2024-04-23T18:46:33.102 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T18:46:33.102 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961 --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} --owner scheduled_suriarte@teuthology --name suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi -- /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/orig.config.yaml 2024-04-23T18:46:33.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T18:46:33.226 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961 branch: rgw-update-boost-redis description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7669961' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rgw-update-boost-redis ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rgw-update-boost-redis sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c owner: scheduled_suriarte@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c sleep_before_teardown: 0 suite: rgw suite_branch: rgw-update-boost-redis suite_path: /home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa suite_relpath: qa suite_repo: https://github.com/samarahu/ceph.git suite_sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c targets: smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5m4oUj4efU6YacigBU5Q1KD6BtJqbHQMGUWHaJySiIo5DcfwP8SDk4I0zckKIs1cBxh98kOjIjrpYtfPZBqLE= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFu7i1OeB2YivgkWSyka1pO4y2n4d66eHKIC7CM/9B12JvnTSF7nPOWbU7IUt+oPm78rZlpsg57lxzHEV9+u2ug= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_15:04:03 tube: smithi user: suriarte verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T18:46:33.226 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa; will attempt to use it 2024-04-23T18:46:33.227 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa/tasks 2024-04-23T18:46:33.227 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T18:46:33.229 INFO:teuthology.task.internal:Checking packages... 2024-04-23T18:46:33.252 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5bf3b3a9b161d70b9aa7806055bdae202e03111c' 2024-04-23T18:46:33.252 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T18:46:33.252 INFO:teuthology.packaging:ref: None 2024-04-23T18:46:33.252 INFO:teuthology.packaging:tag: None 2024-04-23T18:46:33.252 INFO:teuthology.packaging:branch: rgw-update-boost-redis 2024-04-23T18:46:33.252 INFO:teuthology.packaging:sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T18:46:33.253 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rgw-update-boost-redis 2024-04-23T18:46:33.395 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:46:33.396 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T18:46:33.410 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T18:46:33.410 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T18:46:33.437 INFO:teuthology.task.internal:Saving configuration 2024-04-23T18:46:33.452 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T18:46:33.462 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T18:46:33.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 18:40:45.380515', 'locked_by': 'scheduled_suriarte@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIEeNJfV3MFQqlh5WsmH6kad8DExE0E9WpABgrWJ3KCB'} 2024-04-23T18:46:33.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 18:40:45.379229', 'locked_by': 'scheduled_suriarte@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID+gTiqz6BsVVNeZg5L9PCaiXCJoy9jMzfe8SkNt93wz'} 2024-04-23T18:46:33.509 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T18:46:33.518 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-23T18:46:33.518 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-23T18:46:33.518 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T18:46:33.593 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99f950b280>, signals=[15]) 2024-04-23T18:46:33.593 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T18:46:33.601 INFO:teuthology.task.internal:Opening connections... 2024-04-23T18:46:33.601 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T18:46:33.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:46:33.686 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T18:46:33.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:46:33.763 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T18:46:33.769 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-23T18:46:33.775 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-23T18:46:33.775 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-04-23T18:46:33.820 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T18:46:33.821 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T18:46:33.821 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T18:46:33.821 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T18:46:33.821 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-04-23T18:46:33.821 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-23T18:46:33.845 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-04-23T18:46:33.850 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-04-23T18:46:33.850 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu" 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="22.04" 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=jammy 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian 2024-04-23T18:46:33.901 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T18:46:33.902 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T18:46:33.902 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T18:46:33.902 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T18:46:33.902 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=jammy 2024-04-23T18:46:33.902 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-04-23T18:46:33.927 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T18:46:33.937 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T18:46:33.942 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T18:46:33.942 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-04-23T18:46:33.945 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-04-23T18:46:33.949 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T18:46:33.955 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T18:46:33.956 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-04-23T18:46:33.994 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-04-23T18:46:34.011 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T18:46:34.063 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T18:46:34.077 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-23T18:46:34.077 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-23T18:46:34.077 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T18:46:34.078 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T18:46:34.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:46:34.083 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-23T18:46:34.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:46:34.084 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-04-23T18:46:34.129 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-56-generic 2024-04-23T18:46:34.129 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.15.0-56-generic 2024-04-23T18:46:34.129 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-04-23T18:46:34.130 INFO:teuthology.orchestra.run.smithi193.stdout:5.15.0-56-generic 2024-04-23T18:46:34.131 INFO:teuthology.task.kernel:Running kernel on smithi193: 5.15.0-56-generic 2024-04-23T18:46:34.131 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get clean 2024-04-23T18:46:34.269 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-04-23T18:46:34.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-23T18:46:34.414 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:46:34.426 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T18:46:34.426 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T18:46:34.432 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:46:34.447 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T18:46:34.511 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-23T18:46:34.525 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-23T18:46:34.564 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T18:46:34.645 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,392 kB] 2024-04-23T18:46:34.653 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-23T18:46:34.718 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-23T18:46:34.731 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-23T18:46:34.754 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-23T18:46:34.761 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-23T18:46:34.764 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-23T18:46:34.765 INFO:teuthology.orchestra.run.smithi193.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-23T18:46:34.766 INFO:teuthology.orchestra.run.smithi193.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,768 kB] 2024-04-23T18:46:34.779 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-23T18:46:34.783 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-23T18:46:34.783 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-23T18:46:34.783 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-23T18:46:34.801 INFO:teuthology.orchestra.run.smithi193.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-23T18:46:34.806 INFO:teuthology.orchestra.run.smithi193.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T18:46:34.806 INFO:teuthology.orchestra.run.smithi193.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-23T18:46:34.811 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-23T18:46:34.815 INFO:teuthology.orchestra.run.smithi193.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-23T18:46:34.824 INFO:teuthology.orchestra.run.smithi193.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-23T18:46:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-23T18:46:34.832 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T18:46:34.832 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-23T18:46:34.837 INFO:teuthology.orchestra.run.smithi193.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-23T18:46:34.840 INFO:teuthology.orchestra.run.smithi193.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-23T18:46:34.850 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-23T18:46:34.862 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-23T18:46:34.866 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-23T18:46:34.884 INFO:teuthology.orchestra.run.smithi193.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-23T18:46:34.885 INFO:teuthology.orchestra.run.smithi193.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-23T18:46:34.885 INFO:teuthology.orchestra.run.smithi193.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-23T18:46:34.885 INFO:teuthology.orchestra.run.smithi193.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-23T18:46:34.887 INFO:teuthology.orchestra.run.smithi193.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-23T18:46:34.895 INFO:teuthology.orchestra.run.smithi193.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-23T18:46:34.896 INFO:teuthology.orchestra.run.smithi193.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-23T18:46:34.896 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-23T18:46:34.896 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-23T18:46:34.897 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-23T18:46:34.897 INFO:teuthology.orchestra.run.smithi193.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-23T18:46:34.898 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-23T18:46:34.898 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-23T18:46:34.899 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-23T18:46:34.899 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-23T18:46:34.900 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-23T18:46:34.900 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-23T18:46:34.900 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-23T18:46:34.921 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-23T18:46:34.927 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,392 kB] 2024-04-23T18:46:34.932 INFO:teuthology.orchestra.run.smithi193.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-23T18:46:34.938 INFO:teuthology.orchestra.run.smithi193.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T18:46:34.938 INFO:teuthology.orchestra.run.smithi193.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-23T18:46:34.948 INFO:teuthology.orchestra.run.smithi193.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-23T18:46:34.955 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-23T18:46:34.960 INFO:teuthology.orchestra.run.smithi193.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-23T18:46:34.963 INFO:teuthology.orchestra.run.smithi193.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-23T18:46:34.963 INFO:teuthology.orchestra.run.smithi193.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-23T18:46:34.964 INFO:teuthology.orchestra.run.smithi193.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-23T18:46:34.964 INFO:teuthology.orchestra.run.smithi193.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-23T18:46:34.966 INFO:teuthology.orchestra.run.smithi193.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-23T18:46:34.984 INFO:teuthology.orchestra.run.smithi193.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-23T18:46:34.985 INFO:teuthology.orchestra.run.smithi193.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-23T18:46:34.986 INFO:teuthology.orchestra.run.smithi193.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-23T18:46:34.987 INFO:teuthology.orchestra.run.smithi193.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-23T18:46:34.987 INFO:teuthology.orchestra.run.smithi193.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-23T18:46:34.987 INFO:teuthology.orchestra.run.smithi193.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-23T18:46:34.988 INFO:teuthology.orchestra.run.smithi193.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-23T18:46:34.988 INFO:teuthology.orchestra.run.smithi193.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-23T18:46:35.011 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-23T18:46:35.017 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-23T18:46:35.018 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,768 kB] 2024-04-23T18:46:35.048 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-23T18:46:35.048 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-23T18:46:35.053 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T18:46:35.053 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-23T18:46:35.060 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-23T18:46:35.069 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-23T18:46:35.071 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-23T18:46:35.072 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-23T18:46:35.072 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-23T18:46:35.093 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-23T18:46:35.094 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-23T18:46:40.412 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 13.2 MB in 2s (7,392 kB/s) 2024-04-23T18:46:40.477 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 13.2 MB in 2s (7,181 kB/s) 2024-04-23T18:46:41.736 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-04-23T18:46:41.753 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T18:46:41.804 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-04-23T18:46:41.817 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-23T18:46:41.835 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T18:46:41.895 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-23T18:46:41.983 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-04-23T18:46:41.983 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-04-23T18:46:42.082 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-23T18:46:42.082 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-23T18:46:42.137 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:46:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:46:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:46:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:46:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T18:46:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: python2.7-minimal 2024-04-23T18:46:42.138 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:46:42.139 INFO:teuthology.orchestra.run.smithi193.stdout:The following additional packages will be installed: 2024-04-23T18:46:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T18:46:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-23T18:46:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-23T18:46:42.141 INFO:teuthology.orchestra.run.smithi193.stdout:Suggested packages: 2024-04-23T18:46:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-23T18:46:42.141 INFO:teuthology.orchestra.run.smithi193.stdout:Recommended packages: 2024-04-23T18:46:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: thermald 2024-04-23T18:46:42.185 INFO:teuthology.orchestra.run.smithi193.stdout:The following NEW packages will be installed: 2024-04-23T18:46:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T18:46:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-23T18:46:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-23T18:46:42.187 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages will be upgraded: 2024-04-23T18:46:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-23T18:46:42.241 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:46:42.241 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:46:42.241 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:46:42.242 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:46:42.242 INFO:teuthology.orchestra.run.smithi169.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T18:46:42.242 INFO:teuthology.orchestra.run.smithi169.stdout: python2.7-minimal 2024-04-23T18:46:42.242 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:46:42.243 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-23T18:46:42.243 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T18:46:42.243 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-23T18:46:42.244 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-23T18:46:42.245 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-23T18:46:42.245 INFO:teuthology.orchestra.run.smithi169.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-23T18:46:42.245 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-04-23T18:46:42.245 INFO:teuthology.orchestra.run.smithi169.stdout: thermald 2024-04-23T18:46:42.304 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-23T18:46:42.304 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T18:46:42.304 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-23T18:46:42.305 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-23T18:46:42.305 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-04-23T18:46:42.306 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-23T18:46:42.361 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T18:46:42.362 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 113 MB of archives. 2024-04-23T18:46:42.362 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-23T18:46:42.362 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-23T18:46:42.365 INFO:teuthology.orchestra.run.smithi193.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T18:46:42.366 INFO:teuthology.orchestra.run.smithi193.stdout:Need to get 113 MB of archives. 2024-04-23T18:46:42.366 INFO:teuthology.orchestra.run.smithi193.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-23T18:46:42.366 INFO:teuthology.orchestra.run.smithi193.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-23T18:46:42.897 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-23T18:46:43.040 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-23T18:46:43.779 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-23T18:46:44.133 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-23T18:46:44.200 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-23T18:46:44.200 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-23T18:46:44.200 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-23T18:46:44.352 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-23T18:46:44.381 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-23T18:46:44.765 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 113 MB in 2s (54.8 MB/s) 2024-04-23T18:46:44.938 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-23T18:46:46.387 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-23T18:46:46.388 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-23T18:46:46.388 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-23T18:46:46.897 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-23T18:46:46.953 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-23T18:46:47.069 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-23T18:46:47.073 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:46:47.344 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 113 MB in 5s (23.8 MB/s) 2024-04-23T18:46:47.414 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:46:47.500 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-23T18:46:49.419 INFO:teuthology.orchestra.run.smithi193.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-23T18:46:49.423 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:46:49.506 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:46:49.764 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-23T18:46:49.785 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:46:49.873 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:46:50.401 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-23T18:46:50.421 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:46:50.459 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:46:52.024 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-23T18:46:52.045 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:46:52.122 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:46:52.619 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-23T18:46:52.639 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:46:52.685 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:46:57.760 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T18:46:57.878 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T18:46:58.176 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T18:46:58.314 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T18:46:58.641 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-23T18:46:58.663 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-23T18:46:58.708 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T18:46:59.143 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T18:46:59.270 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T18:46:59.603 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T18:46:59.757 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T18:47:00.035 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-23T18:47:00.048 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-23T18:47:00.084 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T18:47:04.967 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-23T18:47:05.004 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:47:05.042 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:05.666 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-23T18:47:05.703 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T18:47:05.740 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:07.740 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T18:47:07.863 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T18:47:08.239 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T18:47:08.385 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:08.511 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-23T18:47:08.656 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:08.871 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T18:47:08.994 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T18:47:09.353 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T18:47:09.491 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:09.617 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-23T18:47:09.729 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:10.082 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:47:10.082 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-23T18:47:10.082 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-23T18:47:10.082 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:10.809 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:11.050 INFO:teuthology.orchestra.run.smithi193.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:47:11.050 INFO:teuthology.orchestra.run.smithi193.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-23T18:47:11.050 INFO:teuthology.orchestra.run.smithi193.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-23T18:47:11.050 INFO:teuthology.orchestra.run.smithi193.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:11.215 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:12.236 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:12.592 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:13.620 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-23T18:47:13.746 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-23T18:47:13.865 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:13.928 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-23T18:47:13.928 INFO:teuthology.orchestra.run.smithi169.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:13.993 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-23T18:47:14.110 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-23T18:47:14.212 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T18:47:14.272 INFO:teuthology.orchestra.run.smithi193.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-23T18:47:14.272 INFO:teuthology.orchestra.run.smithi193.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:28.183 INFO:teuthology.orchestra.run.smithi193.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-23T18:47:28.183 INFO:teuthology.orchestra.run.smithi193.stdout:Sourcing file `/etc/default/grub' 2024-04-23T18:47:28.200 INFO:teuthology.orchestra.run.smithi193.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T18:47:28.219 INFO:teuthology.orchestra.run.smithi193.stdout:Generating grub configuration file ... 2024-04-23T18:47:28.473 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T18:47:28.489 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:28.541 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-23T18:47:28.541 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub' 2024-04-23T18:47:28.560 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T18:47:28.605 INFO:teuthology.orchestra.run.smithi169.stdout:Generating grub configuration file ... 2024-04-23T18:47:28.773 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:47:28.778 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T18:47:28.845 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T18:47:28.850 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T18:47:28.929 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T18:47:28.949 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:29.010 INFO:teuthology.orchestra.run.smithi193.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T18:47:29.010 INFO:teuthology.orchestra.run.smithi193.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T18:47:29.010 INFO:teuthology.orchestra.run.smithi193.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T18:47:29.055 INFO:teuthology.orchestra.run.smithi193.stdout:done 2024-04-23T18:47:29.297 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:47:29.303 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T18:47:29.379 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T18:47:29.385 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T18:47:29.512 DEBUG:teuthology.orchestra.run.smithi193:> dpkg -s linux-image-generic 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Package: linux-image-generic 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Status: install ok installed 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Priority: optional 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Section: kernel 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Installed-Size: 21 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: amd64 2024-04-23T18:47:29.532 INFO:teuthology.orchestra.run.smithi193.stdout:Source: linux-meta 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout:Version: 5.15.0.105.102 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout:Recommends: thermald 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout:Description: Generic Linux kernel image 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout: This package will always depend on the latest generic kernel image 2024-04-23T18:47:29.533 INFO:teuthology.orchestra.run.smithi193.stdout: available. 2024-04-23T18:47:29.533 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-23T18:47:29.533 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-23T18:47:29.533 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-23T18:47:29.534 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-23T18:47:29.534 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi193.front.sepia.ceph.com, path=None, version=distro) 2024-04-23T18:47:29.534 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get clean 2024-04-23T18:47:29.553 INFO:teuthology.orchestra.run.smithi169.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T18:47:29.553 INFO:teuthology.orchestra.run.smithi169.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T18:47:29.553 INFO:teuthology.orchestra.run.smithi169.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T18:47:29.593 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-04-23T18:47:29.696 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-04-23T18:47:29.815 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T18:47:29.928 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:47:30.025 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T18:47:30.030 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-04-23T18:47:30.054 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-04-23T18:47:30.055 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-04-23T18:47:30.056 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.105.102 2024-04-23T18:47:30.056 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T18:47:30.056 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T18:47:30.056 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-04-23T18:47:30.056 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-04-23T18:47:30.056 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-04-23T18:47:30.057 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-04-23T18:47:30.057 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-23T18:47:30.057 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-23T18:47:30.057 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-23T18:47:30.057 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-23T18:47:30.057 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-04-23T18:47:30.058 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-04-23T18:47:30.091 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T18:47:30.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-23T18:47:30.357 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:47:30.372 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T18:47:30.392 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T18:47:30.474 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T18:47:31.210 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-04-23T18:47:31.229 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T18:47:31.280 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-04-23T18:47:31.458 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-04-23T18:47:31.459 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-04-23T18:47:31.616 INFO:teuthology.orchestra.run.smithi193.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-23T18:47:31.616 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:47:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:47:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:47:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:47:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T18:47:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T18:47:31.617 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:47:31.657 INFO:teuthology.orchestra.run.smithi193.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T18:47:31.660 DEBUG:teuthology.orchestra.run.smithi193:> dpkg -s linux-image-generic 2024-04-23T18:47:31.719 INFO:teuthology.orchestra.run.smithi193.stdout:Package: linux-image-generic 2024-04-23T18:47:31.719 INFO:teuthology.orchestra.run.smithi193.stdout:Status: install ok installed 2024-04-23T18:47:31.720 INFO:teuthology.orchestra.run.smithi193.stdout:Priority: optional 2024-04-23T18:47:31.720 INFO:teuthology.orchestra.run.smithi193.stdout:Section: kernel 2024-04-23T18:47:31.720 INFO:teuthology.orchestra.run.smithi193.stdout:Installed-Size: 21 2024-04-23T18:47:31.720 INFO:teuthology.orchestra.run.smithi193.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T18:47:31.720 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: amd64 2024-04-23T18:47:31.720 INFO:teuthology.orchestra.run.smithi193.stdout:Source: linux-meta 2024-04-23T18:47:31.721 INFO:teuthology.orchestra.run.smithi193.stdout:Version: 5.15.0.105.102 2024-04-23T18:47:31.721 INFO:teuthology.orchestra.run.smithi193.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T18:47:31.721 INFO:teuthology.orchestra.run.smithi193.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T18:47:31.721 INFO:teuthology.orchestra.run.smithi193.stdout:Recommends: thermald 2024-04-23T18:47:31.721 INFO:teuthology.orchestra.run.smithi193.stdout:Description: Generic Linux kernel image 2024-04-23T18:47:31.721 INFO:teuthology.orchestra.run.smithi193.stdout: This package will always depend on the latest generic kernel image 2024-04-23T18:47:31.722 INFO:teuthology.orchestra.run.smithi193.stdout: available. 2024-04-23T18:47:31.722 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-04-23T18:47:31.759 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-23T18:47:31.765 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.cugwOSLvGt 2024-04-23T18:47:31.765 DEBUG:teuthology.orchestra.run.smithi193:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cugwOSLvGt 2024-04-23T18:47:31.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T18:47:31.821 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.cugwOSLvGt 2024-04-23T18:47:31.841 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-23T18:47:31.938 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.cugwOSLvGt is 10KB 2024-04-23T18:47:31.951 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.cugwOSLvGt 2024-04-23T18:47:31.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-23T18:47:32.012 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:47:32.012 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-23T18:47:32.012 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-23T18:47:32.042 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-23T18:47:32.043 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-23T18:47:32.093 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-23T18:47:32.093 DEBUG:teuthology.orchestra.run.smithi193:> sudo update-grub 2024-04-23T18:47:32.221 INFO:teuthology.orchestra.run.smithi169.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-23T18:47:32.221 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:47:32.222 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:47:32.222 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:47:32.222 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:47:32.222 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T18:47:32.222 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T18:47:32.223 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:47:32.265 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T18:47:32.267 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-04-23T18:47:32.283 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.105.102 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-04-23T18:47:32.284 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-04-23T18:47:32.284 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-23T18:47:32.331 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.ySZtxg2VM2 2024-04-23T18:47:32.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ySZtxg2VM2 2024-04-23T18:47:32.388 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.ySZtxg2VM2 2024-04-23T18:47:32.509 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.ySZtxg2VM2 is 10KB 2024-04-23T18:47:32.523 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.ySZtxg2VM2 2024-04-23T18:47:32.528 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-23T18:47:32.583 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:47:32.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-23T18:47:32.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-23T18:47:32.652 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-23T18:47:32.652 DEBUG:teuthology.orchestra.run.smithi169:> sudo update-grub 2024-04-23T18:47:33.274 INFO:teuthology.orchestra.run.smithi193.stderr:Sourcing file `/etc/default/grub' 2024-04-23T18:47:33.275 INFO:teuthology.orchestra.run.smithi193.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T18:47:33.277 INFO:teuthology.orchestra.run.smithi193.stderr:Generating grub configuration file ... 2024-04-23T18:47:33.486 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T18:47:33.492 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:33.731 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:47:33.737 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T18:47:33.778 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T18:47:33.783 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T18:47:33.911 INFO:teuthology.orchestra.run.smithi193.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T18:47:33.911 INFO:teuthology.orchestra.run.smithi193.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T18:47:33.911 INFO:teuthology.orchestra.run.smithi193.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T18:47:33.932 INFO:teuthology.orchestra.run.smithi193.stderr:done 2024-04-23T18:47:33.941 DEBUG:teuthology.orchestra.run.smithi193:> sudo shutdown -r now 2024-04-23T18:47:33.953 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub' 2024-04-23T18:47:33.954 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T18:47:33.957 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-04-23T18:47:34.145 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T18:47:34.151 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T18:47:34.422 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:47:34.426 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T18:47:34.465 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T18:47:34.470 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T18:47:34.575 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T18:47:34.575 INFO:teuthology.orchestra.run.smithi169.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T18:47:34.575 INFO:teuthology.orchestra.run.smithi169.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T18:47:34.586 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-04-23T18:47:34.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-04-23T18:48:03.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-23T18:48:03.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-23T18:48:03.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:48:04.590 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-23T18:48:04.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:48:04.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:48:22.307 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-23T18:48:23.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-23T18:48:31.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-23T18:48:31.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:48:32.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:48:32.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:48:34.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-23T18:48:35.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-23T18:48:46.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-23T18:48:46.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:48:47.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:48:47.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:49:18.218 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-04-23T18:49:18.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-23T18:49:18.809 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-23T18:49:18.809 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-04-23T18:49:18.857 INFO:teuthology.orchestra.run.smithi193.stdout:5.15.0-105-generic 2024-04-23T18:49:18.857 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-23T18:49:18.857 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T18:49:18.857 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T18:49:19.858 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-23T18:49:19.858 DEBUG:teuthology.orchestra.run.smithi193:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T18:49:19.939 INFO:teuthology.orchestra.run.smithi193.stdout:ttyS1 2024-04-23T18:49:19.963 DEBUG:teuthology.parallel:result is None 2024-04-23T18:49:47.139 DEBUG:teuthology.orchestra.remote:timed out 2024-04-23T18:50:02.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:50:02.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:50:02.394 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-23T18:50:02.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:50:02.920 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-23T18:50:02.920 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-23T18:50:02.969 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-105-generic 2024-04-23T18:50:02.969 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-23T18:50:02.969 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T18:50:02.969 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T18:50:03.970 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T18:50:03.971 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T18:50:04.030 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-04-23T18:50:04.050 DEBUG:teuthology.parallel:result is None 2024-04-23T18:50:04.051 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T18:50:04.057 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T18:50:04.057 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T18:50:04.060 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T18:50:04.066 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T18:50:04.080 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T18:50:04.087 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T18:50:04.088 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T18:50:04.108 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T18:50:04.132 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T18:50:04.138 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T18:50:04.139 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T18:50:04.162 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T18:50:04.175 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:50:04.183 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:50:04.193 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:50:04.200 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:50:04.202 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T18:50:04.209 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T18:50:04.210 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T18:50:04.230 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T18:50:04.266 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T18:50:04.275 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T18:50:04.275 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T18:50:04.294 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T18:50:04.315 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:50:04.345 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:50:04.393 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:50:04.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T18:50:04.457 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:50:04.463 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:50:04.510 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:50:04.510 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T18:50:04.576 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-04-23T18:50:04.579 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-04-23T18:50:04.656 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T18:50:04.663 INFO:teuthology.task.internal:Starting timer... 2024-04-23T18:50:04.664 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T18:50:04.675 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T18:50:04.688 DEBUG:teuthology.task.selinux:Excluding smithi169: OS 'ubuntu' does not support SELinux 2024-04-23T18:50:04.689 DEBUG:teuthology.task.selinux:Excluding smithi193: OS 'ubuntu' does not support SELinux 2024-04-23T18:50:04.689 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T18:50:04.689 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-23T18:50:04.690 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T18:50:04.690 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T18:50:04.703 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-23T18:50:04.708 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-23T18:50:04.833 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T18:50:04.849 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T18:50:04.850 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi169.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T18:57:11.784 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi169.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-04-23T18:57:11.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:57:11.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:57:11.865 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-23T18:57:11.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-23T18:57:11.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-23T18:57:11.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:57:12.015 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-04-23T18:57:12.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-23T18:57:12.090 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T18:57:12.101 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T18:57:12.102 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T18:57:12.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:57:12.104 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T18:57:12.105 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Command line: ntpd -gq 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: ---------------------------------------------------- 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: corporation. Support and training for ntp-4 are 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: available at https://www.nwtime.org/support 2024-04-23T18:57:12.130 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: ---------------------------------------------------- 2024-04-23T18:57:12.131 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: proto: precision = 0.046 usec (-24) 2024-04-23T18:57:12.131 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: basedate set to 2022-02-04 2024-04-23T18:57:12.131 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: gps base set to 2022-02-06 (week 2196) 2024-04-23T18:57:12.131 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:57:12.131 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:57:12.132 INFO:teuthology.orchestra.run.smithi169.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:57:12.132 INFO:teuthology.orchestra.run.smithi169.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:57:12.132 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T18:57:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T18:57:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T18:57:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listen normally on 3 enp3s0f1 172.21.15.169:123 2024-04-23T18:57:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listen normally on 4 lo [::1]:123 2024-04-23T18:57:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f4d%5]:123 2024-04-23T18:57:12.133 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:12 ntpd[17232]: Listening on routing socket on fd #22 for interface updates 2024-04-23T18:57:12.156 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T18:57:12.156 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Command line: ntpd -gq 2024-04-23T18:57:12.156 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: ---------------------------------------------------- 2024-04-23T18:57:12.156 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T18:57:12.157 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T18:57:12.157 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: corporation. Support and training for ntp-4 are 2024-04-23T18:57:12.157 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: available at https://www.nwtime.org/support 2024-04-23T18:57:12.157 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: ---------------------------------------------------- 2024-04-23T18:57:12.157 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: proto: precision = 0.044 usec (-24) 2024-04-23T18:57:12.157 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: basedate set to 2022-02-04 2024-04-23T18:57:12.158 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: gps base set to 2022-02-06 (week 2196) 2024-04-23T18:57:12.158 INFO:teuthology.orchestra.run.smithi193.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:57:12.158 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:57:12.158 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:57:12.159 INFO:teuthology.orchestra.run.smithi193.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:57:12.159 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T18:57:12.159 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T18:57:12.159 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T18:57:12.160 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listen normally on 3 enp3s0f1 172.21.15.193:123 2024-04-23T18:57:12.160 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listen normally on 4 lo [::1]:123 2024-04-23T18:57:12.160 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7253%5]:123 2024-04-23T18:57:12.160 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:12 ntpd[17240]: Listening on routing socket on fd #22 for interface updates 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:13.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:13.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:13.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:13.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:13 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:13.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:13 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:13.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:13 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:13.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:13 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:13.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:13 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:13.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:13 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:13.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:13 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:14.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:14 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:14.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:14 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:14.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:14 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:14.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:14 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:14.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:14 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:14.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:14 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:14 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:14 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:14 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:14.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:14 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:14 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:14.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:14 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:15.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:15 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:15 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:16.130 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:16.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:16 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:16.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:16.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:16 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:16.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:16.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:16 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:16 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:17.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:17.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:17.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:17 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:17 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:17 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:17 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:17 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:17 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:17 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:18.130 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:18.130 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:18 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:18.130 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:18.130 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:18 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:18.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:18.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:18 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:18.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:18.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:18.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:18.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:18.159 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:18 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:19.130 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stdout:23 Apr 18:57:19 ntpd[17232]: ntpd: time slew -0.000362 s 2024-04-23T18:57:19.131 INFO:teuthology.orchestra.run.smithi169.stdout:ntpd: time slew -0.000362s 2024-04-23T18:57:19.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T18:57:19.132 INFO:teuthology.orchestra.run.smithi169.stderr:23 Apr 18:57:19 ntpd[17232]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T18:57:19.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:19.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:19.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:57:19.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:57:19.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:57:19.157 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:57:19.158 INFO:teuthology.orchestra.run.smithi193.stdout:23 Apr 18:57:19 ntpd[17240]: ntpd: time slew -0.001098 s 2024-04-23T18:57:19.158 INFO:teuthology.orchestra.run.smithi193.stdout:ntpd: time slew -0.001098s 2024-04-23T18:57:19.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T18:57:19.158 INFO:teuthology.orchestra.run.smithi193.stderr:23 Apr 18:57:19 ntpd[17240]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T18:57:19.182 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T18:57:19.183 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-04-23T18:57:19.183 INFO:teuthology.orchestra.run.smithi169.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.183 INFO:teuthology.orchestra.run.smithi169.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.183 INFO:teuthology.orchestra.run.smithi169.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.183 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.216 INFO:teuthology.orchestra.run.smithi193.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T18:57:19.216 INFO:teuthology.orchestra.run.smithi193.stdout:============================================================================== 2024-04-23T18:57:19.216 INFO:teuthology.orchestra.run.smithi193.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.216 INFO:teuthology.orchestra.run.smithi193.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.216 INFO:teuthology.orchestra.run.smithi193.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.216 INFO:teuthology.orchestra.run.smithi193.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:57:19.216 INFO:teuthology.run_tasks:Running task install... 2024-04-23T18:57:19.224 DEBUG:teuthology.task.install:project ceph 2024-04-23T18:57:19.224 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}} 2024-04-23T18:57:19.224 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'} 2024-04-23T18:57:19.224 INFO:teuthology.task.install:Using flavor: default 2024-04-23T18:57:19.229 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T18:57:19.230 INFO:teuthology.task.install:extra packages: [] 2024-04-23T18:57:19.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-key list | grep Ceph 2024-04-23T18:57:19.231 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-key list | grep Ceph 2024-04-23T18:57:19.289 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T18:57:19.315 INFO:teuthology.orchestra.run.smithi193.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T18:57:19.317 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T18:57:19.317 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T18:57:19.318 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-23T18:57:19.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T18:57:19.343 INFO:teuthology.orchestra.run.smithi193.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T18:57:19.343 INFO:teuthology.orchestra.run.smithi193.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T18:57:19.343 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-23T18:57:19.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T18:57:19.466 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default/ 2024-04-23T18:57:19.466 INFO:teuthology.task.install.deb:Package version is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:57:19.486 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default/ 2024-04-23T18:57:19.486 INFO:teuthology.task.install.deb:Package version is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:57:19.604 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:57:19.604 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T18:57:19.620 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-04-23T18:57:19.670 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:57:19.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T18:57:19.684 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-23T18:57:19.810 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:57:19.840 INFO:teuthology.orchestra.run.smithi193.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T18:57:19.848 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T18:57:19.860 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T18:57:19.882 INFO:teuthology.orchestra.run.smithi193.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T18:57:19.889 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T18:57:19.903 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2024-04-23T18:57:19.909 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T18:57:19.910 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T18:57:19.910 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T18:57:19.930 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-23T18:57:19.931 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T18:57:19.956 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T18:57:19.978 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-23T18:57:19.987 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:57:20.011 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2024-04-23T18:57:20.068 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T18:57:20.164 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 29.2 kB in 0s (80.2 kB/s) 2024-04-23T18:57:20.429 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T18:57:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 148 kB in 1s (203 kB/s) 2024-04-23T18:57:21.164 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-04-23T18:57:21.181 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3101-g5bf3b3a9-1jammy cephadm=19.0.0-3101-g5bf3b3a9-1jammy ceph-mds=19.0.0-3101-g5bf3b3a9-1jammy ceph-mgr=19.0.0-3101-g5bf3b3a9-1jammy ceph-common=19.0.0-3101-g5bf3b3a9-1jammy ceph-fuse=19.0.0-3101-g5bf3b3a9-1jammy ceph-test=19.0.0-3101-g5bf3b3a9-1jammy ceph-volume=19.0.0-3101-g5bf3b3a9-1jammy radosgw=19.0.0-3101-g5bf3b3a9-1jammy python3-rados=19.0.0-3101-g5bf3b3a9-1jammy python3-rgw=19.0.0-3101-g5bf3b3a9-1jammy python3-cephfs=19.0.0-3101-g5bf3b3a9-1jammy python3-rbd=19.0.0-3101-g5bf3b3a9-1jammy libcephfs2=19.0.0-3101-g5bf3b3a9-1jammy libcephfs-dev=19.0.0-3101-g5bf3b3a9-1jammy librados2=19.0.0-3101-g5bf3b3a9-1jammy librbd1=19.0.0-3101-g5bf3b3a9-1jammy rbd-fuse=19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:57:21.233 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-04-23T18:57:21.409 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-04-23T18:57:21.410 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-04-23T18:57:21.583 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:57:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:57:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:57:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:57:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T18:57:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T18:57:21.584 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:57:21.584 INFO:teuthology.orchestra.run.smithi193.stdout:The following additional packages will be installed: 2024-04-23T18:57:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T18:57:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T18:57:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T18:57:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T18:57:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-23T18:57:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet zip 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout:Suggested packages: 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout:Recommended packages: 2024-04-23T18:57:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: btrfs-tools 2024-04-23T18:57:21.624 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-23T18:57:21.642 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3101-g5bf3b3a9-1jammy cephadm=19.0.0-3101-g5bf3b3a9-1jammy ceph-mds=19.0.0-3101-g5bf3b3a9-1jammy ceph-mgr=19.0.0-3101-g5bf3b3a9-1jammy ceph-common=19.0.0-3101-g5bf3b3a9-1jammy ceph-fuse=19.0.0-3101-g5bf3b3a9-1jammy ceph-test=19.0.0-3101-g5bf3b3a9-1jammy ceph-volume=19.0.0-3101-g5bf3b3a9-1jammy radosgw=19.0.0-3101-g5bf3b3a9-1jammy python3-rados=19.0.0-3101-g5bf3b3a9-1jammy python3-rgw=19.0.0-3101-g5bf3b3a9-1jammy python3-cephfs=19.0.0-3101-g5bf3b3a9-1jammy python3-rbd=19.0.0-3101-g5bf3b3a9-1jammy libcephfs2=19.0.0-3101-g5bf3b3a9-1jammy libcephfs-dev=19.0.0-3101-g5bf3b3a9-1jammy librados2=19.0.0-3101-g5bf3b3a9-1jammy librbd1=19.0.0-3101-g5bf3b3a9-1jammy rbd-fuse=19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:57:21.685 INFO:teuthology.orchestra.run.smithi193.stdout:The following NEW packages will be installed: 2024-04-23T18:57:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T18:57:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T18:57:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-23T18:57:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-23T18:57:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-23T18:57:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-23T18:57:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-23T18:57:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-23T18:57:21.703 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-23T18:57:21.880 INFO:teuthology.orchestra.run.smithi193.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-23T18:57:21.880 INFO:teuthology.orchestra.run.smithi193.stdout:Need to get 181 MB of archives. 2024-04-23T18:57:21.880 INFO:teuthology.orchestra.run.smithi193.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-23T18:57:21.880 INFO:teuthology.orchestra.run.smithi193.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T18:57:21.902 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-23T18:57:21.902 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-23T18:57:21.911 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,554 kB] 2024-04-23T18:57:22.084 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:57:22.084 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:57:22.084 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:57:22.084 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:57:22.085 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T18:57:22.085 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T18:57:22.085 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:57:22.086 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-23T18:57:22.086 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T18:57:22.086 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T18:57:22.086 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T18:57:22.086 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T18:57:22.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet zip 2024-04-23T18:57:22.088 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-04-23T18:57:22.089 INFO:teuthology.orchestra.run.smithi169.stdout: btrfs-tools 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-23T18:57:22.187 INFO:teuthology.orchestra.run.smithi169.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-23T18:57:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-23T18:57:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-23T18:57:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-23T18:57:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-23T18:57:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-23T18:57:22.188 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-23T18:57:22.189 INFO:teuthology.orchestra.run.smithi169.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-23T18:57:22.234 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,224 kB] 2024-04-23T18:57:22.254 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-23T18:57:22.254 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 181 MB of archives. 2024-04-23T18:57:22.254 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-23T18:57:22.254 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T18:57:22.313 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T18:57:22.326 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T18:57:22.335 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [712 kB] 2024-04-23T18:57:22.356 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3101-g5bf3b3a9-1jammy [356 kB] 2024-04-23T18:57:22.366 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3101-g5bf3b3a9-1jammy [32.8 kB] 2024-04-23T18:57:22.368 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3101-g5bf3b3a9-1jammy [180 kB] 2024-04-23T18:57:22.373 INFO:teuthology.orchestra.run.smithi193.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3101-g5bf3b3a9-1jammy [66.9 kB] 2024-04-23T18:57:22.375 INFO:teuthology.orchestra.run.smithi193.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3101-g5bf3b3a9-1jammy [330 kB] 2024-04-23T18:57:22.378 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T18:57:22.382 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T18:57:22.383 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,554 kB] 2024-04-23T18:57:22.386 INFO:teuthology.orchestra.run.smithi193.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,895 kB] 2024-04-23T18:57:22.404 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T18:57:22.414 INFO:teuthology.orchestra.run.smithi193.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T18:57:22.482 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T18:57:22.487 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T18:57:22.501 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T18:57:22.505 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T18:57:22.506 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T18:57:22.507 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T18:57:22.516 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T18:57:22.518 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T18:57:22.521 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T18:57:22.525 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T18:57:22.549 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T18:57:22.551 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T18:57:22.554 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T18:57:22.556 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T18:57:22.556 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T18:57:22.557 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T18:57:22.558 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T18:57:22.558 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T18:57:22.559 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T18:57:22.581 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T18:57:22.582 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T18:57:22.582 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T18:57:22.583 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T18:57:22.604 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T18:57:22.605 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T18:57:22.606 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T18:57:22.607 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T18:57:22.608 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T18:57:22.609 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T18:57:22.628 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T18:57:22.629 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T18:57:22.631 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T18:57:22.631 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T18:57:22.638 INFO:teuthology.orchestra.run.smithi193.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [112 kB] 2024-04-23T18:57:22.643 INFO:teuthology.orchestra.run.smithi193.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [466 kB] 2024-04-23T18:57:22.652 INFO:teuthology.orchestra.run.smithi193.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T18:57:22.656 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T18:57:22.656 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T18:57:22.657 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T18:57:22.658 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T18:57:22.660 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T18:57:22.662 INFO:teuthology.orchestra.run.smithi193.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3101-g5bf3b3a9-1jammy [25.8 MB] 2024-04-23T18:57:22.663 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T18:57:22.664 INFO:teuthology.orchestra.run.smithi193.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T18:57:22.688 INFO:teuthology.orchestra.run.smithi169.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T18:57:22.690 INFO:teuthology.orchestra.run.smithi169.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T18:57:22.692 INFO:teuthology.orchestra.run.smithi169.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T18:57:22.694 INFO:teuthology.orchestra.run.smithi193.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T18:57:22.695 INFO:teuthology.orchestra.run.smithi169.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T18:57:22.703 INFO:teuthology.orchestra.run.smithi193.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T18:57:22.704 INFO:teuthology.orchestra.run.smithi193.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T18:57:22.705 INFO:teuthology.orchestra.run.smithi193.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T18:57:22.720 INFO:teuthology.orchestra.run.smithi169.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T18:57:22.722 INFO:teuthology.orchestra.run.smithi169.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T18:57:22.725 INFO:teuthology.orchestra.run.smithi193.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T18:57:22.726 INFO:teuthology.orchestra.run.smithi169.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T18:57:22.809 INFO:teuthology.orchestra.run.smithi169.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T18:57:22.810 INFO:teuthology.orchestra.run.smithi169.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T18:57:22.811 INFO:teuthology.orchestra.run.smithi169.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T18:57:22.812 INFO:teuthology.orchestra.run.smithi169.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T18:57:22.814 INFO:teuthology.orchestra.run.smithi169.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T18:57:22.844 INFO:teuthology.orchestra.run.smithi169.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T18:57:22.846 INFO:teuthology.orchestra.run.smithi169.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T18:57:22.847 INFO:teuthology.orchestra.run.smithi169.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T18:57:22.878 INFO:teuthology.orchestra.run.smithi169.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T18:57:22.878 INFO:teuthology.orchestra.run.smithi169.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T18:57:22.879 INFO:teuthology.orchestra.run.smithi169.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T18:57:22.879 INFO:teuthology.orchestra.run.smithi169.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T18:57:22.880 INFO:teuthology.orchestra.run.smithi169.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T18:57:22.885 INFO:teuthology.orchestra.run.smithi169.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T18:57:22.885 INFO:teuthology.orchestra.run.smithi169.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T18:57:22.886 INFO:teuthology.orchestra.run.smithi169.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T18:57:22.890 INFO:teuthology.orchestra.run.smithi169.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T18:57:22.893 INFO:teuthology.orchestra.run.smithi193.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T18:57:22.905 INFO:teuthology.orchestra.run.smithi169.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T18:57:22.907 INFO:teuthology.orchestra.run.smithi169.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T18:57:22.908 INFO:teuthology.orchestra.run.smithi169.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T18:57:22.912 INFO:teuthology.orchestra.run.smithi169.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T18:57:22.915 INFO:teuthology.orchestra.run.smithi169.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T18:57:22.916 INFO:teuthology.orchestra.run.smithi169.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T18:57:22.927 INFO:teuthology.orchestra.run.smithi169.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T18:57:22.933 INFO:teuthology.orchestra.run.smithi169.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T18:57:22.933 INFO:teuthology.orchestra.run.smithi169.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T18:57:22.937 INFO:teuthology.orchestra.run.smithi169.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T18:57:22.948 INFO:teuthology.orchestra.run.smithi169.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T18:57:22.949 INFO:teuthology.orchestra.run.smithi169.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T18:57:22.949 INFO:teuthology.orchestra.run.smithi169.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T18:57:22.953 INFO:teuthology.orchestra.run.smithi169.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T18:57:22.954 INFO:teuthology.orchestra.run.smithi169.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T18:57:22.962 INFO:teuthology.orchestra.run.smithi169.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T18:57:22.969 INFO:teuthology.orchestra.run.smithi169.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T18:57:22.969 INFO:teuthology.orchestra.run.smithi169.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T18:57:22.972 INFO:teuthology.orchestra.run.smithi169.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T18:57:22.973 INFO:teuthology.orchestra.run.smithi169.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T18:57:23.304 INFO:teuthology.orchestra.run.smithi193.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T18:57:23.348 INFO:teuthology.orchestra.run.smithi193.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T18:57:23.351 INFO:teuthology.orchestra.run.smithi193.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T18:57:23.429 INFO:teuthology.orchestra.run.smithi193.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T18:57:23.480 INFO:teuthology.orchestra.run.smithi169.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,224 kB] 2024-04-23T18:57:23.481 INFO:teuthology.orchestra.run.smithi193.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T18:57:23.504 INFO:teuthology.orchestra.run.smithi193.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T18:57:23.511 INFO:teuthology.orchestra.run.smithi193.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T18:57:23.512 INFO:teuthology.orchestra.run.smithi193.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T18:57:23.526 INFO:teuthology.orchestra.run.smithi193.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T18:57:23.526 INFO:teuthology.orchestra.run.smithi193.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T18:57:23.691 INFO:teuthology.orchestra.run.smithi193.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T18:57:23.705 INFO:teuthology.orchestra.run.smithi193.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3101-g5bf3b3a9-1jammy [5,092 kB] 2024-04-23T18:57:23.784 INFO:teuthology.orchestra.run.smithi193.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T18:57:23.813 INFO:teuthology.orchestra.run.smithi193.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T18:57:23.830 INFO:teuthology.orchestra.run.smithi193.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T18:57:23.838 INFO:teuthology.orchestra.run.smithi193.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3101-g5bf3b3a9-1jammy [244 kB] 2024-04-23T18:57:23.853 INFO:teuthology.orchestra.run.smithi193.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-23T18:57:23.859 INFO:teuthology.orchestra.run.smithi193.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3101-g5bf3b3a9-1jammy [1,525 kB] 2024-04-23T18:57:23.875 INFO:teuthology.orchestra.run.smithi193.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T18:57:23.929 INFO:teuthology.orchestra.run.smithi193.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,258 kB] 2024-04-23T18:57:24.027 INFO:teuthology.orchestra.run.smithi169.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [712 kB] 2024-04-23T18:57:24.087 INFO:teuthology.orchestra.run.smithi193.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T18:57:24.102 INFO:teuthology.orchestra.run.smithi193.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T18:57:24.108 INFO:teuthology.orchestra.run.smithi193.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T18:57:24.114 INFO:teuthology.orchestra.run.smithi193.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T18:57:24.119 INFO:teuthology.orchestra.run.smithi169.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3101-g5bf3b3a9-1jammy [356 kB] 2024-04-23T18:57:24.135 INFO:teuthology.orchestra.run.smithi193.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T18:57:24.140 INFO:teuthology.orchestra.run.smithi193.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T18:57:24.183 INFO:teuthology.orchestra.run.smithi169.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3101-g5bf3b3a9-1jammy [32.8 kB] 2024-04-23T18:57:24.184 INFO:teuthology.orchestra.run.smithi193.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3101-g5bf3b3a9-1jammy [22.8 MB] 2024-04-23T18:57:24.185 INFO:teuthology.orchestra.run.smithi169.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3101-g5bf3b3a9-1jammy [180 kB] 2024-04-23T18:57:24.205 INFO:teuthology.orchestra.run.smithi169.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3101-g5bf3b3a9-1jammy [66.9 kB] 2024-04-23T18:57:24.211 INFO:teuthology.orchestra.run.smithi169.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3101-g5bf3b3a9-1jammy [330 kB] 2024-04-23T18:57:24.270 INFO:teuthology.orchestra.run.smithi169.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,895 kB] 2024-04-23T18:57:24.339 INFO:teuthology.orchestra.run.smithi193.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T18:57:24.657 INFO:teuthology.orchestra.run.smithi193.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T18:57:24.695 INFO:teuthology.orchestra.run.smithi193.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T18:57:24.709 INFO:teuthology.orchestra.run.smithi193.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T18:57:24.912 INFO:teuthology.orchestra.run.smithi193.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T18:57:24.912 INFO:teuthology.orchestra.run.smithi193.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T18:57:24.919 INFO:teuthology.orchestra.run.smithi193.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T18:57:24.924 INFO:teuthology.orchestra.run.smithi193.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T18:57:24.940 INFO:teuthology.orchestra.run.smithi193.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T18:57:24.960 INFO:teuthology.orchestra.run.smithi193.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T18:57:24.966 INFO:teuthology.orchestra.run.smithi193.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T18:57:25.109 INFO:teuthology.orchestra.run.smithi169.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [112 kB] 2024-04-23T18:57:25.119 INFO:teuthology.orchestra.run.smithi169.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [466 kB] 2024-04-23T18:57:25.143 INFO:teuthology.orchestra.run.smithi193.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T18:57:25.174 INFO:teuthology.orchestra.run.smithi169.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3101-g5bf3b3a9-1jammy [25.8 MB] 2024-04-23T18:57:25.277 INFO:teuthology.orchestra.run.smithi193.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [14.0 kB] 2024-04-23T18:57:25.278 INFO:teuthology.orchestra.run.smithi193.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [870 kB] 2024-04-23T18:57:25.300 INFO:teuthology.orchestra.run.smithi193.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3101-g5bf3b3a9-1jammy [2,437 kB] 2024-04-23T18:57:25.360 INFO:teuthology.orchestra.run.smithi193.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3101-g5bf3b3a9-1jammy [791 kB] 2024-04-23T18:57:25.395 INFO:teuthology.orchestra.run.smithi193.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3101-g5bf3b3a9-1jammy [148 kB] 2024-04-23T18:57:25.405 INFO:teuthology.orchestra.run.smithi193.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3101-g5bf3b3a9-1jammy [2,304 kB] 2024-04-23T18:57:25.410 INFO:teuthology.orchestra.run.smithi193.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T18:57:25.509 INFO:teuthology.orchestra.run.smithi193.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3101-g5bf3b3a9-1jammy [8,625 kB] 2024-04-23T18:57:25.595 INFO:teuthology.orchestra.run.smithi193.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T18:57:25.612 INFO:teuthology.orchestra.run.smithi193.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T18:57:25.636 INFO:teuthology.orchestra.run.smithi193.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T18:57:25.712 INFO:teuthology.orchestra.run.smithi193.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T18:57:25.909 INFO:teuthology.orchestra.run.smithi193.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3101-g5bf3b3a9-1jammy [14.2 kB] 2024-04-23T18:57:25.909 INFO:teuthology.orchestra.run.smithi193.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3101-g5bf3b3a9-1jammy [51.6 MB] 2024-04-23T18:57:26.059 INFO:teuthology.orchestra.run.smithi193.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T18:57:26.061 INFO:teuthology.orchestra.run.smithi193.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T18:57:26.063 INFO:teuthology.orchestra.run.smithi193.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T18:57:26.064 INFO:teuthology.orchestra.run.smithi193.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T18:57:26.066 INFO:teuthology.orchestra.run.smithi193.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T18:57:26.290 INFO:teuthology.orchestra.run.smithi193.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T18:57:26.727 INFO:teuthology.orchestra.run.smithi193.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T18:57:26.733 INFO:teuthology.orchestra.run.smithi193.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T18:57:27.038 INFO:teuthology.orchestra.run.smithi193.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T18:57:27.038 INFO:teuthology.orchestra.run.smithi193.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T18:57:27.041 INFO:teuthology.orchestra.run.smithi193.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T18:57:27.042 INFO:teuthology.orchestra.run.smithi193.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T18:57:27.044 INFO:teuthology.orchestra.run.smithi193.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T18:57:27.046 INFO:teuthology.orchestra.run.smithi193.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T18:57:27.047 INFO:teuthology.orchestra.run.smithi193.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T18:57:27.049 INFO:teuthology.orchestra.run.smithi193.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T18:57:27.233 INFO:teuthology.orchestra.run.smithi193.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T18:57:27.667 INFO:teuthology.orchestra.run.smithi193.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T18:57:27.720 INFO:teuthology.orchestra.run.smithi193.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T18:57:27.748 INFO:teuthology.orchestra.run.smithi193.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T18:57:27.864 INFO:teuthology.orchestra.run.smithi193.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T18:57:27.954 INFO:teuthology.orchestra.run.smithi193.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T18:57:27.961 INFO:teuthology.orchestra.run.smithi193.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T18:57:27.964 INFO:teuthology.orchestra.run.smithi193.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T18:57:28.137 INFO:teuthology.orchestra.run.smithi169.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3101-g5bf3b3a9-1jammy [5,092 kB] 2024-04-23T18:57:28.519 INFO:teuthology.orchestra.run.smithi169.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3101-g5bf3b3a9-1jammy [244 kB] 2024-04-23T18:57:28.525 INFO:teuthology.orchestra.run.smithi169.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-23T18:57:28.534 INFO:teuthology.orchestra.run.smithi169.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3101-g5bf3b3a9-1jammy [1,525 kB] 2024-04-23T18:57:28.560 INFO:teuthology.orchestra.run.smithi193.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-23T18:57:28.562 INFO:teuthology.orchestra.run.smithi193.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3101-g5bf3b3a9-1jammy [38.9 kB] 2024-04-23T18:57:28.563 INFO:teuthology.orchestra.run.smithi193.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [13.6 MB] 2024-04-23T18:57:28.592 INFO:teuthology.orchestra.run.smithi169.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,258 kB] 2024-04-23T18:57:29.036 INFO:teuthology.orchestra.run.smithi193.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T18:57:29.059 INFO:teuthology.orchestra.run.smithi193.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [91.4 kB] 2024-04-23T18:57:29.113 INFO:teuthology.orchestra.run.smithi169.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3101-g5bf3b3a9-1jammy [22.8 MB] 2024-04-23T18:57:29.225 INFO:teuthology.orchestra.run.smithi193.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T18:57:29.960 INFO:teuthology.orchestra.run.smithi169.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [14.0 kB] 2024-04-23T18:57:29.961 INFO:teuthology.orchestra.run.smithi169.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [870 kB] 2024-04-23T18:57:29.978 INFO:teuthology.orchestra.run.smithi169.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3101-g5bf3b3a9-1jammy [2,437 kB] 2024-04-23T18:57:30.047 INFO:teuthology.orchestra.run.smithi169.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3101-g5bf3b3a9-1jammy [791 kB] 2024-04-23T18:57:30.070 INFO:teuthology.orchestra.run.smithi169.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3101-g5bf3b3a9-1jammy [148 kB] 2024-04-23T18:57:30.073 INFO:teuthology.orchestra.run.smithi169.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3101-g5bf3b3a9-1jammy [2,304 kB] 2024-04-23T18:57:30.151 INFO:teuthology.orchestra.run.smithi169.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3101-g5bf3b3a9-1jammy [8,625 kB] 2024-04-23T18:57:30.279 INFO:teuthology.orchestra.run.smithi193.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T18:57:30.449 INFO:teuthology.orchestra.run.smithi193.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T18:57:30.493 INFO:teuthology.orchestra.run.smithi169.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3101-g5bf3b3a9-1jammy [14.2 kB] 2024-04-23T18:57:30.506 INFO:teuthology.orchestra.run.smithi169.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3101-g5bf3b3a9-1jammy [51.6 MB] 2024-04-23T18:57:30.722 INFO:teuthology.orchestra.run.smithi193.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T18:57:30.740 INFO:teuthology.orchestra.run.smithi193.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T18:57:30.895 INFO:teuthology.orchestra.run.smithi193.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T18:57:30.924 INFO:teuthology.orchestra.run.smithi193.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T18:57:31.082 INFO:teuthology.orchestra.run.smithi193.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T18:57:31.085 INFO:teuthology.orchestra.run.smithi193.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T18:57:31.087 INFO:teuthology.orchestra.run.smithi193.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T18:57:31.109 INFO:teuthology.orchestra.run.smithi193.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T18:57:31.114 INFO:teuthology.orchestra.run.smithi193.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T18:57:31.782 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 181 MB in 10s (19.0 MB/s) 2024-04-23T18:57:31.923 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T18:57:32.022 INFO:teuthology.orchestra.run.smithi193.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-23T18:57:32.028 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T18:57:32.121 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:57:32.417 INFO:teuthology.orchestra.run.smithi169.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-23T18:57:32.419 INFO:teuthology.orchestra.run.smithi169.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3101-g5bf3b3a9-1jammy [38.9 kB] 2024-04-23T18:57:32.420 INFO:teuthology.orchestra.run.smithi169.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [13.6 MB] 2024-04-23T18:57:32.458 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T18:57:32.484 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T18:57:32.525 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:57:32.779 INFO:teuthology.orchestra.run.smithi169.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [91.4 kB] 2024-04-23T18:57:32.819 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T18:57:32.845 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T18:57:32.877 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:57:33.306 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T18:57:33.332 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:57:33.381 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:57:33.409 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 181 MB in 11s (17.0 MB/s) 2024-04-23T18:57:33.556 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T18:57:33.654 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-23T18:57:33.660 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T18:57:33.747 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:57:33.776 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T18:57:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:57:33.851 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:57:34.067 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T18:57:34.093 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T18:57:34.135 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:57:34.162 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T18:57:34.189 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:57:34.220 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:57:34.411 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T18:57:34.438 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T18:57:34.470 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:57:34.582 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T18:57:34.608 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T18:57:34.648 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:57:34.915 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T18:57:34.942 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:57:34.968 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librados2. 2024-04-23T18:57:34.989 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:57:34.994 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../007-librados2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:35.034 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:35.446 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librbd1. 2024-04-23T18:57:35.472 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../008-librbd1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:35.512 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:35.618 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T18:57:35.645 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:57:35.685 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:57:35.915 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T18:57:35.941 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:35.981 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:36.154 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T18:57:36.181 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:57:36.221 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:57:36.259 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rados. 2024-04-23T18:57:36.275 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:36.317 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:36.533 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T18:57:36.559 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T18:57:36.607 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:57:36.654 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T18:57:36.680 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:57:36.720 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:36.910 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librados2. 2024-04-23T18:57:36.926 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../007-librados2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:36.939 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T18:57:36.954 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:36.960 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:36.989 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:37.275 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T18:57:37.301 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:57:37.367 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:37.455 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librbd1. 2024-04-23T18:57:37.482 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../008-librbd1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:37.521 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:37.695 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T18:57:37.721 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T18:57:37.761 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:57:37.941 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T18:57:37.967 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:38.008 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:38.048 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T18:57:38.063 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T18:57:38.098 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T18:57:38.302 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rados. 2024-04-23T18:57:38.328 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:38.358 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T18:57:38.368 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:38.381 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:38.425 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:38.696 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T18:57:38.723 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:57:38.762 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:38.769 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T18:57:38.796 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T18:57:38.836 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:57:39.007 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T18:57:39.033 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:39.073 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:39.114 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T18:57:39.129 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T18:57:39.172 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:57:39.309 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T18:57:39.325 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:57:39.368 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:39.458 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T18:57:39.473 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T18:57:39.508 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:57:39.687 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T18:57:39.714 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T18:57:39.754 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:57:39.820 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua5.1. 2024-04-23T18:57:39.846 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T18:57:39.886 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:57:40.074 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T18:57:40.100 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T18:57:40.140 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T18:57:40.181 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-any. 2024-04-23T18:57:40.196 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-23T18:57:40.239 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T18:57:40.368 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T18:57:40.394 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:40.434 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:40.484 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package zip. 2024-04-23T18:57:40.510 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-23T18:57:40.542 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T18:57:40.771 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T18:57:40.797 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T18:57:40.837 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:57:40.861 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package unzip. 2024-04-23T18:57:40.888 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T18:57:40.928 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:57:41.115 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T18:57:41.130 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T18:57:41.173 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:57:41.324 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package luarocks. 2024-04-23T18:57:41.350 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T18:57:41.390 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:57:41.467 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T18:57:41.482 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T18:57:41.517 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:57:41.773 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librgw2. 2024-04-23T18:57:41.800 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../025-librgw2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:41.829 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua5.1. 2024-04-23T18:57:41.839 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:41.855 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T18:57:41.896 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:57:42.216 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-any. 2024-04-23T18:57:42.242 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-23T18:57:42.282 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T18:57:42.367 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T18:57:42.382 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:42.417 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:42.526 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package zip. 2024-04-23T18:57:42.541 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-23T18:57:42.585 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T18:57:42.753 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T18:57:42.779 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T18:57:42.819 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:57:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package unzip. 2024-04-23T18:57:42.897 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T18:57:42.938 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:57:43.148 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T18:57:43.174 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:43.214 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:43.333 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package luarocks. 2024-04-23T18:57:43.359 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T18:57:43.400 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:57:43.634 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-common. 2024-04-23T18:57:43.661 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:43.700 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:43.774 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librgw2. 2024-04-23T18:57:43.801 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../025-librgw2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:43.841 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:44.435 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T18:57:44.461 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:44.510 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:44.813 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T18:57:44.839 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T18:57:44.871 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:57:45.048 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-base. 2024-04-23T18:57:45.074 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:45.124 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:45.182 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T18:57:45.209 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:45.249 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:45.686 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-common. 2024-04-23T18:57:45.712 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:45.755 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:45.877 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T18:57:45.903 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T18:57:45.935 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:57:46.171 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T18:57:46.198 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T18:57:46.238 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:57:46.549 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T18:57:46.575 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T18:57:46.616 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:57:46.918 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T18:57:46.945 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T18:57:46.985 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:57:47.132 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-base. 2024-04-23T18:57:47.158 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:47.199 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:47.288 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T18:57:47.315 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T18:57:47.379 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:57:47.682 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T18:57:47.709 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T18:57:47.749 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T18:57:47.762 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T18:57:47.788 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T18:57:47.828 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:57:48.018 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-portend. 2024-04-23T18:57:48.033 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-23T18:57:48.068 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T18:57:48.156 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T18:57:48.182 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T18:57:48.222 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:57:48.330 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T18:57:48.356 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T18:57:48.396 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T18:57:48.567 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T18:57:48.594 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T18:57:48.634 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:57:48.699 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T18:57:48.725 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T18:57:48.765 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:57:48.937 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T18:57:48.963 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T18:57:49.003 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:57:49.069 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T18:57:49.096 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T18:57:49.135 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T18:57:49.264 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T18:57:49.291 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T18:57:49.323 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:57:49.464 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T18:57:49.490 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T18:57:49.530 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T18:57:49.609 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T18:57:49.635 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T18:57:49.675 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T18:57:49.833 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T18:57:49.859 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T18:57:49.908 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:57:50.004 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-portend. 2024-04-23T18:57:50.038 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-23T18:57:50.078 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T18:57:50.186 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-mako. 2024-04-23T18:57:50.213 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T18:57:50.252 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:57:50.356 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T18:57:50.371 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T18:57:50.406 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T18:57:50.514 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T18:57:50.536 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T18:57:50.572 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:57:50.675 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T18:57:50.702 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T18:57:50.742 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:57:50.908 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T18:57:50.935 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T18:57:50.975 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:57:51.079 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T18:57:51.105 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T18:57:51.146 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T18:57:51.278 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-webob. 2024-04-23T18:57:51.304 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T18:57:51.344 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:57:51.457 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T18:57:51.483 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T18:57:51.523 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T18:57:51.691 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T18:57:51.717 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T18:57:51.752 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:57:51.810 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T18:57:51.836 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T18:57:51.876 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:57:52.010 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T18:57:52.036 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T18:57:52.077 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:57:52.196 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-mako. 2024-04-23T18:57:52.211 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T18:57:52.254 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:57:52.388 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-paste. 2024-04-23T18:57:52.414 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T18:57:52.454 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:57:52.541 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T18:57:52.556 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T18:57:52.590 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:57:52.757 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T18:57:52.773 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T18:57:52.807 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:57:52.835 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T18:57:52.862 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T18:57:52.901 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:57:53.110 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T18:57:53.137 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T18:57:53.176 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:57:53.204 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webob. 2024-04-23T18:57:53.231 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T18:57:53.271 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:57:53.488 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T18:57:53.514 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T18:57:53.554 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T18:57:53.599 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T18:57:53.626 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T18:57:53.668 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:57:53.874 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T18:57:53.900 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T18:57:53.940 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:57:53.960 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T18:57:53.987 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T18:57:54.026 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:57:54.288 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-paste. 2024-04-23T18:57:54.303 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T18:57:54.314 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T18:57:54.330 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T18:57:54.346 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:57:54.370 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T18:57:54.666 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T18:57:54.672 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-idna. 2024-04-23T18:57:54.681 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T18:57:54.699 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-23T18:57:54.724 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:57:54.731 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T18:57:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T18:57:55.284 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T18:57:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T18:57:55.311 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T18:57:55.684 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:57:55.727 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:57:56.096 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-requests. 2024-04-23T18:57:56.122 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T18:57:56.162 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:57:56.364 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T18:57:56.390 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T18:57:56.430 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T18:57:56.473 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T18:57:56.500 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T18:57:56.540 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:57:56.716 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T18:57:56.739 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T18:57:56.775 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:57:56.818 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T18:57:56.834 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:57:56.876 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:57.088 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T18:57:57.114 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T18:57:57.146 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T18:57:57.256 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T18:57:57.283 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:57.339 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:57.449 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-idna. 2024-04-23T18:57:57.475 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-23T18:57:57.516 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T18:57:57.608 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T18:57:57.624 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T18:57:57.666 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:57:57.793 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T18:57:57.820 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T18:57:57.860 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:57:57.969 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T18:57:57.996 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T18:57:58.036 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T18:57:58.180 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests. 2024-04-23T18:57:58.206 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T18:57:58.246 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:57:58.372 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T18:57:58.399 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:58.438 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:58.524 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T18:57:58.539 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T18:57:58.574 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:57:58.775 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T18:57:58.802 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:58.835 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T18:57:58.851 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:57:58.858 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:58.885 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:59.274 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T18:57:59.300 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:59.340 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:59.461 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T18:57:59.488 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:57:59.528 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:57:59.685 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T18:57:59.711 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T18:57:59.751 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:58:00.056 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T18:58:00.071 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T18:58:00.114 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T18:58:00.468 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T18:58:00.495 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:00.534 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:00.573 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph. 2024-04-23T18:58:00.599 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../066-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:00.656 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:00.929 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T18:58:00.956 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:00.975 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T18:58:00.995 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:01.002 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:01.041 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:01.586 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T18:58:01.599 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T18:58:01.613 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:01.626 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:01.653 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:01.666 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:02.006 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package cephadm. 2024-04-23T18:58:02.033 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../069-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:02.072 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:02.375 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T18:58:02.402 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T18:58:02.441 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T18:58:02.694 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph. 2024-04-23T18:58:02.721 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../066-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:02.727 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T18:58:02.754 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:58:02.760 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:02.794 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:03.047 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T18:58:03.074 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:03.114 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:03.500 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T18:58:03.527 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:03.567 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:03.782 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-babel. 2024-04-23T18:58:03.809 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:58:03.848 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:03.978 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephadm. 2024-04-23T18:58:04.005 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../069-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:04.045 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:04.176 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T18:58:04.192 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T18:58:04.226 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:58:04.364 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T18:58:04.391 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T18:58:04.431 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T18:58:04.562 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T18:58:04.589 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:04.629 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:04.758 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T18:58:04.774 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:58:04.817 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:04.982 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T18:58:05.009 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T18:58:05.048 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T18:58:05.351 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-routes. 2024-04-23T18:58:05.378 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T18:58:05.418 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:58:05.746 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T18:58:05.773 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:05.812 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:05.822 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-babel. 2024-04-23T18:58:05.849 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:58:05.880 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:06.208 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T18:58:06.235 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T18:58:06.275 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:58:06.770 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T18:58:06.796 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:06.836 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:06.992 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T18:58:07.020 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T18:58:07.059 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:58:07.190 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T18:58:07.216 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T18:58:07.256 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T18:58:07.576 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-routes. 2024-04-23T18:58:07.579 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T18:58:07.602 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T18:58:07.606 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T18:58:07.642 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:58:07.645 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:58:07.987 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T18:58:07.990 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T18:58:08.014 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:08.017 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T18:58:08.048 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:58:08.053 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:08.301 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T18:58:08.328 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T18:58:08.368 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:58:09.118 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T18:58:09.145 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:09.269 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:09.334 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T18:58:09.361 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T18:58:09.400 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:58:09.887 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T18:58:09.903 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T18:58:09.945 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:58:10.206 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T18:58:10.233 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T18:58:10.266 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T18:58:10.272 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T18:58:10.281 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T18:58:10.316 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:58:10.584 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T18:58:10.611 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T18:58:10.627 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T18:58:10.650 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:58:10.654 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T18:58:10.693 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:58:11.003 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T18:58:11.030 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T18:58:11.070 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:58:11.381 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T18:58:11.408 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-23T18:58:11.410 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T18:58:11.438 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:11.447 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T18:58:11.554 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:11.935 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T18:58:11.962 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T18:58:11.993 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T18:58:12.321 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T18:58:12.348 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T18:58:12.387 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:58:12.516 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T18:58:12.543 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T18:58:12.583 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T18:58:12.699 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T18:58:12.726 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T18:58:12.765 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T18:58:12.861 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T18:58:12.888 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T18:58:12.919 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:58:13.077 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T18:58:13.104 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T18:58:13.143 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:58:13.231 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T18:58:13.259 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T18:58:13.297 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:58:13.600 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T18:58:13.628 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-23T18:58:13.667 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T18:58:13.773 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T18:58:13.789 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:13.823 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:13.987 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T18:58:14.014 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T18:58:14.054 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T18:58:14.159 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T18:58:14.187 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T18:58:14.251 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:58:14.374 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T18:58:14.401 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T18:58:14.440 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:58:14.587 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T18:58:14.615 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:58:14.653 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:58:14.727 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T18:58:14.754 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T18:58:14.785 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T18:58:14.915 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package jq. 2024-04-23T18:58:14.931 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:58:14.964 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T18:58:15.105 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T18:58:15.133 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T18:58:15.172 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:58:15.184 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package socat. 2024-04-23T18:58:15.200 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T18:58:15.242 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:58:15.545 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T18:58:15.561 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T18:58:15.603 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:58:15.861 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T18:58:15.877 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:15.919 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:15.932 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-test. 2024-04-23T18:58:15.948 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:15.991 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:16.247 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T18:58:16.275 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T18:58:16.313 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:58:16.675 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T18:58:16.691 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:58:16.733 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:58:16.969 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package jq. 2024-04-23T18:58:16.985 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:58:17.044 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T18:58:17.297 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package socat. 2024-04-23T18:58:17.325 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T18:58:17.372 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:58:17.675 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T18:58:17.703 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T18:58:17.742 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:58:18.096 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-test. 2024-04-23T18:58:18.124 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:18.163 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:18.386 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T18:58:18.414 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:18.453 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:18.756 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T18:58:18.772 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:18.814 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:19.117 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T18:58:19.145 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T18:58:19.184 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:58:19.488 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T18:58:19.516 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T18:58:19.546 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:58:19.909 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T18:58:19.937 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T18:58:19.975 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:58:20.380 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package pkg-config. 2024-04-23T18:58:20.408 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T18:58:20.426 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T18:58:20.446 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:58:20.453 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-23T18:58:20.492 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:20.716 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T18:58:20.744 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T18:58:20.782 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:58:20.812 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T18:58:20.837 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:20.879 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:21.157 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T18:58:21.185 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T18:58:21.210 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T18:58:21.232 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:58:21.238 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T18:58:21.277 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T18:58:21.545 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T18:58:21.573 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T18:58:21.580 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T18:58:21.603 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:58:21.607 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T18:58:21.646 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T18:58:21.983 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T18:58:21.990 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T18:58:22.010 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T18:58:22.018 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T18:58:22.049 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:58:22.057 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:58:22.319 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T18:58:22.346 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T18:58:22.377 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T18:58:22.479 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package pkg-config. 2024-04-23T18:58:22.507 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T18:58:22.545 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:58:22.671 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-py. 2024-04-23T18:58:22.699 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-23T18:58:22.729 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T18:58:22.832 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T18:58:22.859 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T18:58:22.899 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:58:23.025 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T18:58:23.052 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T18:58:23.091 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:58:23.335 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T18:58:23.363 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T18:58:23.401 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T18:58:23.511 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T18:58:23.527 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T18:58:23.561 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:58:23.688 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T18:58:23.715 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T18:58:23.754 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T18:58:23.847 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-toml. 2024-04-23T18:58:23.875 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-23T18:58:23.913 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T18:58:24.083 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T18:58:24.110 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T18:58:24.149 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:58:24.225 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T18:58:24.253 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T18:58:24.291 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:58:24.452 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T18:58:24.480 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T18:58:24.518 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T18:58:24.603 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T18:58:24.630 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T18:58:24.661 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:58:24.888 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-py. 2024-04-23T18:58:24.916 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-23T18:58:24.922 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T18:58:24.950 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T18:58:24.954 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T18:58:24.980 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:58:25.283 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T18:58:25.312 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T18:58:25.350 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:58:25.709 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package radosgw. 2024-04-23T18:58:25.737 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../116-radosgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:25.767 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:25.820 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T18:58:25.837 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T18:58:25.879 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:58:26.173 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-toml. 2024-04-23T18:58:26.201 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-23T18:58:26.232 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T18:58:26.510 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T18:58:26.537 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T18:58:26.575 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:58:26.595 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T18:58:26.623 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:26.661 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:26.913 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T18:58:26.941 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T18:58:26.957 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T18:58:26.979 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:58:27.249 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T18:58:27.277 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T18:58:27.307 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:58:27.491 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:58:27.601 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:58:27.836 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T18:58:28.036 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package radosgw. 2024-04-23T18:58:28.064 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../116-radosgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:28.094 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:28.168 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T18:58:28.596 INFO:teuthology.orchestra.run.smithi193.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T18:58:28.677 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:28.905 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T18:58:28.922 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-23T18:58:28.963 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:29.219 INFO:teuthology.orchestra.run.smithi193.stdout:Adding system user cephadm....done 2024-04-23T18:58:29.277 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T18:58:29.342 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:58:29.527 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:58:29.593 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:58:29.653 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:58:29.827 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:58:29.913 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T18:58:29.954 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:58:30.213 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T18:58:30.229 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T18:58:30.481 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:58:30.607 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T18:58:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T18:58:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:30.916 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:58:31.260 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T18:58:31.297 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user cephadm....done 2024-04-23T18:58:31.445 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:58:31.494 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T18:58:31.704 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:58:31.770 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:58:31.955 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:58:32.022 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:58:32.082 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:58:32.273 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:58:32.333 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T18:58:32.542 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:58:32.584 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:58:32.710 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T18:58:32.777 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:32.995 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:58:33.028 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:58:33.154 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:58:33.280 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:58:33.373 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T18:58:33.406 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:58:33.632 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T18:58:33.665 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:58:33.892 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:58:34.065 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T18:58:34.087 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T18:58:34.135 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:58:34.135 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:58:34.253 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T18:58:34.411 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:58:34.620 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:34.654 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:58:34.746 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T18:58:34.913 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:35.014 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:58:35.184 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:58:35.273 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:58:35.291 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:58:35.392 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:58:35.509 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:58:35.566 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T18:58:35.675 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:58:35.761 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:58:36.117 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T18:58:36.150 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T18:58:36.214 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:58:36.319 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:58:36.323 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T18:58:36.578 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:58:36.683 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:36.704 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:58:36.809 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T18:58:36.830 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:58:37.077 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:58:37.131 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T18:58:37.320 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:58:37.524 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T18:58:37.767 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:58:37.921 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T18:58:38.080 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:58:38.135 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:58:38.411 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:58:38.716 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:58:38.746 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:58:38.958 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:58:38.988 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:58:39.085 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:58:39.114 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:39.194 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:58:39.407 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T18:58:39.487 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T18:58:39.758 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:58:39.871 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T18:58:40.131 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:58:40.507 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:58:40.784 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:58:40.906 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:58:41.135 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:58:41.149 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:58:41.283 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T18:58:41.378 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:58:41.504 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:41.517 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:58:41.669 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:58:41.794 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:58:41.805 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T18:58:42.087 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:58:42.265 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:58:42.347 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T18:58:42.598 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:58:42.982 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:58:43.267 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:58:43.446 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:58:43.493 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T18:58:43.690 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:58:43.735 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T18:58:43.799 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T18:58:43.986 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:58:44.050 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:58:44.176 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:58:44.237 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T18:58:44.302 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:58:44.497 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:58:44.588 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:58:44.623 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T18:58:44.838 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T18:58:44.899 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:58:45.033 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:58:45.083 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:58:45.209 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:58:45.318 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:58:45.502 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:58:45.603 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:58:45.745 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T18:58:45.853 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:58:45.979 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:58:46.013 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T18:58:46.105 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:46.194 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T18:58:46.264 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:58:46.457 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:58:46.498 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T18:58:46.583 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:58:46.758 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:58:46.867 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T18:58:46.968 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:58:47.143 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:58:47.210 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T18:58:47.244 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:58:47.336 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T18:58:47.512 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:58:47.596 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:58:47.721 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:58:47.838 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:58:48.039 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:58:48.123 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:58:48.248 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:58:48.382 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:58:48.383 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:58:48.472 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T18:58:48.658 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T18:58:48.727 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:58:48.759 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T18:58:48.852 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:58:49.018 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T18:58:49.262 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:58:49.286 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:58:49.530 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T18:58:49.631 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:58:49.639 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T18:58:49.890 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:58:50.016 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T18:58:50.024 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:58:50.301 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:58:50.342 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:58:50.611 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:58:50.652 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:58:50.738 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:50.863 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:50.911 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T18:58:50.989 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:58:51.029 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T18:58:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T18:58:51.326 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:51.443 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:51.548 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:58:51.569 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T18:58:51.871 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:51.909 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:58:51.997 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:52.123 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:52.286 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T18:58:52.361 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:58:52.361 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:58:52.579 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:58:52.841 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:52.923 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:58:53.001 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:53.049 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:53.110 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:53.184 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:53.278 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:58:53.310 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:58:53.680 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:53.780 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:53.898 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T18:58:54.191 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:54.318 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:54.444 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:54.565 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:54.656 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:58:54.656 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:58:54.691 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:54.801 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:54.952 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:55.078 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:55.128 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:55.506 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:58:55.620 INFO:teuthology.orchestra.run.smithi193.stdout:Adding group ceph....done 2024-04-23T18:58:55.938 INFO:teuthology.orchestra.run.smithi193.stdout:Adding system user ceph....done 2024-04-23T18:58:56.073 INFO:teuthology.orchestra.run.smithi193.stdout:Setting system user ceph properties....done 2024-04-23T18:58:56.085 INFO:teuthology.orchestra.run.smithi193.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T18:58:56.222 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T18:58:56.549 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T18:58:56.693 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:56.819 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:56.945 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:57.012 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:57.062 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:57.138 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:57.172 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:57.604 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:58:57.604 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:58:57.715 INFO:teuthology.orchestra.run.smithi169.stdout:Adding group ceph....done 2024-04-23T18:58:58.081 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:58.099 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user ceph....done 2024-04-23T18:58:58.210 INFO:teuthology.orchestra.run.smithi169.stdout:Setting system user ceph properties....done 2024-04-23T18:58:58.224 INFO:teuthology.orchestra.run.smithi169.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T18:58:58.357 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T18:58:58.479 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T18:58:58.694 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T18:58:58.949 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:59.173 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:58:59.173 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:58:59.198 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:59.324 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:59.685 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:58:59.903 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:58:59.903 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:59:00.211 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:59:00.211 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:59:00.369 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:00.641 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:59:00.642 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:59:00.693 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:01.053 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T18:59:01.129 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:01.255 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:01.406 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:01.520 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:01.619 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:59:01.619 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:59:01.734 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:59:01.734 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:59:02.115 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:02.206 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:02.250 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:02.367 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:02.415 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:59:02.415 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:59:02.518 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:02.863 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T18:59:02.933 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:02.972 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T18:59:03.124 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T18:59:03.315 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:59:03.315 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:59:03.827 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:04.304 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:04.402 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T18:59:04.455 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:04.665 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:59:04.665 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:59:05.028 INFO:teuthology.orchestra.run.smithi193.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T18:59:05.034 DEBUG:teuthology.parallel:result is None 2024-04-23T18:59:05.123 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:05.282 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:05.408 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:05.542 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-23T18:59:05.879 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T18:59:05.987 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T18:59:06.123 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T18:59:06.840 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T18:59:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T18:59:07.483 DEBUG:teuthology.parallel:result is None 2024-04-23T18:59:07.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T18:59:07.701 DEBUG:teuthology.orchestra.run.smithi169:> dpkg-query -W -f '${Version}' ceph 2024-04-23T18:59:07.720 INFO:teuthology.orchestra.run.smithi169.stdout:19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:59:07.721 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:59:07.721 INFO:teuthology.task.install:The correct ceph version 19.0.0-3101-g5bf3b3a9-1jammy is installed. 2024-04-23T18:59:07.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T18:59:07.860 DEBUG:teuthology.orchestra.run.smithi193:> dpkg-query -W -f '${Version}' ceph 2024-04-23T18:59:07.879 INFO:teuthology.orchestra.run.smithi193.stdout:19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:59:07.879 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-23T18:59:07.880 INFO:teuthology.task.install:The correct ceph version 19.0.0-3101-g5bf3b3a9-1jammy is installed. 2024-04-23T18:59:07.881 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T18:59:07.882 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:07.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T18:59:07.896 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:07.896 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T18:59:07.933 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T18:59:07.934 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:07.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T18:59:07.951 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T18:59:08.007 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:08.007 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T18:59:08.020 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T18:59:08.072 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T18:59:08.073 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:08.073 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T18:59:08.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T18:59:08.138 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:08.138 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T18:59:08.151 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T18:59:08.205 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T18:59:08.205 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:08.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T18:59:08.219 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T18:59:08.279 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:08.279 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T18:59:08.293 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T18:59:08.349 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T18:59:08.435 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T18:59:08.435 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-04-23T18:59:08.438 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /var/log/ceph 2024-04-23T18:59:08.451 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T18:59:08.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T18:59:08.493 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T18:59:08.510 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T18:59:08.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T18:59:08.545 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T18:59:08.577 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T18:59:08.577 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T18:59:08.577 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961', 'branch': 'rgw-update-boost-redis', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7669961', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rgw-update-boost-redis'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rgw-update-boost-redis', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}}, 'owner': 'scheduled_suriarte@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'rgw-update-boost-redis', 'suite_path': '/home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/samarahu/ceph.git', 'suite_sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c', 'targets': {'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5m4oUj4efU6YacigBU5Q1KD6BtJqbHQMGUWHaJySiIo5DcfwP8SDk4I0zckKIs1cBxh98kOjIjrpYtfPZBqLE=', 'smithi193.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFu7i1OeB2YivgkWSyka1pO4y2n4d66eHKIC7CM/9B12JvnTSF7nPOWbU7IUt+oPm78rZlpsg57lxzHEV9+u2ug='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_15:04:03', 'tube': 'smithi', 'user': 'suriarte', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T18:59:08.577 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T18:59:08.601 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T18:59:08.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T18:59:08.649 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T18:59:08.669 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:08.669 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T18:59:08.708 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T18:59:08.708 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-23 18:53:53.133379482 +0000 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-23 18:53:52.889381662 +0000 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-23 18:53:52.889381662 +0000 2024-04-23T18:59:08.758 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-23T18:59:08.759 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T18:59:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-23T18:59:08.810 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-23T18:59:08.811 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000439817 s, 1.2 MB/s 2024-04-23T18:59:08.812 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T18:59:08.861 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-04-23T18:59:08.908 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T18:59:08.908 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:08.908 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-23T18:59:08.908 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:08.908 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-23 18:53:53.645374905 +0000 2024-04-23T18:59:08.908 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-23 18:53:53.349377550 +0000 2024-04-23T18:59:08.909 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-23 18:53:53.349377550 +0000 2024-04-23T18:59:08.909 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-23T18:59:08.909 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T18:59:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-23T18:59:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-23T18:59:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000407597 s, 1.3 MB/s 2024-04-23T18:59:08.963 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T18:59:09.013 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-04-23T18:59:09.059 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-23 18:53:54.217369792 +0000 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-23 18:53:53.937372295 +0000 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-23 18:53:53.937372295 +0000 2024-04-23T18:59:09.060 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-23T18:59:09.060 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T18:59:09.114 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-23T18:59:09.114 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-23T18:59:09.114 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000436646 s, 1.2 MB/s 2024-04-23T18:59:09.115 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T18:59:09.165 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-04-23T18:59:09.211 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-23 18:53:54.765364895 +0000 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-23 18:53:54.497367291 +0000 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-23 18:53:54.497367291 +0000 2024-04-23T18:59:09.212 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-23T18:59:09.212 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T18:59:09.266 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-23T18:59:09.266 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-23T18:59:09.266 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000327643 s, 1.6 MB/s 2024-04-23T18:59:09.267 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T18:59:09.317 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:09.317 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:09.317 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T18:59:09.323 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T18:59:09.323 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-04-23T18:59:09.370 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T18:59:09.370 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:09.370 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-04-23T18:59:09.370 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:09.370 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-23 18:53:53.204512248 +0000 2024-04-23T18:59:09.371 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-23 18:53:52.904514927 +0000 2024-04-23T18:59:09.371 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-23 18:53:52.904514927 +0000 2024-04-23T18:59:09.371 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-04-23T18:59:09.371 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T18:59:09.424 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-23T18:59:09.424 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-23T18:59:09.425 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000428744 s, 1.2 MB/s 2024-04-23T18:59:09.426 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T18:59:09.475 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-23 18:53:53.728507567 +0000 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-23 18:53:53.436510176 +0000 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-23 18:53:53.436510176 +0000 2024-04-23T18:59:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-04-23T18:59:09.523 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T18:59:09.576 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-23T18:59:09.576 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-23T18:59:09.576 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.00044661 s, 1.1 MB/s 2024-04-23T18:59:09.577 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T18:59:09.627 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-23 18:53:54.188503458 +0000 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-23 18:53:53.948505602 +0000 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-23 18:53:53.948505602 +0000 2024-04-23T18:59:09.674 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-04-23T18:59:09.674 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T18:59:09.728 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-23T18:59:09.728 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-23T18:59:09.728 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000307597 s, 1.7 MB/s 2024-04-23T18:59:09.729 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T18:59:09.779 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-04-23T18:59:09.826 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-23 18:53:54.424501350 +0000 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-23 18:53:54.420501386 +0000 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-23 18:53:54.420501386 +0000 2024-04-23T18:59:09.827 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-04-23T18:59:09.827 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T18:59:09.880 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-23T18:59:09.880 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-23T18:59:09.880 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000373175 s, 1.4 MB/s 2024-04-23T18:59:09.881 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T18:59:09.932 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:09.932 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T18:59:09.932 INFO:tasks.ceph:Generating config... 2024-04-23T18:59:09.933 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-04-23T18:59:09.933 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T18:59:09.933 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T18:59:09.933 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T18:59:09.933 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T18:59:09.934 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-23T18:59:09.934 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-23T18:59:09.935 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-23T18:59:09.935 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-23T18:59:09.935 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-23T18:59:09.935 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-23T18:59:09.935 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-23T18:59:09.935 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T18:59:09.935 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T18:59:09.970 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T18:59:09.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T18:59:10.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:59:10.107 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]'), ('mon.b', '172.21.15.193')] 2024-04-23T18:59:10.107 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790],172.21.15.193'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-23T18:59:10.108 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:10.108 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T18:59:10.156 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --add b 172.21.15.193 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:10.241 INFO:teuthology.orchestra.run.smithi169.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:10.241 INFO:teuthology.orchestra.run.smithi169.stdout:monmaptool: generated fsid 4bb45736-c8eb-4572-abb0-38f9ff40b613 2024-04-23T18:59:10.241 INFO:teuthology.orchestra.run.smithi169.stdout:setting min_mon_release = quincy 2024-04-23T18:59:10.241 INFO:teuthology.orchestra.run.smithi169.stdout:epoch 0 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:fsid 4bb45736-c8eb-4572-abb0-38f9ff40b613 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:last_changed 2024-04-23T18:59:10.246359+0000 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:created 2024-04-23T18:59:10.246359+0000 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:min_mon_release 17 (quincy) 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:election_strategy: 1 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:0: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.a 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-04-23T18:59:10.242 INFO:teuthology.orchestra.run.smithi169.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-23T18:59:10.243 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T18:59:10.292 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4bb45736-c8eb-4572-abb0-38f9ff40b613... 2024-04-23T18:59:10.293 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T18:59:10.337 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T18:59:10.365 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-04-23T18:59:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-04-23T18:59:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T18:59:10.365 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-04-23T18:59:10.366 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T18:59:10.367 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790],172.21.15.193" 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 4bb45736-c8eb-4572-abb0-38f9ff40b613 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.368 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-04-23T18:59:10.369 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-04-23T18:59:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: osd blocked scrub grace period = 3600 2024-04-23T18:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: osd max markdown count = 1000 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: osd shutdown pgref assert = True 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-23T18:59:10.372 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.373 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T18:59:10.374 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi169.stdout: rgw relaxed s3 bucket names = True 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi193.stdout:[global] 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi193.stdout: chdir = "" 2024-04-23T18:59:10.375 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: auth supported = cephx 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: filestore xattr use omap = true 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: mon clock drift allowed = 1.000 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: osd crush chooseleaf type = 0 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: auth debug = true 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on old message = true 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on bug = true 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: mon pg warn max object skew = 0 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.376 INFO:teuthology.orchestra.run.smithi193.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default size = 2 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow primary affinity = true 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow pg remap = true 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on legacy crush tunables = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on crush straw calc version zero = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on no sortbitwise = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on osd down out interval zero = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on too few osds = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: mon_allow_pool_size_one = true 2024-04-23T18:59:10.377 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: osd default data pool replay window = 5 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: mon allow pool delete = true 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: mon cluster log file level = debug 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: debug asserts on shutdown = true 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: mon health detail to clog = false 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: mon host = "172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790],172.21.15.193" 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: fsid = 4bb45736-c8eb-4572-abb0-38f9ff40b613 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.378 INFO:teuthology.orchestra.run.smithi193.stdout:[osd] 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd journal size = 100 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub load threshold = 5.0 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub max interval = 600 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd mclock profile = high_recovery_ops 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd recover clone overlap = true 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd recovery max chunk = 1048576 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug shutdown = true 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug op order = true 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug verify stray on activate = true 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug trim objects = true 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.379 INFO:teuthology.orchestra.run.smithi193.stdout: osd open classes on start = true 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug pg log writeout = true 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: osd deep scrub update digest min age = 30 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: osd map max advance = 10 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: journal zero on create = true 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: filestore ondisk finisher threads = 3 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: filestore apply finisher threads = 3 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: bdev debug aio = true 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug misdirected ops = true 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: bdev async discard = True 2024-04-23T18:59:10.380 INFO:teuthology.orchestra.run.smithi193.stdout: bdev enable discard = True 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore allocator = bitmap 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore block size = 96636764160 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore fsck on mount = True 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluefs = 1/20 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluestore = 1/20 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: debug osd = 20 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: debug rocksdb = 4/10 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd full ratio = 0.9 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd nearfull ratio = 0.8 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: osd blocked scrub grace period = 3600 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: osd failsafe full ratio = 0.95 2024-04-23T18:59:10.381 INFO:teuthology.orchestra.run.smithi193.stdout: osd max markdown count = 1000 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: osd objectstore = bluestore 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: osd shutdown pgref assert = True 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr] 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: debug mgr = 20 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: mgr/telemetry/nag = false 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.382 INFO:teuthology.orchestra.run.smithi193.stdout:[mon] 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: debug paxos = 20 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: mon data avail warn = 5 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: mon mgr mkfs grace = 240 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd reporter subtree level = osd 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd prime pg temp = true 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T18:59:10.383 INFO:teuthology.orchestra.run.smithi193.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: # 1m isn't quite enough 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: mon_down_mkfs_grace = 2m 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_filestore_osds = false 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout:[client] 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: rgw cache enabled = true 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable ops log = true 2024-04-23T18:59:10.384 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable usage log = true 2024-04-23T18:59:10.385 INFO:teuthology.orchestra.run.smithi193.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T18:59:10.385 INFO:teuthology.orchestra.run.smithi193.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T18:59:10.385 INFO:teuthology.orchestra.run.smithi193.stdout: rgw relaxed s3 bucket names = True 2024-04-23T18:59:10.385 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.a] 2024-04-23T18:59:10.385 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.c] 2024-04-23T18:59:10.385 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.b] 2024-04-23T18:59:10.386 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T18:59:10.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T18:59:10.475 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T18:59:10.475 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:10.475 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T18:59:10.524 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:10.524 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T18:59:10.572 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T18:59:10.572 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:10.572 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T18:59:10.572 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:59:10.636 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:10.637 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:10.684 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T18:59:10.684 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:10.684 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T18:59:10.684 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:59:10.706 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:10.706 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:10.754 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T18:59:10.754 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T18:59:10.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T18:59:10.798 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T18:59:10.802 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T18:59:10.845 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T18:59:10.856 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T18:59:10.856 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T18:59:10.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T18:59:10.890 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T18:59:10.901 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-23T18:59:10.935 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-23T18:59:10.945 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T18:59:10.945 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T18:59:10.946 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T18:59:10.959 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:10.959 INFO:tasks.ceph:role: osd.0 2024-04-23T18:59:10.959 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T18:59:10.959 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:11.023 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:11.024 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:11.024 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:11.024 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:11.503 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-23T18:59:11.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-23T18:59:11.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T18:59:11.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T18:59:11.680 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:11.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:11.681 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T18:59:11.734 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:11.734 INFO:tasks.ceph:role: osd.1 2024-04-23T18:59:11.734 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T18:59:11.734 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:11.795 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:11.796 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:11.796 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:11.796 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:12.238 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-23T18:59:12.240 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-23T18:59:12.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-23T18:59:12.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T18:59:12.385 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:12.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:12.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T18:59:12.438 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:12.438 INFO:tasks.ceph:role: osd.2 2024-04-23T18:59:12.438 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T18:59:12.438 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:12.499 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:12.500 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:12.500 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:12.500 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:12.960 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-23T18:59:12.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-23T18:59:12.962 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-23T18:59:13.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T18:59:13.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:13.092 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:13.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T18:59:13.148 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:13.148 INFO:tasks.ceph:role: osd.3 2024-04-23T18:59:13.148 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T18:59:13.148 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:13.210 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:13.713 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-23T18:59:13.715 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-23T18:59:13.715 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-23T18:59:13.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T18:59:13.873 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:13.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:13.878 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:13.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:13.982+0000 7f0c3914a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-23T18:59:13.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:13.986+0000 7f0c3914a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-23T18:59:13.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:13.986+0000 7f0c3914a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:59:13.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:13.986+0000 7f0c3914a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:59:13.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:13.986+0000 7f0c3914a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:59:13.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:13.986+0000 7f0c3914a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-23T18:59:16.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T18:59:16.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:17.070+0000 7f3008ee97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-23T18:59:17.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:17.070+0000 7f3008ee97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-23T18:59:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:17.070+0000 7f3008ee97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:59:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:17.070+0000 7f3008ee97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:59:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:17.070+0000 7f3008ee97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:59:17.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:17.070+0000 7f3008ee97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-23T18:59:20.049 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T18:59:20.104 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:20.186+0000 7fa2bbf0d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-23T18:59:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:20.186+0000 7fa2bbf0d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-23T18:59:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:20.186+0000 7fa2bbf0d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:59:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:20.186+0000 7fa2bbf0d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:59:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:20.186+0000 7fa2bbf0d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:59:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:20.186+0000 7fa2bbf0d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-23T18:59:23.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T18:59:23.215 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:23.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:23.298+0000 7f5a9e9727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-23T18:59:23.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:23.298+0000 7f5a9e9727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-23T18:59:23.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:23.298+0000 7f5a9e9727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:59:23.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:23.298+0000 7f5a9e9727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:59:23.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:23.298+0000 7f5a9e9727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:59:23.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-23T18:59:23.298+0000 7f5a9e9727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-23T18:59:26.270 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T18:59:26.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-23T18:59:26.338 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:26.338 INFO:tasks.ceph:role: osd.4 2024-04-23T18:59:26.338 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T18:59:26.338 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:26.401 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:26.891 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-04-23T18:59:26.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-04-23T18:59:26.893 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-23T18:59:27.045 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-23T18:59:27.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:27.057 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-23T18:59:27.113 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:27.113 INFO:tasks.ceph:role: osd.5 2024-04-23T18:59:27.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T18:59:27.113 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T18:59:27.177 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:27.177 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:27.178 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:27.619 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-04-23T18:59:27.621 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-04-23T18:59:27.621 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-23T18:59:27.712 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-23T18:59:27.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:27.722 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:27.722 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-23T18:59:27.775 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:27.775 INFO:tasks.ceph:role: osd.6 2024-04-23T18:59:27.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T18:59:27.776 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T18:59:27.834 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:27.835 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:28.292 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-04-23T18:59:28.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-04-23T18:59:28.294 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-23T18:59:28.386 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-23T18:59:28.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:28.439 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:28.439 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-23T18:59:28.491 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:59:28.491 INFO:tasks.ceph:role: osd.7 2024-04-23T18:59:28.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T18:59:28.492 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:59:28.554 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:59:29.055 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-04-23T18:59:29.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-04-23T18:59:29.057 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-23T18:59:29.223 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-23T18:59:29.233 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:59:29.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:59:29.234 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:29.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:29.339+0000 7f39419697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-23T18:59:29.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:29.343+0000 7f39419697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-23T18:59:29.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:29.343+0000 7f39419697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T18:59:29.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:29.343+0000 7f39419697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T18:59:29.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:29.343+0000 7f39419697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T18:59:29.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:29.347+0000 7f39419697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-23T18:59:32.329 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T18:59:32.342 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:32.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:32.427+0000 7f52e573d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-23T18:59:32.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:32.427+0000 7f52e573d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-23T18:59:32.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:32.427+0000 7f52e573d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T18:59:32.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:32.427+0000 7f52e573d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T18:59:32.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:32.427+0000 7f52e573d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T18:59:32.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:32.427+0000 7f52e573d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-23T18:59:35.435 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T18:59:35.491 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:35.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:35.571+0000 7f9c99d297c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-23T18:59:35.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:35.571+0000 7f9c99d297c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-23T18:59:35.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:35.571+0000 7f9c99d297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T18:59:35.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:35.571+0000 7f9c99d297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T18:59:35.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:35.571+0000 7f9c99d297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T18:59:35.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:35.575+0000 7f9c99d297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-23T18:59:38.548 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-23T18:59:38.601 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:38.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:38.683+0000 7fc49b12c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-23T18:59:38.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:38.683+0000 7fc49b12c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-23T18:59:38.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:38.683+0000 7fc49b12c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T18:59:38.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:38.683+0000 7fc49b12c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T18:59:38.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:38.683+0000 7fc49b12c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T18:59:38.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-23T18:59:38.683+0000 7fc49b12c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-23T18:59:41.661 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-23T18:59:41.722 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T18:59:41.722 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:41.722 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-23T18:59:41.736 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:41.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T18:59:41.791 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:41.791 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T18:59:41.846 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:41.846 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T18:59:41.898 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:41.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T18:59:41.952 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:41.952 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T18:59:41.965 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:41.965 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-23T18:59:42.021 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:42.021 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-23T18:59:42.076 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:42.076 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-23T18:59:42.129 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:42.130 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-23T18:59:42.188 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:42.188 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T18:59:42.194 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:42.194 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-23T18:59:42.234 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T18:59:42.234 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T18:59:42.236 DEBUG:teuthology.orchestra.run.smithi193:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD+BChm6u/jLxAAJrCNY8esqvaZTq5z4CWkkg== 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQABBShm2KHWOhAAM48YFmbWnt8WpfA0gMo7dA== 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAFBShmEvltBBAAruO9BxPADlXUtjiLWmEUlw== 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-04-23T18:59:42.280 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAIBShmzSFdCxAAMNk0xwgDBGCAkDIJoUGvFw== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQALBShm4e7yERAAvapbMsq9sc67LfO7p8J9eA== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD+BChmMQ2UMhAAYAkwprqDjOKxiTfVy0PWKw== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQARBShmN4uAFBAArSi7UgVu21mmtnGjel5p3g== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAUBShmrmS5GRAAWJQK/PjLQOeCCxwPTOcBQA== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAXBShmilNSIhAA6ceNKo40aEwABpNXZ0WQdQ== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQAaBShmc6PyKBAAuWaiL+0yb56BFN66vBzh/A== 2024-04-23T18:59:42.281 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-04-23T18:59:42.282 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD+BChmurVkNRAAe3fSQFVtRcE7SwH42quU9Q== 2024-04-23T18:59:42.282 INFO:teuthology.orchestra.run.smithi169.stdout:[client.1] 2024-04-23T18:59:42.282 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQD+BChmV1n4NxAAkAB7I1FTceD0pO+J7g2fuQ== 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr.y] 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQD+BChm6u/jLxAAJrCNY8esqvaZTq5z4CWkkg== 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.0] 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQABBShm2KHWOhAAM48YFmbWnt8WpfA0gMo7dA== 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.1] 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQAFBShmEvltBBAAruO9BxPADlXUtjiLWmEUlw== 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.2] 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQAIBShmzSFdCxAAMNk0xwgDBGCAkDIJoUGvFw== 2024-04-23T18:59:42.287 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.3] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQALBShm4e7yERAAvapbMsq9sc67LfO7p8J9eA== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr.x] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQD+BChmMQ2UMhAAYAkwprqDjOKxiTfVy0PWKw== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.4] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQARBShmN4uAFBAArSi7UgVu21mmtnGjel5p3g== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.5] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQAUBShmrmS5GRAAWJQK/PjLQOeCCxwPTOcBQA== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.6] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQAXBShmilNSIhAA6ceNKo40aEwABpNXZ0WQdQ== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.7] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQAaBShmc6PyKBAAuWaiL+0yb56BFN66vBzh/A== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[client.0] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQD+BChmurVkNRAAe3fSQFVtRcE7SwH42quU9Q== 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout:[client.1] 2024-04-23T18:59:42.288 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQD+BChmV1n4NxAAkAB7I1FTceD0pO+J7g2fuQ== 2024-04-23T18:59:42.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:59:42.329 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:59:42.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.380 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.461 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.504 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.549 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.591 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.633 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.675 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:59:42.712 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:59:42.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.792 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.840 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.876 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:42.961 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:43.003 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:43.049 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:59:43.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:59:43.133 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:59:43.175 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:59:43.217 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:59:43.263 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T18:59:43.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T18:59:43.313 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:59:43.404 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T18:59:43.415 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-23T18:59:43.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:59:43.564 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-23T18:59:43.575 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-23T18:59:43.590 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:59:43.684 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-23T18:59:43.695 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:43.697 DEBUG:teuthology.orchestra.run.smithi193:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:59:43.741 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T18:59:43.741 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T18:59:43.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T18:59:43.744 INFO:tasks.ceph.mon.a:Started 2024-04-23T18:59:43.744 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-23T18:59:43.745 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-23T18:59:43.747 INFO:tasks.ceph.mon.c:Started 2024-04-23T18:59:43.747 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-23T18:59:43.747 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-23T18:59:43.786 INFO:tasks.ceph.mon.b:Started 2024-04-23T18:59:43.787 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T18:59:43.787 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-23T18:59:43.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-23T18:59:43.789 INFO:tasks.ceph.mgr.y:Started 2024-04-23T18:59:43.790 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T18:59:43.790 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T18:59:43.792 INFO:tasks.ceph.mgr.x:Started 2024-04-23T18:59:43.792 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T18:59:43.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T18:59:49.376 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:49.378+0000 7f304d98d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T18:59:49.419 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:49.419+0000 7ffa03a13180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T18:59:49.898 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:49.898+0000 7f304d98d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T18:59:49.926 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:49.927+0000 7ffa03a13180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T18:59:50.010 INFO:teuthology.orchestra.run.smithi169.stderr:adjusted tunables profile to default 2024-04-23T18:59:50.033 INFO:tasks.ceph:check_enable_crimson: False 2024-04-23T18:59:50.034 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T18:59:50.034 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:50.034 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T18:59:50.045 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:50.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T18:59:50.092 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.094+0000 7f304d98d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T18:59:50.098 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:50.098 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T18:59:50.150 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T18:59:50.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T18:59:50.152 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:50.151+0000 7ffa03a13180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T18:59:50.201 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:50.201 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-23T18:59:50.214 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:50.214 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-23T18:59:50.269 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:50.269 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-23T18:59:50.323 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-23T18:59:50.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-23T18:59:50.377 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 19702f2e-d87b-4f04-91b1-933211c92efc 0 2024-04-23T18:59:50.633 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.634+0000 7f304d98d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T18:59:50.638 INFO:teuthology.orchestra.run.smithi193.stdout:0 2024-04-23T18:59:50.654 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 6f9fa56c-0fcb-4f45-9440-e60fe043be19 1 2024-04-23T18:59:50.687 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.686+0000 7f304d98d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T18:59:50.707 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:50.707+0000 7ffa03a13180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T18:59:50.739 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.738+0000 7f304d98d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T18:59:50.762 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:50.763+0000 7ffa03a13180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T18:59:50.815 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.818+0000 7f304d98d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T18:59:50.816 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:50.815+0000 7ffa03a13180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T18:59:50.851 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-04-23T18:59:50.867 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new a45daf8f-561c-4931-954a-ae4cda4e9383 2 2024-04-23T18:59:50.868 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.870+0000 7f304d98d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T18:59:50.897 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:50.895+0000 7ffa03a13180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T18:59:50.944 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.946+0000 7f304d98d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T18:59:50.950 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:50.951+0000 7ffa03a13180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T18:59:50.998 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:50.998+0000 7f304d98d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T18:59:51.029 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:51.031+0000 7ffa03a13180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T18:59:51.061 INFO:teuthology.orchestra.run.smithi193.stdout:2 2024-04-23T18:59:51.078 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 9ae3c352-4546-4115-8a2e-07ccb88ea066 3 2024-04-23T18:59:51.085 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:51.083+0000 7ffa03a13180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T18:59:51.148 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:51.150+0000 7f304d98d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T18:59:51.211 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:51.214+0000 7f304d98d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T18:59:51.241 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:51.239+0000 7ffa03a13180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T18:59:51.272 INFO:teuthology.orchestra.run.smithi193.stdout:3 2024-04-23T18:59:51.288 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new feff8989-ac80-433d-8d4d-61c64acbb0e7 4 2024-04-23T18:59:51.305 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:51.307+0000 7ffa03a13180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T18:59:51.487 INFO:teuthology.orchestra.run.smithi193.stdout:4 2024-04-23T18:59:51.502 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 3ceb25a3-bc75-4611-8353-9a4ab397b27e 5 2024-04-23T18:59:51.793 INFO:teuthology.orchestra.run.smithi193.stdout:5 2024-04-23T18:59:51.810 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new b958ec69-6670-4132-a39d-30ba2027eaaf 6 2024-04-23T18:59:51.866 INFO:tasks.ceph.mgr.y.smithi169.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T18:59:51.866 INFO:tasks.ceph.mgr.y.smithi169.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T18:59:51.866 INFO:tasks.ceph.mgr.y.smithi169.stderr: from numpy import show_config as show_numpy_config 2024-04-23T18:59:51.938 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:51.938+0000 7f304d98d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T18:59:51.960 INFO:tasks.ceph.mgr.x.smithi193.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T18:59:51.960 INFO:tasks.ceph.mgr.x.smithi193.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T18:59:51.960 INFO:tasks.ceph.mgr.x.smithi193.stderr: from numpy import show_config as show_numpy_config 2024-04-23T18:59:51.995 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:51.995+0000 7ffa03a13180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T18:59:52.013 INFO:teuthology.orchestra.run.smithi193.stdout:6 2024-04-23T18:59:52.034 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new ab2626db-9460-443c-aa97-6f6c38f8b72c 7 2024-04-23T18:59:52.121 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:52.122+0000 7f304d98d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:59:52.139 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:52.139+0000 7ffa03a13180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:59:52.235 INFO:teuthology.orchestra.run.smithi193.stdout:7 2024-04-23T18:59:52.251 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T18:59:52.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-23T18:59:52.254 INFO:tasks.ceph.osd.0:Started 2024-04-23T18:59:52.254 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T18:59:52.255 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-23T18:59:52.257 INFO:tasks.ceph.osd.1:Started 2024-04-23T18:59:52.257 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T18:59:52.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-23T18:59:52.259 INFO:tasks.ceph.osd.2:Started 2024-04-23T18:59:52.260 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T18:59:52.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T18:59:52.262 INFO:tasks.ceph.osd.3:Started 2024-04-23T18:59:52.262 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-23T18:59:52.262 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-23T18:59:52.264 INFO:tasks.ceph.osd.4:Started 2024-04-23T18:59:52.265 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-23T18:59:52.265 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-23T18:59:52.267 INFO:tasks.ceph.osd.5:Started 2024-04-23T18:59:52.267 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-23T18:59:52.267 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-23T18:59:52.269 INFO:tasks.ceph.osd.6:Started 2024-04-23T18:59:52.269 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-23T18:59:52.269 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-23T18:59:52.271 INFO:tasks.ceph.osd.7:Started 2024-04-23T18:59:52.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:59:52.314 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:52.314+0000 7f304d98d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T18:59:52.315 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:52.315+0000 7ffa03a13180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T18:59:52.388 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:52.387+0000 7ffa03a13180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T18:59:52.391 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:52.394+0000 7f304d98d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T18:59:52.479 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T18:59:52.479 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":10,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T18:59:52.236751+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:59:52.497 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T18:59:52.497 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T18:59:52.534 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:52.535+0000 7ffa03a13180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:59:52.540 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:52.542+0000 7f304d98d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:59:52.872 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T18:59:52.874+0000 7f25e87b47c0 -1 Falling back to public interface 2024-04-23T18:59:52.876 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T18:59:52.878+0000 7ff51f35c7c0 -1 Falling back to public interface 2024-04-23T18:59:52.878 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T18:59:52.879+0000 7fd55e0367c0 -1 Falling back to public interface 2024-04-23T18:59:52.878 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T18:59:52.879+0000 7fcea01b67c0 -1 Falling back to public interface 2024-04-23T18:59:52.894 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T18:59:52.895+0000 7f38cea5f7c0 -1 Falling back to public interface 2024-04-23T18:59:52.894 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T18:59:52.895+0000 7fdd873f17c0 -1 Falling back to public interface 2024-04-23T18:59:52.896 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T18:59:52.898+0000 7f49662817c0 -1 Falling back to public interface 2024-04-23T18:59:52.896 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T18:59:52.898+0000 7fc7a52a47c0 -1 Falling back to public interface 2024-04-23T18:59:53.156 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:53.158+0000 7f304d98d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T18:59:53.163 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:53.163+0000 7ffa03a13180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T18:59:53.233 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:53.234+0000 7f304d98d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T18:59:53.239 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:53.239+0000 7ffa03a13180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T18:59:53.303 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:59:53.416 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:53.418+0000 7f304d98d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T18:59:53.418 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:53.419+0000 7ffa03a13180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T18:59:53.482 INFO:teuthology.misc.health.smithi169.stdout: 2024-04-23T18:59:53.482 INFO:teuthology.misc.health.smithi169.stdout:{"epoch":10,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T18:59:52.236751+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:59:53.493 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:53.491+0000 7ffa03a13180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T18:59:53.493 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:53.494+0000 7f304d98d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T18:59:53.497 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T18:59:53.778 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:53.779+0000 7ffa03a13180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T18:59:53.786 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:53.786+0000 7f304d98d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T18:59:53.839 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:53.839+0000 7ffa03a13180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T18:59:53.847 INFO:tasks.ceph.mgr.y.smithi169.stderr:2024-04-23T18:59:53.850+0000 7f304d98d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T18:59:54.887 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:54.887+0000 7ff9aad59640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-23T18:59:54.887 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-04-23T18:59:54.887+0000 7ff9aad59640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-23T18:59:56.521 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T18:59:56.522+0000 7fc7a52a47c0 -1 osd.2 0 log_to_monitors true 2024-04-23T18:59:56.544 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T18:59:56.546+0000 7f49662817c0 -1 osd.1 0 log_to_monitors true 2024-04-23T18:59:56.652 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T18:59:56.654+0000 7ff51f35c7c0 -1 osd.0 0 log_to_monitors true 2024-04-23T18:59:56.659 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T18:59:56.659+0000 7fd55e0367c0 -1 osd.4 0 log_to_monitors true 2024-04-23T18:59:56.760 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T18:59:56.759+0000 7fcea01b67c0 -1 osd.6 0 log_to_monitors true 2024-04-23T18:59:56.771 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T18:59:56.771+0000 7fdd873f17c0 -1 osd.7 0 log_to_monitors true 2024-04-23T18:59:56.775 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T18:59:56.778+0000 7f25e87b47c0 -1 osd.3 0 log_to_monitors true 2024-04-23T18:59:56.783 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T18:59:56.783+0000 7f38cea5f7c0 -1 osd.5 0 log_to_monitors true 2024-04-23T18:59:59.926 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T18:59:59.926+0000 7f25e4f6f640 -1 osd.3 0 waiting for initial osdmap 2024-04-23T18:59:59.960 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T18:59:59.962+0000 7f25dc591640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:59:59.994 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T18:59:59.994+0000 7f496222a640 -1 osd.1 0 waiting for initial osdmap 2024-04-23T19:00:00.028 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:00.030+0000 7f495a05e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.072 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:00.071+0000 7fdd8339a640 -1 osd.7 0 waiting for initial osdmap 2024-04-23T19:00:00.081 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:00.082+0000 7fc7a124d640 -1 osd.2 0 waiting for initial osdmap 2024-04-23T19:00:00.098 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:00.099+0000 7fdd7b1ce640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.102 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:00.103+0000 7fce9c971640 -1 osd.6 0 waiting for initial osdmap 2024-04-23T19:00:00.104 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:00.103+0000 7f38caa08640 -1 osd.5 0 waiting for initial osdmap 2024-04-23T19:00:00.107 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:00.107+0000 7fd55a7f1640 -1 osd.4 0 waiting for initial osdmap 2024-04-23T19:00:00.108 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:00.110+0000 7fc799081640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.116 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:00.118+0000 7ff51b305640 -1 osd.0 0 waiting for initial osdmap 2024-04-23T19:00:00.130 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:00.131+0000 7fd551e13640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.130 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:00.131+0000 7f38c283c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.131 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:00.131+0000 7fce93f93640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.148 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:00.150+0000 7ff513139640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T19:00:00.303 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T19:00:00.600 INFO:teuthology.misc.health.smithi169.stdout: 2024-04-23T19:00:00.601 INFO:teuthology.misc.health.smithi169.stdout:{"epoch":12,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T18:59:57.889614+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:00:00.618 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T19:00:07.424 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T19:00:07.722 INFO:teuthology.misc.health.smithi169.stdout: 2024-04-23T19:00:07.722 INFO:teuthology.misc.health.smithi169.stdout:{"epoch":16,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T19:00:04.161066+0000","last_up_change":"2024-04-23T19:00:00.934154+0000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T19:00:01.944184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6809","nonce":2480149234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6811","nonce":2480149234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6815","nonce":2480149234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6813","nonce":2480149234}]},"public_addr":"172.21.15.169:6809/2480149234","cluster_addr":"172.21.15.169:6811/2480149234","heartbeat_back_addr":"172.21.15.169:6815/2480149234","heartbeat_front_addr":"172.21.15.169:6813/2480149234","state":["exists","up"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6818","nonce":2143529353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6823","nonce":2143529353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6831","nonce":2143529353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6825","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6828","nonce":2143529353}]},"public_addr":"172.21.15.169:6818/2143529353","cluster_addr":"172.21.15.169:6823/2143529353","heartbeat_back_addr":"172.21.15.169:6831/2143529353","heartbeat_front_addr":"172.21.15.169:6828/2143529353","state":["exists","up"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6819","nonce":2796580003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6822","nonce":2796580003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6827","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6829","nonce":2796580003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6826","nonce":2796580003}]},"public_addr":"172.21.15.169:6819/2796580003","cluster_addr":"172.21.15.169:6822/2796580003","heartbeat_back_addr":"172.21.15.169:6829/2796580003","heartbeat_front_addr":"172.21.15.169:6826/2796580003","state":["exists","up"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6801","nonce":3764305788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6803","nonce":3764305788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6807","nonce":3764305788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6805","nonce":3764305788}]},"public_addr":"172.21.15.169:6801/3764305788","cluster_addr":"172.21.15.169:6803/3764305788","heartbeat_back_addr":"172.21.15.169:6807/3764305788","heartbeat_front_addr":"172.21.15.169:6805/3764305788","state":["exists","up"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6801","nonce":519231085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6803","nonce":519231085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6812","nonce":519231085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6805","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6807","nonce":519231085}]},"public_addr":"172.21.15.193:6801/519231085","cluster_addr":"172.21.15.193:6803/519231085","heartbeat_back_addr":"172.21.15.193:6812/519231085","heartbeat_front_addr":"172.21.15.193:6807/519231085","state":["exists","up"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6818","nonce":3321647745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6821","nonce":3321647745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6825","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6827","nonce":3321647745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6824","nonce":3321647745}]},"public_addr":"172.21.15.193:6818/3321647745","cluster_addr":"172.21.15.193:6821/3321647745","heartbeat_back_addr":"172.21.15.193:6827/3321647745","heartbeat_front_addr":"172.21.15.193:6824/3321647745","state":["exists","up"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6806","nonce":46529429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6809","nonce":46529429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6815","nonce":46529429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6811","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6813","nonce":46529429}]},"public_addr":"172.21.15.193:6806/46529429","cluster_addr":"172.21.15.193:6809/46529429","heartbeat_back_addr":"172.21.15.193:6815/46529429","heartbeat_front_addr":"172.21.15.193:6813/46529429","state":["exists","up"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6817","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6820","nonce":1901200038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6823","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6826","nonce":1901200038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6831","nonce":1901200038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6829","nonce":1901200038}]},"public_addr":"172.21.15.193:6820/1901200038","cluster_addr":"172.21.15.193:6826/1901200038","heartbeat_back_addr":"172.21.15.193:6831/1901200038","heartbeat_front_addr":"172.21.15.193:6829/1901200038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.665743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.556828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.555318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.632689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.791617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811905+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.825013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:00:07.739 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-23T19:00:07.739 INFO:tasks.ceph:Creating RBD pool 2024-04-23T19:00:07.740 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-23T19:00:08.185 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'rbd' created 2024-04-23T19:00:08.210 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-23T19:00:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-23T19:00:09.215 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T19:00:09.215 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T19:00:09.216 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T19:00:09.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T19:00:09.216 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T19:00:09.559 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:09.577 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":3158508135},{"type":"v1","addr":"172.21.15.193:6833","nonce":3158508135}]},"active_addr":"172.21.15.193:6833/3158508135","active_change":"2024-04-23T18:59:53.864791+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3627311264}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":2074182197}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":1798680090}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3403871299}]}]} 2024-04-23T19:00:09.583 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T19:00:09.583 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T19:00:09.584 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T19:00:09.885 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:09.886 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":18,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T19:00:09.183013+0000","last_up_change":"2024-04-23T19:00:00.934154+0000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T19:00:01.944184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T19:00:08.051772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6809","nonce":2480149234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6811","nonce":2480149234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6815","nonce":2480149234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6813","nonce":2480149234}]},"public_addr":"172.21.15.169:6809/2480149234","cluster_addr":"172.21.15.169:6811/2480149234","heartbeat_back_addr":"172.21.15.169:6815/2480149234","heartbeat_front_addr":"172.21.15.169:6813/2480149234","state":["exists","up"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6818","nonce":2143529353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6823","nonce":2143529353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6831","nonce":2143529353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6825","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6828","nonce":2143529353}]},"public_addr":"172.21.15.169:6818/2143529353","cluster_addr":"172.21.15.169:6823/2143529353","heartbeat_back_addr":"172.21.15.169:6831/2143529353","heartbeat_front_addr":"172.21.15.169:6828/2143529353","state":["exists","up"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6819","nonce":2796580003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6822","nonce":2796580003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6827","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6829","nonce":2796580003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6826","nonce":2796580003}]},"public_addr":"172.21.15.169:6819/2796580003","cluster_addr":"172.21.15.169:6822/2796580003","heartbeat_back_addr":"172.21.15.169:6829/2796580003","heartbeat_front_addr":"172.21.15.169:6826/2796580003","state":["exists","up"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6801","nonce":3764305788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6803","nonce":3764305788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6807","nonce":3764305788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6805","nonce":3764305788}]},"public_addr":"172.21.15.169:6801/3764305788","cluster_addr":"172.21.15.169:6803/3764305788","heartbeat_back_addr":"172.21.15.169:6807/3764305788","heartbeat_front_addr":"172.21.15.169:6805/3764305788","state":["exists","up"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6801","nonce":519231085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6803","nonce":519231085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6812","nonce":519231085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6805","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6807","nonce":519231085}]},"public_addr":"172.21.15.193:6801/519231085","cluster_addr":"172.21.15.193:6803/519231085","heartbeat_back_addr":"172.21.15.193:6812/519231085","heartbeat_front_addr":"172.21.15.193:6807/519231085","state":["exists","up"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6818","nonce":3321647745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6821","nonce":3321647745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6825","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6827","nonce":3321647745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6824","nonce":3321647745}]},"public_addr":"172.21.15.193:6818/3321647745","cluster_addr":"172.21.15.193:6821/3321647745","heartbeat_back_addr":"172.21.15.193:6827/3321647745","heartbeat_front_addr":"172.21.15.193:6824/3321647745","state":["exists","up"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6806","nonce":46529429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6809","nonce":46529429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6815","nonce":46529429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6811","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6813","nonce":46529429}]},"public_addr":"172.21.15.193:6806/46529429","cluster_addr":"172.21.15.193:6809/46529429","heartbeat_back_addr":"172.21.15.193:6815/46529429","heartbeat_front_addr":"172.21.15.193:6813/46529429","state":["exists","up"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6817","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6820","nonce":1901200038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6823","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6826","nonce":1901200038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6831","nonce":1901200038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6829","nonce":1901200038}]},"public_addr":"172.21.15.193:6820/1901200038","cluster_addr":"172.21.15.193:6826/1901200038","heartbeat_back_addr":"172.21.15.193:6831/1901200038","heartbeat_front_addr":"172.21.15.193:6829/1901200038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.665743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.556828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.555318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.632689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.791617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811905+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.825013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:00:09.905 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T19:00:09.905 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T19:00:10.204 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:10.205 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":19,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T19:00:10.185475+0000","last_up_change":"2024-04-23T19:00:00.934154+0000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T19:00:01.944184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T19:00:08.051772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6809","nonce":2480149234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6811","nonce":2480149234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6815","nonce":2480149234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6813","nonce":2480149234}]},"public_addr":"172.21.15.169:6809/2480149234","cluster_addr":"172.21.15.169:6811/2480149234","heartbeat_back_addr":"172.21.15.169:6815/2480149234","heartbeat_front_addr":"172.21.15.169:6813/2480149234","state":["exists","up"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6818","nonce":2143529353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6823","nonce":2143529353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6831","nonce":2143529353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6825","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6828","nonce":2143529353}]},"public_addr":"172.21.15.169:6818/2143529353","cluster_addr":"172.21.15.169:6823/2143529353","heartbeat_back_addr":"172.21.15.169:6831/2143529353","heartbeat_front_addr":"172.21.15.169:6828/2143529353","state":["exists","up"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6819","nonce":2796580003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6822","nonce":2796580003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6827","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6829","nonce":2796580003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6826","nonce":2796580003}]},"public_addr":"172.21.15.169:6819/2796580003","cluster_addr":"172.21.15.169:6822/2796580003","heartbeat_back_addr":"172.21.15.169:6829/2796580003","heartbeat_front_addr":"172.21.15.169:6826/2796580003","state":["exists","up"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6801","nonce":3764305788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6803","nonce":3764305788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6807","nonce":3764305788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6805","nonce":3764305788}]},"public_addr":"172.21.15.169:6801/3764305788","cluster_addr":"172.21.15.169:6803/3764305788","heartbeat_back_addr":"172.21.15.169:6807/3764305788","heartbeat_front_addr":"172.21.15.169:6805/3764305788","state":["exists","up"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6801","nonce":519231085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6803","nonce":519231085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6812","nonce":519231085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6805","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6807","nonce":519231085}]},"public_addr":"172.21.15.193:6801/519231085","cluster_addr":"172.21.15.193:6803/519231085","heartbeat_back_addr":"172.21.15.193:6812/519231085","heartbeat_front_addr":"172.21.15.193:6807/519231085","state":["exists","up"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6818","nonce":3321647745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6821","nonce":3321647745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6825","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6827","nonce":3321647745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6824","nonce":3321647745}]},"public_addr":"172.21.15.193:6818/3321647745","cluster_addr":"172.21.15.193:6821/3321647745","heartbeat_back_addr":"172.21.15.193:6827/3321647745","heartbeat_front_addr":"172.21.15.193:6824/3321647745","state":["exists","up"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6806","nonce":46529429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6809","nonce":46529429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6815","nonce":46529429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6811","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6813","nonce":46529429}]},"public_addr":"172.21.15.193:6806/46529429","cluster_addr":"172.21.15.193:6809/46529429","heartbeat_back_addr":"172.21.15.193:6815/46529429","heartbeat_front_addr":"172.21.15.193:6813/46529429","state":["exists","up"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6817","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6820","nonce":1901200038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6823","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6826","nonce":1901200038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6831","nonce":1901200038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6829","nonce":1901200038}]},"public_addr":"172.21.15.193:6820/1901200038","cluster_addr":"172.21.15.193:6826/1901200038","heartbeat_back_addr":"172.21.15.193:6831/1901200038","heartbeat_front_addr":"172.21.15.193:6829/1901200038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.665743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.556828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.555318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.632689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.791617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811905+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.825013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:00:10.222 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T19:00:10.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T19:00:10.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T19:00:10.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T19:00:10.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T19:00:10.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T19:00:10.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T19:00:10.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T19:00:10.488 INFO:teuthology.orchestra.run.smithi169.stdout:55834574853 2024-04-23T19:00:10.488 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T19:00:10.489 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:10.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T19:00:10.491 INFO:teuthology.orchestra.run.smithi169.stdout:55834574854 2024-04-23T19:00:10.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T19:00:10.496 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:10.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T19:00:10.500 INFO:teuthology.orchestra.run.smithi169.stdout:55834574854 2024-04-23T19:00:10.501 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T19:00:10.505 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:10.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T19:00:10.506 INFO:teuthology.orchestra.run.smithi169.stdout:55834574853 2024-04-23T19:00:10.507 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T19:00:10.512 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:10.512 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T19:00:10.983 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:10.992 INFO:teuthology.orchestra.run.smithi169.stdout:55834574851 2024-04-23T19:00:11.007 INFO:teuthology.orchestra.run.smithi169.stdout:55834574851 2024-04-23T19:00:11.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-23T19:00:11.012 INFO:teuthology.orchestra.run.smithi169.stdout:55834574853 2024-04-23T19:00:11.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-04-23T19:00:11.031 INFO:teuthology.orchestra.run.smithi169.stdout:55834574853 2024-04-23T19:00:11.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-04-23T19:00:11.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-23T19:00:11.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-23T19:00:11.051 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:11.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-04-23T19:00:11.080 INFO:teuthology.orchestra.run.smithi169.stdout:55834574851 2024-04-23T19:00:11.091 INFO:teuthology.orchestra.run.smithi169.stdout:55834574851 2024-04-23T19:00:11.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-04-23T19:00:11.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-04-23T19:00:12.012 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T19:00:12.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T19:00:12.037 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T19:00:12.040 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T19:00:12.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T19:00:12.069 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T19:00:12.101 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T19:00:12.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T19:00:12.477 INFO:teuthology.orchestra.run.smithi169.stdout:55834574853 2024-04-23T19:00:12.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-23T19:00:12.499 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.537 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:12.549 INFO:teuthology.orchestra.run.smithi169.stdout:55834574854 2024-04-23T19:00:12.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-04-23T19:00:12.567 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-23T19:00:12.569 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.600 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:12.602 INFO:teuthology.orchestra.run.smithi169.stdout:55834574853 2024-04-23T19:00:12.611 INFO:teuthology.orchestra.run.smithi169.stdout:55834574854 2024-04-23T19:00:12.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-04-23T19:00:12.624 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-23T19:00:12.628 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-23T19:00:12.636 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.646 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:12.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-04-23T19:00:12.663 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.670 INFO:teuthology.orchestra.run.smithi169.stdout:55834574852 2024-04-23T19:00:12.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-04-23T19:00:12.687 DEBUG:teuthology.parallel:result is None 2024-04-23T19:00:12.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T19:00:12.687 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:00:13.004 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:13.004 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:00:13.020 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-23T19:00:11.876201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218756,"kb_used_data":2556,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755964,"statfs":{"total":773094113280,"available":772870107136,"internally_reserved":0,"allocated":2617344,"data_stored":1633423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001096"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.194039+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:00:10.194039+0000","last_peered":"2024-04-23T19:00:10.194039+0000","last_clean":"2024-04-23T19:00:10.194039+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:00:10.194039+0000","last_undegraded":"2024-04-23T19:00:10.194039+0000","last_fullsized":"2024-04-23T19:00:10.194039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195219+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:00:10.195219+0000","last_peered":"2024-04-23T19:00:10.195219+0000","last_clean":"2024-04-23T19:00:10.195219+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:00:10.195219+0000","last_undegraded":"2024-04-23T19:00:10.195219+0000","last_fullsized":"2024-04-23T19:00:10.195219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195273+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:00:10.195273+0000","last_peered":"2024-04-23T19:00:10.195273+0000","last_clean":"2024-04-23T19:00:10.195273+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:00:10.195273+0000","last_undegraded":"2024-04-23T19:00:10.195273+0000","last_fullsized":"2024-04-23T19:00:10.195273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195203+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:00:10.195203+0000","last_peered":"2024-04-23T19:00:10.195203+0000","last_clean":"2024-04-23T19:00:10.195203+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:00:10.195203+0000","last_undegraded":"2024-04-23T19:00:10.195203+0000","last_fullsized":"2024-04-23T19:00:10.195203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.190600+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:00:10.190600+0000","last_peered":"2024-04-23T19:00:10.190600+0000","last_clean":"2024-04-23T19:00:10.190600+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:00:10.190600+0000","last_undegraded":"2024-04-23T19:00:10.190600+0000","last_fullsized":"2024-04-23T19:00:10.190600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.192761+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:00:10.192761+0000","last_peered":"2024-04-23T19:00:10.192761+0000","last_clean":"2024-04-23T19:00:10.192761+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:00:10.192761+0000","last_undegraded":"2024-04-23T19:00:10.192761+0000","last_fullsized":"2024-04-23T19:00:10.192761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195222+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:00:10.195222+0000","last_peered":"2024-04-23T19:00:10.195222+0000","last_clean":"2024-04-23T19:00:10.195222+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:00:10.195222+0000","last_undegraded":"2024-04-23T19:00:10.195222+0000","last_fullsized":"2024-04-23T19:00:10.195222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.190740+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:00:10.190740+0000","last_peered":"2024-04-23T19:00:10.190740+0000","last_clean":"2024-04-23T19:00:10.190740+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:00:10.190740+0000","last_undegraded":"2024-04-23T19:00:10.190740+0000","last_fullsized":"2024-04-23T19:00:10.190740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.194990+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:00:10.194990+0000","last_peered":"2024-04-23T19:00:10.194990+0000","last_clean":"2024-04-23T19:00:10.194990+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:00:10.194990+0000","last_undegraded":"2024-04-23T19:00:10.194990+0000","last_fullsized":"2024-04-23T19:00:10.194990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:00:13.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:00:13.295 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:13.295 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:00:13.311 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-23T19:00:11.876201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218756,"kb_used_data":2556,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755964,"statfs":{"total":773094113280,"available":772870107136,"internally_reserved":0,"allocated":2617344,"data_stored":1633423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001096"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.194039+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:00:10.194039+0000","last_peered":"2024-04-23T19:00:10.194039+0000","last_clean":"2024-04-23T19:00:10.194039+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:00:10.194039+0000","last_undegraded":"2024-04-23T19:00:10.194039+0000","last_fullsized":"2024-04-23T19:00:10.194039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195219+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:00:10.195219+0000","last_peered":"2024-04-23T19:00:10.195219+0000","last_clean":"2024-04-23T19:00:10.195219+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:00:10.195219+0000","last_undegraded":"2024-04-23T19:00:10.195219+0000","last_fullsized":"2024-04-23T19:00:10.195219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195273+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:00:10.195273+0000","last_peered":"2024-04-23T19:00:10.195273+0000","last_clean":"2024-04-23T19:00:10.195273+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:00:10.195273+0000","last_undegraded":"2024-04-23T19:00:10.195273+0000","last_fullsized":"2024-04-23T19:00:10.195273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195203+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:00:10.195203+0000","last_peered":"2024-04-23T19:00:10.195203+0000","last_clean":"2024-04-23T19:00:10.195203+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:00:10.195203+0000","last_undegraded":"2024-04-23T19:00:10.195203+0000","last_fullsized":"2024-04-23T19:00:10.195203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.190600+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:00:10.190600+0000","last_peered":"2024-04-23T19:00:10.190600+0000","last_clean":"2024-04-23T19:00:10.190600+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:00:10.190600+0000","last_undegraded":"2024-04-23T19:00:10.190600+0000","last_fullsized":"2024-04-23T19:00:10.190600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.192761+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:00:10.192761+0000","last_peered":"2024-04-23T19:00:10.192761+0000","last_clean":"2024-04-23T19:00:10.192761+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:00:10.192761+0000","last_undegraded":"2024-04-23T19:00:10.192761+0000","last_fullsized":"2024-04-23T19:00:10.192761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.195222+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:00:10.195222+0000","last_peered":"2024-04-23T19:00:10.195222+0000","last_clean":"2024-04-23T19:00:10.195222+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:00:10.195222+0000","last_undegraded":"2024-04-23T19:00:10.195222+0000","last_fullsized":"2024-04-23T19:00:10.195222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.190740+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:00:10.190740+0000","last_peered":"2024-04-23T19:00:10.190740+0000","last_clean":"2024-04-23T19:00:10.190740+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:00:10.190740+0000","last_undegraded":"2024-04-23T19:00:10.190740+0000","last_fullsized":"2024-04-23T19:00:10.190740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T19:00:10.194990+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:00:10.194990+0000","last_peered":"2024-04-23T19:00:10.194990+0000","last_clean":"2024-04-23T19:00:10.194990+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:00:10.194990+0000","last_undegraded":"2024-04-23T19:00:10.194990+0000","last_fullsized":"2024-04-23T19:00:10.194990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:00:13.312 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T19:00:13.312 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T19:00:13.312 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T19:00:13.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T19:00:13.621 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:13.621 INFO:teuthology.orchestra.run.smithi169.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T19:00:13.638 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T19:00:13.639 INFO:teuthology.run_tasks:Running task rgw... 2024-04-23T19:00:13.653 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-23T19:00:13.653 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-23T19:00:13.653 INFO:tasks.rgw:Creating data pools 2024-04-23T19:00:13.654 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-23T19:00:13.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-23T19:00:14.224 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'default.rgw.buckets.data' created 2024-04-23T19:00:14.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-23T19:00:15.227 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-23T19:00:15.272 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-23T19:00:16.272 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'default.rgw.buckets.index' created 2024-04-23T19:00:16.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-23T19:00:17.275 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-23T19:00:17.324 DEBUG:tasks.rgw:Pools created 2024-04-23T19:00:17.325 INFO:tasks.rgw:Starting rgw... 2024-04-23T19:00:17.325 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-23T19:00:17.325 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-23T19:00:17.325 DEBUG:teuthology.orchestra.run.smithi169:> sudo echo -n http://smithi169.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-23T19:00:17.336 INFO:teuthology.orchestra.run.smithi169.stdout:http://smithi169.front.sepia.ceph.com:80 2024-04-23T19:00:17.336 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-23T19:00:17.389 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-23T19:00:17.389 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-23T19:00:17.432 INFO:tasks.rgw.client.0:Started 2024-04-23T19:00:17.432 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi169.front.sepia.ceph.com:80/ 2024-04-23T19:00:17.432 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-23T19:00:17.459 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T19:00:17.460 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T19:00:17.460 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-23T19:00:18.461 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-23T19:00:18.473 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T19:00:18.473 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-23T19:00:18.473 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T19:00:18.473 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-23T19:00:18.474 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T19:00:20.475 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-23T19:00:20.486 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T19:00:20.486 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-23T19:00:20.486 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T19:00:20.486 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-23T19:00:20.487 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T19:00:24.488 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-23T19:00:24.500 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T19:00:24.500 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-23T19:00:24.500 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T19:00:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-23T19:00:24.501 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T19:00:26.459 INFO:tasks.rgw.client.0.smithi169.stdout:2024-04-23T19:00:26.462+0000 7f6e39f43a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-23T19:00:32.502 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-23T19:00:32.514 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T19:00:32.514 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-23T19:00:32.517 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 54598 0 --:--:-- --:--:-- --:--:-- 62333 2024-04-23T19:00:32.518 INFO:teuthology.orchestra.run.smithi169.stdout:anonymous 2024-04-23T19:00:32.518 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-23T19:00:32.531 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-23T19:00:32.531 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'rgw-update-boost-redis'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rgw-update-boost-redis', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}} 2024-04-23T19:00:32.531 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-23T19:00:32.532 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-23T19:00:32.890 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-23T19:00:32.891 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T19:00:32.891 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:00:33.230 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:33.241 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:00:33.257 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-23T19:00:31.883818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":649,"num_read_kb":445,"num_write":480,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":473,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224488,"kb_used_data":4160,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750232,"statfs":{"total":773094113280,"available":772864237568,"internally_reserved":0,"allocated":4259840,"data_stored":2443824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":529,"num_read_kb":341,"num_write":311,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.586559"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333035+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:00:26.333035+0000","last_peered":"2024-04-23T19:00:26.333035+0000","last_clean":"2024-04-23T19:00:26.333035+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:00:26.333035+0000","last_undegraded":"2024-04-23T19:00:26.333035+0000","last_fullsized":"2024-04-23T19:00:26.333035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309295+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:00:26.309295+0000","last_peered":"2024-04-23T19:00:26.309295+0000","last_clean":"2024-04-23T19:00:26.309295+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:00:26.309295+0000","last_undegraded":"2024-04-23T19:00:26.309295+0000","last_fullsized":"2024-04-23T19:00:26.309295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321276+0000","last_change":"2024-04-23T19:00:15.257176+0000","last_active":"2024-04-23T19:00:26.321276+0000","last_peered":"2024-04-23T19:00:26.321276+0000","last_clean":"2024-04-23T19:00:26.321276+0000","last_became_active":"2024-04-23T19:00:15.256794+0000","last_became_peered":"2024-04-23T19:00:15.256794+0000","last_unstale":"2024-04-23T19:00:26.321276+0000","last_undegraded":"2024-04-23T19:00:26.321276+0000","last_fullsized":"2024-04-23T19:00:26.321276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330971+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:00:26.330971+0000","last_peered":"2024-04-23T19:00:26.330971+0000","last_clean":"2024-04-23T19:00:26.330971+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:00:26.330971+0000","last_undegraded":"2024-04-23T19:00:26.330971+0000","last_fullsized":"2024-04-23T19:00:26.330971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325572+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:00:26.325572+0000","last_peered":"2024-04-23T19:00:26.325572+0000","last_clean":"2024-04-23T19:00:26.325572+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:00:26.325572+0000","last_undegraded":"2024-04-23T19:00:26.325572+0000","last_fullsized":"2024-04-23T19:00:26.325572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347209+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:00:26.347209+0000","last_peered":"2024-04-23T19:00:26.347209+0000","last_clean":"2024-04-23T19:00:26.347209+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:00:26.347209+0000","last_undegraded":"2024-04-23T19:00:26.347209+0000","last_fullsized":"2024-04-23T19:00:26.347209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311555+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:00:26.311555+0000","last_peered":"2024-04-23T19:00:26.311555+0000","last_clean":"2024-04-23T19:00:26.311555+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:00:26.311555+0000","last_undegraded":"2024-04-23T19:00:26.311555+0000","last_fullsized":"2024-04-23T19:00:26.311555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323180+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:00:26.323180+0000","last_peered":"2024-04-23T19:00:26.323180+0000","last_clean":"2024-04-23T19:00:26.323180+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:00:26.323180+0000","last_undegraded":"2024-04-23T19:00:26.323180+0000","last_fullsized":"2024-04-23T19:00:26.323180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332000+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:00:26.332000+0000","last_peered":"2024-04-23T19:00:26.332000+0000","last_clean":"2024-04-23T19:00:26.332000+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:00:26.332000+0000","last_undegraded":"2024-04-23T19:00:26.332000+0000","last_fullsized":"2024-04-23T19:00:26.332000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340437+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:00:26.340437+0000","last_peered":"2024-04-23T19:00:26.340437+0000","last_clean":"2024-04-23T19:00:26.340437+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:00:26.340437+0000","last_undegraded":"2024-04-23T19:00:26.340437+0000","last_fullsized":"2024-04-23T19:00:26.340437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309980+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:00:26.309980+0000","last_peered":"2024-04-23T19:00:26.309980+0000","last_clean":"2024-04-23T19:00:26.309980+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:00:26.309980+0000","last_undegraded":"2024-04-23T19:00:26.309980+0000","last_fullsized":"2024-04-23T19:00:26.309980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347761+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:00:26.347761+0000","last_peered":"2024-04-23T19:00:26.347761+0000","last_clean":"2024-04-23T19:00:26.347761+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:00:26.347761+0000","last_undegraded":"2024-04-23T19:00:26.347761+0000","last_fullsized":"2024-04-23T19:00:26.347761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331295+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:00:26.331295+0000","last_peered":"2024-04-23T19:00:26.331295+0000","last_clean":"2024-04-23T19:00:26.331295+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:00:26.331295+0000","last_undegraded":"2024-04-23T19:00:26.331295+0000","last_fullsized":"2024-04-23T19:00:26.331295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311432+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:00:26.311432+0000","last_peered":"2024-04-23T19:00:26.311432+0000","last_clean":"2024-04-23T19:00:26.311432+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:00:26.311432+0000","last_undegraded":"2024-04-23T19:00:26.311432+0000","last_fullsized":"2024-04-23T19:00:26.311432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310790+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:00:26.310790+0000","last_peered":"2024-04-23T19:00:26.310790+0000","last_clean":"2024-04-23T19:00:26.310790+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:00:26.310790+0000","last_undegraded":"2024-04-23T19:00:26.310790+0000","last_fullsized":"2024-04-23T19:00:26.310790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309948+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:00:26.309948+0000","last_peered":"2024-04-23T19:00:26.309948+0000","last_clean":"2024-04-23T19:00:26.309948+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:00:26.309948+0000","last_undegraded":"2024-04-23T19:00:26.309948+0000","last_fullsized":"2024-04-23T19:00:26.309948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346115+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:00:26.346115+0000","last_peered":"2024-04-23T19:00:26.346115+0000","last_clean":"2024-04-23T19:00:26.346115+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:00:26.346115+0000","last_undegraded":"2024-04-23T19:00:26.346115+0000","last_fullsized":"2024-04-23T19:00:26.346115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333080+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:00:26.333080+0000","last_peered":"2024-04-23T19:00:26.333080+0000","last_clean":"2024-04-23T19:00:26.333080+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:00:26.333080+0000","last_undegraded":"2024-04-23T19:00:26.333080+0000","last_fullsized":"2024-04-23T19:00:26.333080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331190+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:00:26.331190+0000","last_peered":"2024-04-23T19:00:26.331190+0000","last_clean":"2024-04-23T19:00:26.331190+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:00:26.331190+0000","last_undegraded":"2024-04-23T19:00:26.331190+0000","last_fullsized":"2024-04-23T19:00:26.331190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341724+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:00:26.341724+0000","last_peered":"2024-04-23T19:00:26.341724+0000","last_clean":"2024-04-23T19:00:26.341724+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:00:26.341724+0000","last_undegraded":"2024-04-23T19:00:26.341724+0000","last_fullsized":"2024-04-23T19:00:26.341724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310390+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:00:26.310390+0000","last_peered":"2024-04-23T19:00:26.310390+0000","last_clean":"2024-04-23T19:00:26.310390+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:00:26.310390+0000","last_undegraded":"2024-04-23T19:00:26.310390+0000","last_fullsized":"2024-04-23T19:00:26.310390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341440+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:00:26.341440+0000","last_peered":"2024-04-23T19:00:26.341440+0000","last_clean":"2024-04-23T19:00:26.341440+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:00:26.341440+0000","last_undegraded":"2024-04-23T19:00:26.341440+0000","last_fullsized":"2024-04-23T19:00:26.341440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.308460+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:00:26.308460+0000","last_peered":"2024-04-23T19:00:26.308460+0000","last_clean":"2024-04-23T19:00:26.308460+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:00:26.308460+0000","last_undegraded":"2024-04-23T19:00:26.308460+0000","last_fullsized":"2024-04-23T19:00:26.308460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347085+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:00:26.347085+0000","last_peered":"2024-04-23T19:00:26.347085+0000","last_clean":"2024-04-23T19:00:26.347085+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:00:26.347085+0000","last_undegraded":"2024-04-23T19:00:26.347085+0000","last_fullsized":"2024-04-23T19:00:26.347085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309045+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:00:26.309045+0000","last_peered":"2024-04-23T19:00:26.309045+0000","last_clean":"2024-04-23T19:00:26.309045+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:00:26.309045+0000","last_undegraded":"2024-04-23T19:00:26.309045+0000","last_fullsized":"2024-04-23T19:00:26.309045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312271+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:00:26.312271+0000","last_peered":"2024-04-23T19:00:26.312271+0000","last_clean":"2024-04-23T19:00:26.312271+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:00:26.312271+0000","last_undegraded":"2024-04-23T19:00:26.312271+0000","last_fullsized":"2024-04-23T19:00:26.312271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348017+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:00:26.348017+0000","last_peered":"2024-04-23T19:00:26.348017+0000","last_clean":"2024-04-23T19:00:26.348017+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:00:26.348017+0000","last_undegraded":"2024-04-23T19:00:26.348017+0000","last_fullsized":"2024-04-23T19:00:26.348017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323409+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:00:26.323409+0000","last_peered":"2024-04-23T19:00:26.323409+0000","last_clean":"2024-04-23T19:00:26.323409+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:00:26.323409+0000","last_undegraded":"2024-04-23T19:00:26.323409+0000","last_fullsized":"2024-04-23T19:00:26.323409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346107+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:00:26.346107+0000","last_peered":"2024-04-23T19:00:26.346107+0000","last_clean":"2024-04-23T19:00:26.346107+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:00:26.346107+0000","last_undegraded":"2024-04-23T19:00:26.346107+0000","last_fullsized":"2024-04-23T19:00:26.346107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313576+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:00:26.313576+0000","last_peered":"2024-04-23T19:00:26.313576+0000","last_clean":"2024-04-23T19:00:26.313576+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:00:26.313576+0000","last_undegraded":"2024-04-23T19:00:26.313576+0000","last_fullsized":"2024-04-23T19:00:26.313576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332142+0000","last_change":"2024-04-23T19:00:15.286378+0000","last_active":"2024-04-23T19:00:26.332142+0000","last_peered":"2024-04-23T19:00:26.332142+0000","last_clean":"2024-04-23T19:00:26.332142+0000","last_became_active":"2024-04-23T19:00:15.281478+0000","last_became_peered":"2024-04-23T19:00:15.281478+0000","last_unstale":"2024-04-23T19:00:26.332142+0000","last_undegraded":"2024-04-23T19:00:26.332142+0000","last_fullsized":"2024-04-23T19:00:26.332142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:02.135753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310275+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:00:26.310275+0000","last_peered":"2024-04-23T19:00:26.310275+0000","last_clean":"2024-04-23T19:00:26.310275+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:00:26.310275+0000","last_undegraded":"2024-04-23T19:00:26.310275+0000","last_fullsized":"2024-04-23T19:00:26.310275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.720309+0000","last_change":"2024-04-23T19:00:21.316254+0000","last_active":"2024-04-23T19:00:26.720309+0000","last_peered":"2024-04-23T19:00:26.720309+0000","last_clean":"2024-04-23T19:00:26.720309+0000","last_became_active":"2024-04-23T19:00:21.315622+0000","last_became_peered":"2024-04-23T19:00:21.315622+0000","last_unstale":"2024-04-23T19:00:26.720309+0000","last_undegraded":"2024-04-23T19:00:26.720309+0000","last_fullsized":"2024-04-23T19:00:26.720309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332739+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:00:26.332739+0000","last_peered":"2024-04-23T19:00:26.332739+0000","last_clean":"2024-04-23T19:00:26.332739+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:00:26.332739+0000","last_undegraded":"2024-04-23T19:00:26.332739+0000","last_fullsized":"2024-04-23T19:00:26.332739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309565+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:00:26.309565+0000","last_peered":"2024-04-23T19:00:26.309565+0000","last_clean":"2024-04-23T19:00:26.309565+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:00:26.309565+0000","last_undegraded":"2024-04-23T19:00:26.309565+0000","last_fullsized":"2024-04-23T19:00:26.309565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311480+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:00:26.311480+0000","last_peered":"2024-04-23T19:00:26.311480+0000","last_clean":"2024-04-23T19:00:26.311480+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:00:26.311480+0000","last_undegraded":"2024-04-23T19:00:26.311480+0000","last_fullsized":"2024-04-23T19:00:26.311480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323409+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:00:26.323409+0000","last_peered":"2024-04-23T19:00:26.323409+0000","last_clean":"2024-04-23T19:00:26.323409+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:00:26.323409+0000","last_undegraded":"2024-04-23T19:00:26.323409+0000","last_fullsized":"2024-04-23T19:00:26.323409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312934+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:00:26.312934+0000","last_peered":"2024-04-23T19:00:26.312934+0000","last_clean":"2024-04-23T19:00:26.312934+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:00:26.312934+0000","last_undegraded":"2024-04-23T19:00:26.312934+0000","last_fullsized":"2024-04-23T19:00:26.312934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.752395+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:00:26.752395+0000","last_peered":"2024-04-23T19:00:26.752395+0000","last_clean":"2024-04-23T19:00:26.752395+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:00:26.752395+0000","last_undegraded":"2024-04-23T19:00:26.752395+0000","last_fullsized":"2024-04-23T19:00:26.752395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348853+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:00:26.348853+0000","last_peered":"2024-04-23T19:00:26.348853+0000","last_clean":"2024-04-23T19:00:26.348853+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:00:26.348853+0000","last_undegraded":"2024-04-23T19:00:26.348853+0000","last_fullsized":"2024-04-23T19:00:26.348853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323133+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:00:26.323133+0000","last_peered":"2024-04-23T19:00:26.323133+0000","last_clean":"2024-04-23T19:00:26.323133+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:00:26.323133+0000","last_undegraded":"2024-04-23T19:00:26.323133+0000","last_fullsized":"2024-04-23T19:00:26.323133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326582+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:00:26.326582+0000","last_peered":"2024-04-23T19:00:26.326582+0000","last_clean":"2024-04-23T19:00:26.326582+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:00:26.326582+0000","last_undegraded":"2024-04-23T19:00:26.326582+0000","last_fullsized":"2024-04-23T19:00:26.326582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331446+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:00:26.331446+0000","last_peered":"2024-04-23T19:00:26.331446+0000","last_clean":"2024-04-23T19:00:26.331446+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:00:26.331446+0000","last_undegraded":"2024-04-23T19:00:26.331446+0000","last_fullsized":"2024-04-23T19:00:26.331446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314653+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:00:26.314653+0000","last_peered":"2024-04-23T19:00:26.314653+0000","last_clean":"2024-04-23T19:00:26.314653+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:00:26.314653+0000","last_undegraded":"2024-04-23T19:00:26.314653+0000","last_fullsized":"2024-04-23T19:00:26.314653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.459735+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:00:26.459735+0000","last_peered":"2024-04-23T19:00:26.459735+0000","last_clean":"2024-04-23T19:00:26.459735+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:00:26.459735+0000","last_undegraded":"2024-04-23T19:00:26.459735+0000","last_fullsized":"2024-04-23T19:00:26.459735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332215+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:00:26.332215+0000","last_peered":"2024-04-23T19:00:26.332215+0000","last_clean":"2024-04-23T19:00:26.332215+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:00:26.332215+0000","last_undegraded":"2024-04-23T19:00:26.332215+0000","last_fullsized":"2024-04-23T19:00:26.332215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347035+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:00:26.347035+0000","last_peered":"2024-04-23T19:00:26.347035+0000","last_clean":"2024-04-23T19:00:26.347035+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:00:26.347035+0000","last_undegraded":"2024-04-23T19:00:26.347035+0000","last_fullsized":"2024-04-23T19:00:26.347035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313339+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:00:26.313339+0000","last_peered":"2024-04-23T19:00:26.313339+0000","last_clean":"2024-04-23T19:00:26.313339+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:00:26.313339+0000","last_undegraded":"2024-04-23T19:00:26.313339+0000","last_fullsized":"2024-04-23T19:00:26.313339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340270+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:00:26.340270+0000","last_peered":"2024-04-23T19:00:26.340270+0000","last_clean":"2024-04-23T19:00:26.340270+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:00:26.340270+0000","last_undegraded":"2024-04-23T19:00:26.340270+0000","last_fullsized":"2024-04-23T19:00:26.340270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311137+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:00:26.311137+0000","last_peered":"2024-04-23T19:00:26.311137+0000","last_clean":"2024-04-23T19:00:26.311137+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:00:26.311137+0000","last_undegraded":"2024-04-23T19:00:26.311137+0000","last_fullsized":"2024-04-23T19:00:26.311137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.738947+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:00:26.738947+0000","last_peered":"2024-04-23T19:00:26.738947+0000","last_clean":"2024-04-23T19:00:26.738947+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:00:26.738947+0000","last_undegraded":"2024-04-23T19:00:26.738947+0000","last_fullsized":"2024-04-23T19:00:26.738947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312411+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:00:26.312411+0000","last_peered":"2024-04-23T19:00:26.312411+0000","last_clean":"2024-04-23T19:00:26.312411+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:00:26.312411+0000","last_undegraded":"2024-04-23T19:00:26.312411+0000","last_fullsized":"2024-04-23T19:00:26.312411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309873+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:00:26.309873+0000","last_peered":"2024-04-23T19:00:26.309873+0000","last_clean":"2024-04-23T19:00:26.309873+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:00:26.309873+0000","last_undegraded":"2024-04-23T19:00:26.309873+0000","last_fullsized":"2024-04-23T19:00:26.309873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333307+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:00:26.333307+0000","last_peered":"2024-04-23T19:00:26.333307+0000","last_clean":"2024-04-23T19:00:26.333307+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:00:26.333307+0000","last_undegraded":"2024-04-23T19:00:26.333307+0000","last_fullsized":"2024-04-23T19:00:26.333307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330586+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:00:26.330586+0000","last_peered":"2024-04-23T19:00:26.330586+0000","last_clean":"2024-04-23T19:00:26.330586+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:00:26.330586+0000","last_undegraded":"2024-04-23T19:00:26.330586+0000","last_fullsized":"2024-04-23T19:00:26.330586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.811948+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:00:26.811948+0000","last_peered":"2024-04-23T19:00:26.811948+0000","last_clean":"2024-04-23T19:00:26.811948+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:00:26.811948+0000","last_undegraded":"2024-04-23T19:00:26.811948+0000","last_fullsized":"2024-04-23T19:00:26.811948+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319179+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:00:26.319179+0000","last_peered":"2024-04-23T19:00:26.319179+0000","last_clean":"2024-04-23T19:00:26.319179+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:00:26.319179+0000","last_undegraded":"2024-04-23T19:00:26.319179+0000","last_fullsized":"2024-04-23T19:00:26.319179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310975+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:00:26.310975+0000","last_peered":"2024-04-23T19:00:26.310975+0000","last_clean":"2024-04-23T19:00:26.310975+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:00:26.310975+0000","last_undegraded":"2024-04-23T19:00:26.310975+0000","last_fullsized":"2024-04-23T19:00:26.310975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346364+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:00:26.346364+0000","last_peered":"2024-04-23T19:00:26.346364+0000","last_clean":"2024-04-23T19:00:26.346364+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:00:26.346364+0000","last_undegraded":"2024-04-23T19:00:26.346364+0000","last_fullsized":"2024-04-23T19:00:26.346364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333106+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:00:26.333106+0000","last_peered":"2024-04-23T19:00:26.333106+0000","last_clean":"2024-04-23T19:00:26.333106+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:00:26.333106+0000","last_undegraded":"2024-04-23T19:00:26.333106+0000","last_fullsized":"2024-04-23T19:00:26.333106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307295+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:00:26.307295+0000","last_peered":"2024-04-23T19:00:26.307295+0000","last_clean":"2024-04-23T19:00:26.307295+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:00:26.307295+0000","last_undegraded":"2024-04-23T19:00:26.307295+0000","last_fullsized":"2024-04-23T19:00:26.307295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.727404+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:00:26.727404+0000","last_peered":"2024-04-23T19:00:26.727404+0000","last_clean":"2024-04-23T19:00:26.727404+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:00:26.727404+0000","last_undegraded":"2024-04-23T19:00:26.727404+0000","last_fullsized":"2024-04-23T19:00:26.727404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309482+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:00:26.309482+0000","last_peered":"2024-04-23T19:00:26.309482+0000","last_clean":"2024-04-23T19:00:26.309482+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:00:26.309482+0000","last_undegraded":"2024-04-23T19:00:26.309482+0000","last_fullsized":"2024-04-23T19:00:26.309482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340946+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:00:26.340946+0000","last_peered":"2024-04-23T19:00:26.340946+0000","last_clean":"2024-04-23T19:00:26.340946+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:00:26.340946+0000","last_undegraded":"2024-04-23T19:00:26.340946+0000","last_fullsized":"2024-04-23T19:00:26.340946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340517+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:00:26.340517+0000","last_peered":"2024-04-23T19:00:26.340517+0000","last_clean":"2024-04-23T19:00:26.340517+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:00:26.340517+0000","last_undegraded":"2024-04-23T19:00:26.340517+0000","last_fullsized":"2024-04-23T19:00:26.340517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333161+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:00:26.333161+0000","last_peered":"2024-04-23T19:00:26.333161+0000","last_clean":"2024-04-23T19:00:26.333161+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:00:26.333161+0000","last_undegraded":"2024-04-23T19:00:26.333161+0000","last_fullsized":"2024-04-23T19:00:26.333161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.308977+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:00:26.308977+0000","last_peered":"2024-04-23T19:00:26.308977+0000","last_clean":"2024-04-23T19:00:26.308977+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:00:26.308977+0000","last_undegraded":"2024-04-23T19:00:26.308977+0000","last_fullsized":"2024-04-23T19:00:26.308977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'13","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.879328+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:00:26.879328+0000","last_peered":"2024-04-23T19:00:26.879328+0000","last_clean":"2024-04-23T19:00:26.879328+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:00:26.879328+0000","last_undegraded":"2024-04-23T19:00:26.879328+0000","last_fullsized":"2024-04-23T19:00:26.879328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321992+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:00:26.321992+0000","last_peered":"2024-04-23T19:00:26.321992+0000","last_clean":"2024-04-23T19:00:26.321992+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:00:26.321992+0000","last_undegraded":"2024-04-23T19:00:26.321992+0000","last_fullsized":"2024-04-23T19:00:26.321992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326008+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:00:26.326008+0000","last_peered":"2024-04-23T19:00:26.326008+0000","last_clean":"2024-04-23T19:00:26.326008+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:00:26.326008+0000","last_undegraded":"2024-04-23T19:00:26.326008+0000","last_fullsized":"2024-04-23T19:00:26.326008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.324725+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:00:26.324725+0000","last_peered":"2024-04-23T19:00:26.324725+0000","last_clean":"2024-04-23T19:00:26.324725+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:00:26.324725+0000","last_undegraded":"2024-04-23T19:00:26.324725+0000","last_fullsized":"2024-04-23T19:00:26.324725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312231+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:00:26.312231+0000","last_peered":"2024-04-23T19:00:26.312231+0000","last_clean":"2024-04-23T19:00:26.312231+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:00:26.312231+0000","last_undegraded":"2024-04-23T19:00:26.312231+0000","last_fullsized":"2024-04-23T19:00:26.312231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307929+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:00:26.307929+0000","last_peered":"2024-04-23T19:00:26.307929+0000","last_clean":"2024-04-23T19:00:26.307929+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:00:26.307929+0000","last_undegraded":"2024-04-23T19:00:26.307929+0000","last_fullsized":"2024-04-23T19:00:26.307929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.681700+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:00:26.681700+0000","last_peered":"2024-04-23T19:00:26.681700+0000","last_clean":"2024-04-23T19:00:26.681700+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:00:26.681700+0000","last_undegraded":"2024-04-23T19:00:26.681700+0000","last_fullsized":"2024-04-23T19:00:26.681700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307252+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:00:26.307252+0000","last_peered":"2024-04-23T19:00:26.307252+0000","last_clean":"2024-04-23T19:00:26.307252+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:00:26.307252+0000","last_undegraded":"2024-04-23T19:00:26.307252+0000","last_fullsized":"2024-04-23T19:00:26.307252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321805+0000","last_change":"2024-04-23T19:00:25.352691+0000","last_active":"2024-04-23T19:00:26.321805+0000","last_peered":"2024-04-23T19:00:26.321805+0000","last_clean":"2024-04-23T19:00:26.321805+0000","last_became_active":"2024-04-23T19:00:25.351805+0000","last_became_peered":"2024-04-23T19:00:25.351805+0000","last_unstale":"2024-04-23T19:00:26.321805+0000","last_undegraded":"2024-04-23T19:00:26.321805+0000","last_fullsized":"2024-04-23T19:00:26.321805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:41.939230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347582+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:00:26.347582+0000","last_peered":"2024-04-23T19:00:26.347582+0000","last_clean":"2024-04-23T19:00:26.347582+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:00:26.347582+0000","last_undegraded":"2024-04-23T19:00:26.347582+0000","last_fullsized":"2024-04-23T19:00:26.347582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311834+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:00:26.311834+0000","last_peered":"2024-04-23T19:00:26.311834+0000","last_clean":"2024-04-23T19:00:26.311834+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:00:26.311834+0000","last_undegraded":"2024-04-23T19:00:26.311834+0000","last_fullsized":"2024-04-23T19:00:26.311834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.308966+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:00:26.308966+0000","last_peered":"2024-04-23T19:00:26.308966+0000","last_clean":"2024-04-23T19:00:26.308966+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:00:26.308966+0000","last_undegraded":"2024-04-23T19:00:26.308966+0000","last_fullsized":"2024-04-23T19:00:26.308966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.653055+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:00:26.653055+0000","last_peered":"2024-04-23T19:00:26.653055+0000","last_clean":"2024-04-23T19:00:26.653055+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:00:26.653055+0000","last_undegraded":"2024-04-23T19:00:26.653055+0000","last_fullsized":"2024-04-23T19:00:26.653055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327214+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:00:26.327214+0000","last_peered":"2024-04-23T19:00:26.327214+0000","last_clean":"2024-04-23T19:00:26.327214+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:00:26.327214+0000","last_undegraded":"2024-04-23T19:00:26.327214+0000","last_fullsized":"2024-04-23T19:00:26.327214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309708+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:00:26.309708+0000","last_peered":"2024-04-23T19:00:26.309708+0000","last_clean":"2024-04-23T19:00:26.309708+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:00:26.309708+0000","last_undegraded":"2024-04-23T19:00:26.309708+0000","last_fullsized":"2024-04-23T19:00:26.309708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348263+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:00:26.348263+0000","last_peered":"2024-04-23T19:00:26.348263+0000","last_clean":"2024-04-23T19:00:26.348263+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:00:26.348263+0000","last_undegraded":"2024-04-23T19:00:26.348263+0000","last_fullsized":"2024-04-23T19:00:26.348263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340794+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:00:26.340794+0000","last_peered":"2024-04-23T19:00:26.340794+0000","last_clean":"2024-04-23T19:00:26.340794+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:00:26.340794+0000","last_undegraded":"2024-04-23T19:00:26.340794+0000","last_fullsized":"2024-04-23T19:00:26.340794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319324+0000","last_change":"2024-04-23T19:00:19.306483+0000","last_active":"2024-04-23T19:00:26.319324+0000","last_peered":"2024-04-23T19:00:26.319324+0000","last_clean":"2024-04-23T19:00:26.319324+0000","last_became_active":"2024-04-23T19:00:19.305544+0000","last_became_peered":"2024-04-23T19:00:19.305544+0000","last_unstale":"2024-04-23T19:00:26.319324+0000","last_undegraded":"2024-04-23T19:00:26.319324+0000","last_fullsized":"2024-04-23T19:00:26.319324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:57.250293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.826953+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:00:26.826953+0000","last_peered":"2024-04-23T19:00:26.826953+0000","last_clean":"2024-04-23T19:00:26.826953+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:00:26.826953+0000","last_undegraded":"2024-04-23T19:00:26.826953+0000","last_fullsized":"2024-04-23T19:00:26.826953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310380+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:00:26.310380+0000","last_peered":"2024-04-23T19:00:26.310380+0000","last_clean":"2024-04-23T19:00:26.310380+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:00:26.310380+0000","last_undegraded":"2024-04-23T19:00:26.310380+0000","last_fullsized":"2024-04-23T19:00:26.310380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319401+0000","last_change":"2024-04-23T19:00:25.341628+0000","last_active":"2024-04-23T19:00:26.319401+0000","last_peered":"2024-04-23T19:00:26.319401+0000","last_clean":"2024-04-23T19:00:26.319401+0000","last_became_active":"2024-04-23T19:00:25.341011+0000","last_became_peered":"2024-04-23T19:00:25.341011+0000","last_unstale":"2024-04-23T19:00:26.319401+0000","last_undegraded":"2024-04-23T19:00:26.319401+0000","last_fullsized":"2024-04-23T19:00:26.319401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:34.837079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.349501+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:00:26.349501+0000","last_peered":"2024-04-23T19:00:26.349501+0000","last_clean":"2024-04-23T19:00:26.349501+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:00:26.349501+0000","last_undegraded":"2024-04-23T19:00:26.349501+0000","last_fullsized":"2024-04-23T19:00:26.349501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346879+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:00:26.346879+0000","last_peered":"2024-04-23T19:00:26.346879+0000","last_clean":"2024-04-23T19:00:26.346879+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:00:26.346879+0000","last_undegraded":"2024-04-23T19:00:26.346879+0000","last_fullsized":"2024-04-23T19:00:26.346879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310499+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:00:26.310499+0000","last_peered":"2024-04-23T19:00:26.310499+0000","last_clean":"2024-04-23T19:00:26.310499+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:00:26.310499+0000","last_undegraded":"2024-04-23T19:00:26.310499+0000","last_fullsized":"2024-04-23T19:00:26.310499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.618961+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:00:26.618961+0000","last_peered":"2024-04-23T19:00:26.618961+0000","last_clean":"2024-04-23T19:00:26.618961+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:00:26.618961+0000","last_undegraded":"2024-04-23T19:00:26.618961+0000","last_fullsized":"2024-04-23T19:00:26.618961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340992+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:00:26.340992+0000","last_peered":"2024-04-23T19:00:26.340992+0000","last_clean":"2024-04-23T19:00:26.340992+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:00:26.340992+0000","last_undegraded":"2024-04-23T19:00:26.340992+0000","last_fullsized":"2024-04-23T19:00:26.340992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348863+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:00:26.348863+0000","last_peered":"2024-04-23T19:00:26.348863+0000","last_clean":"2024-04-23T19:00:26.348863+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:00:26.348863+0000","last_undegraded":"2024-04-23T19:00:26.348863+0000","last_fullsized":"2024-04-23T19:00:26.348863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322284+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:00:26.322284+0000","last_peered":"2024-04-23T19:00:26.322284+0000","last_clean":"2024-04-23T19:00:26.322284+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:00:26.322284+0000","last_undegraded":"2024-04-23T19:00:26.322284+0000","last_fullsized":"2024-04-23T19:00:26.322284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311055+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:00:26.311055+0000","last_peered":"2024-04-23T19:00:26.311055+0000","last_clean":"2024-04-23T19:00:26.311055+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:00:26.311055+0000","last_undegraded":"2024-04-23T19:00:26.311055+0000","last_fullsized":"2024-04-23T19:00:26.311055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.349276+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:00:26.349276+0000","last_peered":"2024-04-23T19:00:26.349276+0000","last_clean":"2024-04-23T19:00:26.349276+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:00:26.349276+0000","last_undegraded":"2024-04-23T19:00:26.349276+0000","last_fullsized":"2024-04-23T19:00:26.349276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'13","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.899172+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:00:26.899172+0000","last_peered":"2024-04-23T19:00:26.899172+0000","last_clean":"2024-04-23T19:00:26.899172+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:00:26.899172+0000","last_undegraded":"2024-04-23T19:00:26.899172+0000","last_fullsized":"2024-04-23T19:00:26.899172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339967+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:00:26.339967+0000","last_peered":"2024-04-23T19:00:26.339967+0000","last_clean":"2024-04-23T19:00:26.339967+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:00:26.339967+0000","last_undegraded":"2024-04-23T19:00:26.339967+0000","last_fullsized":"2024-04-23T19:00:26.339967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319164+0000","last_change":"2024-04-23T19:00:25.337128+0000","last_active":"2024-04-23T19:00:26.319164+0000","last_peered":"2024-04-23T19:00:26.319164+0000","last_clean":"2024-04-23T19:00:26.319164+0000","last_became_active":"2024-04-23T19:00:25.336132+0000","last_became_peered":"2024-04-23T19:00:25.336132+0000","last_unstale":"2024-04-23T19:00:26.319164+0000","last_undegraded":"2024-04-23T19:00:26.319164+0000","last_fullsized":"2024-04-23T19:00:26.319164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:40.547819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341287+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:00:26.341287+0000","last_peered":"2024-04-23T19:00:26.341287+0000","last_clean":"2024-04-23T19:00:26.341287+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:00:26.341287+0000","last_undegraded":"2024-04-23T19:00:26.341287+0000","last_fullsized":"2024-04-23T19:00:26.341287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330921+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:00:26.330921+0000","last_peered":"2024-04-23T19:00:26.330921+0000","last_clean":"2024-04-23T19:00:26.330921+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:00:26.330921+0000","last_undegraded":"2024-04-23T19:00:26.330921+0000","last_fullsized":"2024-04-23T19:00:26.330921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310569+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:00:26.310569+0000","last_peered":"2024-04-23T19:00:26.310569+0000","last_clean":"2024-04-23T19:00:26.310569+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:00:26.310569+0000","last_undegraded":"2024-04-23T19:00:26.310569+0000","last_fullsized":"2024-04-23T19:00:26.310569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311949+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:00:26.311949+0000","last_peered":"2024-04-23T19:00:26.311949+0000","last_clean":"2024-04-23T19:00:26.311949+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:00:26.311949+0000","last_undegraded":"2024-04-23T19:00:26.311949+0000","last_fullsized":"2024-04-23T19:00:26.311949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331929+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:00:26.331929+0000","last_peered":"2024-04-23T19:00:26.331929+0000","last_clean":"2024-04-23T19:00:26.331929+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:00:26.331929+0000","last_undegraded":"2024-04-23T19:00:26.331929+0000","last_fullsized":"2024-04-23T19:00:26.331929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.651759+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:00:26.651759+0000","last_peered":"2024-04-23T19:00:26.651759+0000","last_clean":"2024-04-23T19:00:26.651759+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:00:26.651759+0000","last_undegraded":"2024-04-23T19:00:26.651759+0000","last_fullsized":"2024-04-23T19:00:26.651759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326032+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:00:26.326032+0000","last_peered":"2024-04-23T19:00:26.326032+0000","last_clean":"2024-04-23T19:00:26.326032+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:00:26.326032+0000","last_undegraded":"2024-04-23T19:00:26.326032+0000","last_fullsized":"2024-04-23T19:00:26.326032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339574+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:00:26.339574+0000","last_peered":"2024-04-23T19:00:26.339574+0000","last_clean":"2024-04-23T19:00:26.339574+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:00:26.339574+0000","last_undegraded":"2024-04-23T19:00:26.339574+0000","last_fullsized":"2024-04-23T19:00:26.339574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326377+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:00:26.326377+0000","last_peered":"2024-04-23T19:00:26.326377+0000","last_clean":"2024-04-23T19:00:26.326377+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:00:26.326377+0000","last_undegraded":"2024-04-23T19:00:26.326377+0000","last_fullsized":"2024-04-23T19:00:26.326377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330679+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:00:26.330679+0000","last_peered":"2024-04-23T19:00:26.330679+0000","last_clean":"2024-04-23T19:00:26.330679+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:00:26.330679+0000","last_undegraded":"2024-04-23T19:00:26.330679+0000","last_fullsized":"2024-04-23T19:00:26.330679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322361+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:00:26.322361+0000","last_peered":"2024-04-23T19:00:26.322361+0000","last_clean":"2024-04-23T19:00:26.322361+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:00:26.322361+0000","last_undegraded":"2024-04-23T19:00:26.322361+0000","last_fullsized":"2024-04-23T19:00:26.322361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311580+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:00:26.311580+0000","last_peered":"2024-04-23T19:00:26.311580+0000","last_clean":"2024-04-23T19:00:26.311580+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:00:26.311580+0000","last_undegraded":"2024-04-23T19:00:26.311580+0000","last_fullsized":"2024-04-23T19:00:26.311580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'19","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.806801+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:00:26.806801+0000","last_peered":"2024-04-23T19:00:26.806801+0000","last_clean":"2024-04-23T19:00:26.806801+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:00:26.806801+0000","last_undegraded":"2024-04-23T19:00:26.806801+0000","last_fullsized":"2024-04-23T19:00:26.806801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":23,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332472+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:00:26.332472+0000","last_peered":"2024-04-23T19:00:26.332472+0000","last_clean":"2024-04-23T19:00:26.332472+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:00:26.332472+0000","last_undegraded":"2024-04-23T19:00:26.332472+0000","last_fullsized":"2024-04-23T19:00:26.332472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.318924+0000","last_change":"2024-04-23T19:00:25.337116+0000","last_active":"2024-04-23T19:00:26.318924+0000","last_peered":"2024-04-23T19:00:26.318924+0000","last_clean":"2024-04-23T19:00:26.318924+0000","last_became_active":"2024-04-23T19:00:25.336196+0000","last_became_peered":"2024-04-23T19:00:25.336196+0000","last_unstale":"2024-04-23T19:00:26.318924+0000","last_undegraded":"2024-04-23T19:00:26.318924+0000","last_fullsized":"2024-04-23T19:00:26.318924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:14.525312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322503+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:00:26.322503+0000","last_peered":"2024-04-23T19:00:26.322503+0000","last_clean":"2024-04-23T19:00:26.322503+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:00:26.322503+0000","last_undegraded":"2024-04-23T19:00:26.322503+0000","last_fullsized":"2024-04-23T19:00:26.322503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307730+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:00:26.307730+0000","last_peered":"2024-04-23T19:00:26.307730+0000","last_clean":"2024-04-23T19:00:26.307730+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:00:26.307730+0000","last_undegraded":"2024-04-23T19:00:26.307730+0000","last_fullsized":"2024-04-23T19:00:26.307730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319614+0000","last_change":"2024-04-23T19:00:15.254230+0000","last_active":"2024-04-23T19:00:26.319614+0000","last_peered":"2024-04-23T19:00:26.319614+0000","last_clean":"2024-04-23T19:00:26.319614+0000","last_became_active":"2024-04-23T19:00:15.253857+0000","last_became_peered":"2024-04-23T19:00:15.253857+0000","last_unstale":"2024-04-23T19:00:26.319614+0000","last_undegraded":"2024-04-23T19:00:26.319614+0000","last_fullsized":"2024-04-23T19:00:26.319614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310512+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:00:26.310512+0000","last_peered":"2024-04-23T19:00:26.310512+0000","last_clean":"2024-04-23T19:00:26.310512+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:00:26.310512+0000","last_undegraded":"2024-04-23T19:00:26.310512+0000","last_fullsized":"2024-04-23T19:00:26.310512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.778400+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:00:26.778400+0000","last_peered":"2024-04-23T19:00:26.778400+0000","last_clean":"2024-04-23T19:00:26.778400+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:00:26.778400+0000","last_undegraded":"2024-04-23T19:00:26.778400+0000","last_fullsized":"2024-04-23T19:00:26.778400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":9,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.324924+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:00:26.324924+0000","last_peered":"2024-04-23T19:00:26.324924+0000","last_clean":"2024-04-23T19:00:26.324924+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:00:26.324924+0000","last_undegraded":"2024-04-23T19:00:26.324924+0000","last_fullsized":"2024-04-23T19:00:26.324924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313504+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:00:26.313504+0000","last_peered":"2024-04-23T19:00:26.313504+0000","last_clean":"2024-04-23T19:00:26.313504+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:00:26.313504+0000","last_undegraded":"2024-04-23T19:00:26.313504+0000","last_fullsized":"2024-04-23T19:00:26.313504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319853+0000","last_change":"2024-04-23T19:00:17.298132+0000","last_active":"2024-04-23T19:00:26.319853+0000","last_peered":"2024-04-23T19:00:26.319853+0000","last_clean":"2024-04-23T19:00:26.319853+0000","last_became_active":"2024-04-23T19:00:17.297866+0000","last_became_peered":"2024-04-23T19:00:17.297866+0000","last_unstale":"2024-04-23T19:00:26.319853+0000","last_undegraded":"2024-04-23T19:00:26.319853+0000","last_fullsized":"2024-04-23T19:00:26.319853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310869+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:00:26.310869+0000","last_peered":"2024-04-23T19:00:26.310869+0000","last_clean":"2024-04-23T19:00:26.310869+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:00:26.310869+0000","last_undegraded":"2024-04-23T19:00:26.310869+0000","last_fullsized":"2024-04-23T19:00:26.310869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348238+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:00:26.348238+0000","last_peered":"2024-04-23T19:00:26.348238+0000","last_clean":"2024-04-23T19:00:26.348238+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:00:26.348238+0000","last_undegraded":"2024-04-23T19:00:26.348238+0000","last_fullsized":"2024-04-23T19:00:26.348238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325238+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:00:26.325238+0000","last_peered":"2024-04-23T19:00:26.325238+0000","last_clean":"2024-04-23T19:00:26.325238+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:00:26.325238+0000","last_undegraded":"2024-04-23T19:00:26.325238+0000","last_fullsized":"2024-04-23T19:00:26.325238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.855355+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:00:26.855355+0000","last_peered":"2024-04-23T19:00:26.855355+0000","last_clean":"2024-04-23T19:00:26.855355+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:00:26.855355+0000","last_undegraded":"2024-04-23T19:00:26.855355+0000","last_fullsized":"2024-04-23T19:00:26.855355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341383+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:00:26.341383+0000","last_peered":"2024-04-23T19:00:26.341383+0000","last_clean":"2024-04-23T19:00:26.341383+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:00:26.341383+0000","last_undegraded":"2024-04-23T19:00:26.341383+0000","last_fullsized":"2024-04-23T19:00:26.341383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309179+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:00:26.309179+0000","last_peered":"2024-04-23T19:00:26.309179+0000","last_clean":"2024-04-23T19:00:26.309179+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:00:26.309179+0000","last_undegraded":"2024-04-23T19:00:26.309179+0000","last_fullsized":"2024-04-23T19:00:26.309179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321073+0000","last_change":"2024-04-23T19:00:17.323700+0000","last_active":"2024-04-23T19:00:26.321073+0000","last_peered":"2024-04-23T19:00:26.321073+0000","last_clean":"2024-04-23T19:00:26.321073+0000","last_became_active":"2024-04-23T19:00:17.323443+0000","last_became_peered":"2024-04-23T19:00:17.323443+0000","last_unstale":"2024-04-23T19:00:26.321073+0000","last_undegraded":"2024-04-23T19:00:26.321073+0000","last_fullsized":"2024-04-23T19:00:26.321073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311967+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:00:26.311967+0000","last_peered":"2024-04-23T19:00:26.311967+0000","last_clean":"2024-04-23T19:00:26.311967+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:00:26.311967+0000","last_undegraded":"2024-04-23T19:00:26.311967+0000","last_fullsized":"2024-04-23T19:00:26.311967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320381+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:00:26.320381+0000","last_peered":"2024-04-23T19:00:26.320381+0000","last_clean":"2024-04-23T19:00:26.320381+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:00:26.320381+0000","last_undegraded":"2024-04-23T19:00:26.320381+0000","last_fullsized":"2024-04-23T19:00:26.320381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323660+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:00:26.323660+0000","last_peered":"2024-04-23T19:00:26.323660+0000","last_clean":"2024-04-23T19:00:26.323660+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:00:26.323660+0000","last_undegraded":"2024-04-23T19:00:26.323660+0000","last_fullsized":"2024-04-23T19:00:26.323660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.887476+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:00:26.887476+0000","last_peered":"2024-04-23T19:00:26.887476+0000","last_clean":"2024-04-23T19:00:26.887476+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:00:26.887476+0000","last_undegraded":"2024-04-23T19:00:26.887476+0000","last_fullsized":"2024-04-23T19:00:26.887476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":16,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346094+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:00:26.346094+0000","last_peered":"2024-04-23T19:00:26.346094+0000","last_clean":"2024-04-23T19:00:26.346094+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:00:26.346094+0000","last_undegraded":"2024-04-23T19:00:26.346094+0000","last_fullsized":"2024-04-23T19:00:26.346094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325640+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:00:26.325640+0000","last_peered":"2024-04-23T19:00:26.325640+0000","last_clean":"2024-04-23T19:00:26.325640+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:00:26.325640+0000","last_undegraded":"2024-04-23T19:00:26.325640+0000","last_fullsized":"2024-04-23T19:00:26.325640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.324600+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:00:26.324600+0000","last_peered":"2024-04-23T19:00:26.324600+0000","last_clean":"2024-04-23T19:00:26.324600+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:00:26.324600+0000","last_undegraded":"2024-04-23T19:00:26.324600+0000","last_fullsized":"2024-04-23T19:00:26.324600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320139+0000","last_change":"2024-04-23T19:00:15.252825+0000","last_active":"2024-04-23T19:00:26.320139+0000","last_peered":"2024-04-23T19:00:26.320139+0000","last_clean":"2024-04-23T19:00:26.320139+0000","last_became_active":"2024-04-23T19:00:15.247413+0000","last_became_peered":"2024-04-23T19:00:15.247413+0000","last_unstale":"2024-04-23T19:00:26.320139+0000","last_undegraded":"2024-04-23T19:00:26.320139+0000","last_fullsized":"2024-04-23T19:00:26.320139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333431+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:00:26.333431+0000","last_peered":"2024-04-23T19:00:26.333431+0000","last_clean":"2024-04-23T19:00:26.333431+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:00:26.333431+0000","last_undegraded":"2024-04-23T19:00:26.333431+0000","last_fullsized":"2024-04-23T19:00:26.333431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340026+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:00:26.340026+0000","last_peered":"2024-04-23T19:00:26.340026+0000","last_clean":"2024-04-23T19:00:26.340026+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:00:26.340026+0000","last_undegraded":"2024-04-23T19:00:26.340026+0000","last_fullsized":"2024-04-23T19:00:26.340026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.908673+0000","last_change":"2024-04-23T19:00:21.313162+0000","last_active":"2024-04-23T19:00:26.908673+0000","last_peered":"2024-04-23T19:00:26.908673+0000","last_clean":"2024-04-23T19:00:26.908673+0000","last_became_active":"2024-04-23T19:00:21.312313+0000","last_became_peered":"2024-04-23T19:00:21.312313+0000","last_unstale":"2024-04-23T19:00:26.908673+0000","last_undegraded":"2024-04-23T19:00:26.908673+0000","last_fullsized":"2024-04-23T19:00:26.908673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:05.309099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311767+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:00:26.311767+0000","last_peered":"2024-04-23T19:00:26.311767+0000","last_clean":"2024-04-23T19:00:26.311767+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:00:26.311767+0000","last_undegraded":"2024-04-23T19:00:26.311767+0000","last_fullsized":"2024-04-23T19:00:26.311767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314138+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:00:26.314138+0000","last_peered":"2024-04-23T19:00:26.314138+0000","last_clean":"2024-04-23T19:00:26.314138+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:00:26.314138+0000","last_undegraded":"2024-04-23T19:00:26.314138+0000","last_fullsized":"2024-04-23T19:00:26.314138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310529+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:00:26.310529+0000","last_peered":"2024-04-23T19:00:26.310529+0000","last_clean":"2024-04-23T19:00:26.310529+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:00:26.310529+0000","last_undegraded":"2024-04-23T19:00:26.310529+0000","last_fullsized":"2024-04-23T19:00:26.310529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313120+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:00:26.313120+0000","last_peered":"2024-04-23T19:00:26.313120+0000","last_clean":"2024-04-23T19:00:26.313120+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:00:26.313120+0000","last_undegraded":"2024-04-23T19:00:26.313120+0000","last_fullsized":"2024-04-23T19:00:26.313120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321385+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:00:26.321385+0000","last_peered":"2024-04-23T19:00:26.321385+0000","last_clean":"2024-04-23T19:00:26.321385+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:00:26.321385+0000","last_undegraded":"2024-04-23T19:00:26.321385+0000","last_fullsized":"2024-04-23T19:00:26.321385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346223+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:00:26.346223+0000","last_peered":"2024-04-23T19:00:26.346223+0000","last_clean":"2024-04-23T19:00:26.346223+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:00:26.346223+0000","last_undegraded":"2024-04-23T19:00:26.346223+0000","last_fullsized":"2024-04-23T19:00:26.346223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.574119+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:00:26.574119+0000","last_peered":"2024-04-23T19:00:26.574119+0000","last_clean":"2024-04-23T19:00:26.574119+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:00:26.574119+0000","last_undegraded":"2024-04-23T19:00:26.574119+0000","last_fullsized":"2024-04-23T19:00:26.574119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314164+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:00:26.314164+0000","last_peered":"2024-04-23T19:00:26.314164+0000","last_clean":"2024-04-23T19:00:26.314164+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:00:26.314164+0000","last_undegraded":"2024-04-23T19:00:26.314164+0000","last_fullsized":"2024-04-23T19:00:26.314164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325240+0000","last_change":"2024-04-23T19:00:25.339039+0000","last_active":"2024-04-23T19:00:26.325240+0000","last_peered":"2024-04-23T19:00:26.325240+0000","last_clean":"2024-04-23T19:00:26.325240+0000","last_became_active":"2024-04-23T19:00:25.337875+0000","last_became_peered":"2024-04-23T19:00:25.337875+0000","last_unstale":"2024-04-23T19:00:26.325240+0000","last_undegraded":"2024-04-23T19:00:26.325240+0000","last_fullsized":"2024-04-23T19:00:26.325240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346478+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:00:26.346478+0000","last_peered":"2024-04-23T19:00:26.346478+0000","last_clean":"2024-04-23T19:00:26.346478+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:00:26.346478+0000","last_undegraded":"2024-04-23T19:00:26.346478+0000","last_fullsized":"2024-04-23T19:00:26.346478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326624+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:00:26.326624+0000","last_peered":"2024-04-23T19:00:26.326624+0000","last_clean":"2024-04-23T19:00:26.326624+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:00:26.326624+0000","last_undegraded":"2024-04-23T19:00:26.326624+0000","last_fullsized":"2024-04-23T19:00:26.326624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341699+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:00:26.341699+0000","last_peered":"2024-04-23T19:00:26.341699+0000","last_clean":"2024-04-23T19:00:26.341699+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:00:26.341699+0000","last_undegraded":"2024-04-23T19:00:26.341699+0000","last_fullsized":"2024-04-23T19:00:26.341699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310285+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:00:26.310285+0000","last_peered":"2024-04-23T19:00:26.310285+0000","last_clean":"2024-04-23T19:00:26.310285+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:00:26.310285+0000","last_undegraded":"2024-04-23T19:00:26.310285+0000","last_fullsized":"2024-04-23T19:00:26.310285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'15","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.818494+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:00:26.818494+0000","last_peered":"2024-04-23T19:00:26.818494+0000","last_clean":"2024-04-23T19:00:26.818494+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:00:26.818494+0000","last_undegraded":"2024-04-23T19:00:26.818494+0000","last_fullsized":"2024-04-23T19:00:26.818494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311640+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:00:26.311640+0000","last_peered":"2024-04-23T19:00:26.311640+0000","last_clean":"2024-04-23T19:00:26.311640+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:00:26.311640+0000","last_undegraded":"2024-04-23T19:00:26.311640+0000","last_fullsized":"2024-04-23T19:00:26.311640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312148+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:00:26.312148+0000","last_peered":"2024-04-23T19:00:26.312148+0000","last_clean":"2024-04-23T19:00:26.312148+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:00:26.312148+0000","last_undegraded":"2024-04-23T19:00:26.312148+0000","last_fullsized":"2024-04-23T19:00:26.312148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327223+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:00:26.327223+0000","last_peered":"2024-04-23T19:00:26.327223+0000","last_clean":"2024-04-23T19:00:26.327223+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:00:26.327223+0000","last_undegraded":"2024-04-23T19:00:26.327223+0000","last_fullsized":"2024-04-23T19:00:26.327223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347442+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:00:26.347442+0000","last_peered":"2024-04-23T19:00:26.347442+0000","last_clean":"2024-04-23T19:00:26.347442+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:00:26.347442+0000","last_undegraded":"2024-04-23T19:00:26.347442+0000","last_fullsized":"2024-04-23T19:00:26.347442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347076+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:00:26.347076+0000","last_peered":"2024-04-23T19:00:26.347076+0000","last_clean":"2024-04-23T19:00:26.347076+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:00:26.347076+0000","last_undegraded":"2024-04-23T19:00:26.347076+0000","last_fullsized":"2024-04-23T19:00:26.347076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320599+0000","last_change":"2024-04-23T19:00:19.302914+0000","last_active":"2024-04-23T19:00:26.320599+0000","last_peered":"2024-04-23T19:00:26.320599+0000","last_clean":"2024-04-23T19:00:26.320599+0000","last_became_active":"2024-04-23T19:00:19.302271+0000","last_became_peered":"2024-04-23T19:00:19.302271+0000","last_unstale":"2024-04-23T19:00:26.320599+0000","last_undegraded":"2024-04-23T19:00:26.320599+0000","last_fullsized":"2024-04-23T19:00:26.320599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:39.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.665010+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:00:26.665010+0000","last_peered":"2024-04-23T19:00:26.665010+0000","last_clean":"2024-04-23T19:00:26.665010+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:00:26.665010+0000","last_undegraded":"2024-04-23T19:00:26.665010+0000","last_fullsized":"2024-04-23T19:00:26.665010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310153+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:00:26.310153+0000","last_peered":"2024-04-23T19:00:26.310153+0000","last_clean":"2024-04-23T19:00:26.310153+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:00:26.310153+0000","last_undegraded":"2024-04-23T19:00:26.310153+0000","last_fullsized":"2024-04-23T19:00:26.310153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312904+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:00:26.312904+0000","last_peered":"2024-04-23T19:00:26.312904+0000","last_clean":"2024-04-23T19:00:26.312904+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:00:26.312904+0000","last_undegraded":"2024-04-23T19:00:26.312904+0000","last_fullsized":"2024-04-23T19:00:26.312904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319368+0000","last_change":"2024-04-23T19:00:17.321501+0000","last_active":"2024-04-23T19:00:26.319368+0000","last_peered":"2024-04-23T19:00:26.319368+0000","last_clean":"2024-04-23T19:00:26.319368+0000","last_became_active":"2024-04-23T19:00:17.321203+0000","last_became_peered":"2024-04-23T19:00:17.321203+0000","last_unstale":"2024-04-23T19:00:26.319368+0000","last_undegraded":"2024-04-23T19:00:26.319368+0000","last_fullsized":"2024-04-23T19:00:26.319368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333084+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:00:26.333084+0000","last_peered":"2024-04-23T19:00:26.333084+0000","last_clean":"2024-04-23T19:00:26.333084+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:00:26.333084+0000","last_undegraded":"2024-04-23T19:00:26.333084+0000","last_fullsized":"2024-04-23T19:00:26.333084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312535+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:00:26.312535+0000","last_peered":"2024-04-23T19:00:26.312535+0000","last_clean":"2024-04-23T19:00:26.312535+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:00:26.312535+0000","last_undegraded":"2024-04-23T19:00:26.312535+0000","last_fullsized":"2024-04-23T19:00:26.312535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.687487+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:00:26.687487+0000","last_peered":"2024-04-23T19:00:26.687487+0000","last_clean":"2024-04-23T19:00:26.687487+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:00:26.687487+0000","last_undegraded":"2024-04-23T19:00:26.687487+0000","last_fullsized":"2024-04-23T19:00:26.687487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331021+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:00:26.331021+0000","last_peered":"2024-04-23T19:00:26.331021+0000","last_clean":"2024-04-23T19:00:26.331021+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:00:26.331021+0000","last_undegraded":"2024-04-23T19:00:26.331021+0000","last_fullsized":"2024-04-23T19:00:26.331021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322734+0000","last_change":"2024-04-23T19:00:25.342813+0000","last_active":"2024-04-23T19:00:26.322734+0000","last_peered":"2024-04-23T19:00:26.322734+0000","last_clean":"2024-04-23T19:00:26.322734+0000","last_became_active":"2024-04-23T19:00:25.342143+0000","last_became_peered":"2024-04-23T19:00:25.342143+0000","last_unstale":"2024-04-23T19:00:26.322734+0000","last_undegraded":"2024-04-23T19:00:26.322734+0000","last_fullsized":"2024-04-23T19:00:26.322734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310609+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:00:26.310609+0000","last_peered":"2024-04-23T19:00:26.310609+0000","last_clean":"2024-04-23T19:00:26.310609+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:00:26.310609+0000","last_undegraded":"2024-04-23T19:00:26.310609+0000","last_fullsized":"2024-04-23T19:00:26.310609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311877+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:00:26.311877+0000","last_peered":"2024-04-23T19:00:26.311877+0000","last_clean":"2024-04-23T19:00:26.311877+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:00:26.311877+0000","last_undegraded":"2024-04-23T19:00:26.311877+0000","last_fullsized":"2024-04-23T19:00:26.311877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330117+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:00:26.330117+0000","last_peered":"2024-04-23T19:00:26.330117+0000","last_clean":"2024-04-23T19:00:26.330117+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:00:26.330117+0000","last_undegraded":"2024-04-23T19:00:26.330117+0000","last_fullsized":"2024-04-23T19:00:26.330117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.760933+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:00:26.760933+0000","last_peered":"2024-04-23T19:00:26.760933+0000","last_clean":"2024-04-23T19:00:26.760933+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:00:26.760933+0000","last_undegraded":"2024-04-23T19:00:26.760933+0000","last_fullsized":"2024-04-23T19:00:26.760933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340142+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:00:26.340142+0000","last_peered":"2024-04-23T19:00:26.340142+0000","last_clean":"2024-04-23T19:00:26.340142+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:00:26.340142+0000","last_undegraded":"2024-04-23T19:00:26.340142+0000","last_fullsized":"2024-04-23T19:00:26.340142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311043+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:00:26.311043+0000","last_peered":"2024-04-23T19:00:26.311043+0000","last_clean":"2024-04-23T19:00:26.311043+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:00:26.311043+0000","last_undegraded":"2024-04-23T19:00:26.311043+0000","last_fullsized":"2024-04-23T19:00:26.311043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310786+0000","last_change":"2024-04-23T19:00:17.291645+0000","last_active":"2024-04-23T19:00:26.310786+0000","last_peered":"2024-04-23T19:00:26.310786+0000","last_clean":"2024-04-23T19:00:26.310786+0000","last_became_active":"2024-04-23T19:00:17.291365+0000","last_became_peered":"2024-04-23T19:00:17.291365+0000","last_unstale":"2024-04-23T19:00:26.310786+0000","last_undegraded":"2024-04-23T19:00:26.310786+0000","last_fullsized":"2024-04-23T19:00:26.310786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327647+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:00:26.327647+0000","last_peered":"2024-04-23T19:00:26.327647+0000","last_clean":"2024-04-23T19:00:26.327647+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:00:26.327647+0000","last_undegraded":"2024-04-23T19:00:26.327647+0000","last_fullsized":"2024-04-23T19:00:26.327647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339964+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:00:26.339964+0000","last_peered":"2024-04-23T19:00:26.339964+0000","last_clean":"2024-04-23T19:00:26.339964+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:00:26.339964+0000","last_undegraded":"2024-04-23T19:00:26.339964+0000","last_fullsized":"2024-04-23T19:00:26.339964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.891657+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:00:26.891657+0000","last_peered":"2024-04-23T19:00:26.891657+0000","last_clean":"2024-04-23T19:00:26.891657+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:00:26.891657+0000","last_undegraded":"2024-04-23T19:00:26.891657+0000","last_fullsized":"2024-04-23T19:00:26.891657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322819+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:00:26.322819+0000","last_peered":"2024-04-23T19:00:26.322819+0000","last_clean":"2024-04-23T19:00:26.322819+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:00:26.322819+0000","last_undegraded":"2024-04-23T19:00:26.322819+0000","last_fullsized":"2024-04-23T19:00:26.322819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341563+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:00:26.341563+0000","last_peered":"2024-04-23T19:00:26.341563+0000","last_clean":"2024-04-23T19:00:26.341563+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:00:26.341563+0000","last_undegraded":"2024-04-23T19:00:26.341563+0000","last_fullsized":"2024-04-23T19:00:26.341563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311028+0000","last_change":"2024-04-23T19:00:15.256663+0000","last_active":"2024-04-23T19:00:26.311028+0000","last_peered":"2024-04-23T19:00:26.311028+0000","last_clean":"2024-04-23T19:00:26.311028+0000","last_became_active":"2024-04-23T19:00:15.256378+0000","last_became_peered":"2024-04-23T19:00:15.256378+0000","last_unstale":"2024-04-23T19:00:26.311028+0000","last_undegraded":"2024-04-23T19:00:26.311028+0000","last_fullsized":"2024-04-23T19:00:26.311028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326150+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:00:26.326150+0000","last_peered":"2024-04-23T19:00:26.326150+0000","last_clean":"2024-04-23T19:00:26.326150+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:00:26.326150+0000","last_undegraded":"2024-04-23T19:00:26.326150+0000","last_fullsized":"2024-04-23T19:00:26.326150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.599831+0000","last_change":"2024-04-23T19:00:21.317917+0000","last_active":"2024-04-23T19:00:26.599831+0000","last_peered":"2024-04-23T19:00:26.599831+0000","last_clean":"2024-04-23T19:00:26.599831+0000","last_became_active":"2024-04-23T19:00:21.317050+0000","last_became_peered":"2024-04-23T19:00:21.317050+0000","last_unstale":"2024-04-23T19:00:26.599831+0000","last_undegraded":"2024-04-23T19:00:26.599831+0000","last_fullsized":"2024-04-23T19:00:26.599831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:14.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311283+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:00:26.311283+0000","last_peered":"2024-04-23T19:00:26.311283+0000","last_clean":"2024-04-23T19:00:26.311283+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:00:26.311283+0000","last_undegraded":"2024-04-23T19:00:26.311283+0000","last_fullsized":"2024-04-23T19:00:26.311283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312089+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:00:26.312089+0000","last_peered":"2024-04-23T19:00:26.312089+0000","last_clean":"2024-04-23T19:00:26.312089+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:00:26.312089+0000","last_undegraded":"2024-04-23T19:00:26.312089+0000","last_fullsized":"2024-04-23T19:00:26.312089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326290+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:00:26.326290+0000","last_peered":"2024-04-23T19:00:26.326290+0000","last_clean":"2024-04-23T19:00:26.326290+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:00:26.326290+0000","last_undegraded":"2024-04-23T19:00:26.326290+0000","last_fullsized":"2024-04-23T19:00:26.326290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319712+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:00:26.319712+0000","last_peered":"2024-04-23T19:00:26.319712+0000","last_clean":"2024-04-23T19:00:26.319712+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:00:26.319712+0000","last_undegraded":"2024-04-23T19:00:26.319712+0000","last_fullsized":"2024-04-23T19:00:26.319712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341429+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:00:26.341429+0000","last_peered":"2024-04-23T19:00:26.341429+0000","last_clean":"2024-04-23T19:00:26.341429+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:00:26.341429+0000","last_undegraded":"2024-04-23T19:00:26.341429+0000","last_fullsized":"2024-04-23T19:00:26.341429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.692507+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:00:26.692507+0000","last_peered":"2024-04-23T19:00:26.692507+0000","last_clean":"2024-04-23T19:00:26.692507+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:00:26.692507+0000","last_undegraded":"2024-04-23T19:00:26.692507+0000","last_fullsized":"2024-04-23T19:00:26.692507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319960+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:00:26.319960+0000","last_peered":"2024-04-23T19:00:26.319960+0000","last_clean":"2024-04-23T19:00:26.319960+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:00:26.319960+0000","last_undegraded":"2024-04-23T19:00:26.319960+0000","last_fullsized":"2024-04-23T19:00:26.319960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339845+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:00:26.339845+0000","last_peered":"2024-04-23T19:00:26.339845+0000","last_clean":"2024-04-23T19:00:26.339845+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:00:26.339845+0000","last_undegraded":"2024-04-23T19:00:26.339845+0000","last_fullsized":"2024-04-23T19:00:26.339845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312943+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:00:26.312943+0000","last_peered":"2024-04-23T19:00:26.312943+0000","last_clean":"2024-04-23T19:00:26.312943+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:00:26.312943+0000","last_undegraded":"2024-04-23T19:00:26.312943+0000","last_fullsized":"2024-04-23T19:00:26.312943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348388+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:00:26.348388+0000","last_peered":"2024-04-23T19:00:26.348388+0000","last_clean":"2024-04-23T19:00:26.348388+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:00:26.348388+0000","last_undegraded":"2024-04-23T19:00:26.348388+0000","last_fullsized":"2024-04-23T19:00:26.348388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348073+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:00:26.348073+0000","last_peered":"2024-04-23T19:00:26.348073+0000","last_clean":"2024-04-23T19:00:26.348073+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:00:26.348073+0000","last_undegraded":"2024-04-23T19:00:26.348073+0000","last_fullsized":"2024-04-23T19:00:26.348073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.700075+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:00:26.700075+0000","last_peered":"2024-04-23T19:00:26.700075+0000","last_clean":"2024-04-23T19:00:26.700075+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:00:26.700075+0000","last_undegraded":"2024-04-23T19:00:26.700075+0000","last_fullsized":"2024-04-23T19:00:26.700075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320791+0000","last_change":"2024-04-23T19:00:23.344133+0000","last_active":"2024-04-23T19:00:26.320791+0000","last_peered":"2024-04-23T19:00:26.320791+0000","last_clean":"2024-04-23T19:00:26.320791+0000","last_became_active":"2024-04-23T19:00:23.343020+0000","last_became_peered":"2024-04-23T19:00:23.343020+0000","last_unstale":"2024-04-23T19:00:26.320791+0000","last_undegraded":"2024-04-23T19:00:26.320791+0000","last_fullsized":"2024-04-23T19:00:26.320791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:16.330420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311051+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:00:26.311051+0000","last_peered":"2024-04-23T19:00:26.311051+0000","last_clean":"2024-04-23T19:00:26.311051+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:00:26.311051+0000","last_undegraded":"2024-04-23T19:00:26.311051+0000","last_fullsized":"2024-04-23T19:00:26.311051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309161+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:00:26.309161+0000","last_peered":"2024-04-23T19:00:26.309161+0000","last_clean":"2024-04-23T19:00:26.309161+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:00:26.309161+0000","last_undegraded":"2024-04-23T19:00:26.309161+0000","last_fullsized":"2024-04-23T19:00:26.309161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322943+0000","last_change":"2024-04-23T19:00:15.277198+0000","last_active":"2024-04-23T19:00:26.322943+0000","last_peered":"2024-04-23T19:00:26.322943+0000","last_clean":"2024-04-23T19:00:26.322943+0000","last_became_active":"2024-04-23T19:00:15.276676+0000","last_became_peered":"2024-04-23T19:00:15.276676+0000","last_unstale":"2024-04-23T19:00:26.322943+0000","last_undegraded":"2024-04-23T19:00:26.322943+0000","last_fullsized":"2024-04-23T19:00:26.322943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320346+0000","last_change":"2024-04-23T19:00:19.306559+0000","last_active":"2024-04-23T19:00:26.320346+0000","last_peered":"2024-04-23T19:00:26.320346+0000","last_clean":"2024-04-23T19:00:26.320346+0000","last_became_active":"2024-04-23T19:00:19.305854+0000","last_became_peered":"2024-04-23T19:00:19.305854+0000","last_unstale":"2024-04-23T19:00:26.320346+0000","last_undegraded":"2024-04-23T19:00:26.320346+0000","last_fullsized":"2024-04-23T19:00:26.320346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.859985+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:00:26.859985+0000","last_peered":"2024-04-23T19:00:26.859985+0000","last_clean":"2024-04-23T19:00:26.859985+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:00:26.859985+0000","last_undegraded":"2024-04-23T19:00:26.859985+0000","last_fullsized":"2024-04-23T19:00:26.859985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341276+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:00:26.341276+0000","last_peered":"2024-04-23T19:00:26.341276+0000","last_clean":"2024-04-23T19:00:26.341276+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:00:26.341276+0000","last_undegraded":"2024-04-23T19:00:26.341276+0000","last_fullsized":"2024-04-23T19:00:26.341276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330444+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:00:26.330444+0000","last_peered":"2024-04-23T19:00:26.330444+0000","last_clean":"2024-04-23T19:00:26.330444+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:00:26.330444+0000","last_undegraded":"2024-04-23T19:00:26.330444+0000","last_fullsized":"2024-04-23T19:00:26.330444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347185+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:00:26.347185+0000","last_peered":"2024-04-23T19:00:26.347185+0000","last_clean":"2024-04-23T19:00:26.347185+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:00:26.347185+0000","last_undegraded":"2024-04-23T19:00:26.347185+0000","last_fullsized":"2024-04-23T19:00:26.347185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311812+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:00:26.311812+0000","last_peered":"2024-04-23T19:00:26.311812+0000","last_clean":"2024-04-23T19:00:26.311812+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:00:26.311812+0000","last_undegraded":"2024-04-23T19:00:26.311812+0000","last_fullsized":"2024-04-23T19:00:26.311812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331174+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:00:26.331174+0000","last_peered":"2024-04-23T19:00:26.331174+0000","last_clean":"2024-04-23T19:00:26.331174+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:00:26.331174+0000","last_undegraded":"2024-04-23T19:00:26.331174+0000","last_fullsized":"2024-04-23T19:00:26.331174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.839602+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:00:26.839602+0000","last_peered":"2024-04-23T19:00:26.839602+0000","last_clean":"2024-04-23T19:00:26.839602+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:00:26.839602+0000","last_undegraded":"2024-04-23T19:00:26.839602+0000","last_fullsized":"2024-04-23T19:00:26.839602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321701+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:00:26.321701+0000","last_peered":"2024-04-23T19:00:26.321701+0000","last_clean":"2024-04-23T19:00:26.321701+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:00:26.321701+0000","last_undegraded":"2024-04-23T19:00:26.321701+0000","last_fullsized":"2024-04-23T19:00:26.321701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333638+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:00:26.333638+0000","last_peered":"2024-04-23T19:00:26.333638+0000","last_clean":"2024-04-23T19:00:26.333638+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:00:26.333638+0000","last_undegraded":"2024-04-23T19:00:26.333638+0000","last_fullsized":"2024-04-23T19:00:26.333638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347708+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:00:26.347708+0000","last_peered":"2024-04-23T19:00:26.347708+0000","last_clean":"2024-04-23T19:00:26.347708+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:00:26.347708+0000","last_undegraded":"2024-04-23T19:00:26.347708+0000","last_fullsized":"2024-04-23T19:00:26.347708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311718+0000","last_change":"2024-04-23T19:00:15.264129+0000","last_active":"2024-04-23T19:00:26.311718+0000","last_peered":"2024-04-23T19:00:26.311718+0000","last_clean":"2024-04-23T19:00:26.311718+0000","last_became_active":"2024-04-23T19:00:15.263412+0000","last_became_peered":"2024-04-23T19:00:15.263412+0000","last_unstale":"2024-04-23T19:00:26.311718+0000","last_undegraded":"2024-04-23T19:00:26.311718+0000","last_fullsized":"2024-04-23T19:00:26.311718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:02.135753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310179+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:00:26.310179+0000","last_peered":"2024-04-23T19:00:26.310179+0000","last_clean":"2024-04-23T19:00:26.310179+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:00:26.310179+0000","last_undegraded":"2024-04-23T19:00:26.310179+0000","last_fullsized":"2024-04-23T19:00:26.310179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.633206+0000","last_change":"2024-04-23T19:00:21.320263+0000","last_active":"2024-04-23T19:00:26.633206+0000","last_peered":"2024-04-23T19:00:26.633206+0000","last_clean":"2024-04-23T19:00:26.633206+0000","last_became_active":"2024-04-23T19:00:21.319483+0000","last_became_peered":"2024-04-23T19:00:21.319483+0000","last_unstale":"2024-04-23T19:00:26.633206+0000","last_undegraded":"2024-04-23T19:00:26.633206+0000","last_fullsized":"2024-04-23T19:00:26.633206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:49.400487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339605+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:00:26.339605+0000","last_peered":"2024-04-23T19:00:26.339605+0000","last_clean":"2024-04-23T19:00:26.339605+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:00:26.339605+0000","last_undegraded":"2024-04-23T19:00:26.339605+0000","last_fullsized":"2024-04-23T19:00:26.339605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312964+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:00:26.312964+0000","last_peered":"2024-04-23T19:00:26.312964+0000","last_clean":"2024-04-23T19:00:26.312964+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:00:26.312964+0000","last_undegraded":"2024-04-23T19:00:26.312964+0000","last_fullsized":"2024-04-23T19:00:26.312964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310845+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:00:26.310845+0000","last_peered":"2024-04-23T19:00:26.310845+0000","last_clean":"2024-04-23T19:00:26.310845+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:00:26.310845+0000","last_undegraded":"2024-04-23T19:00:26.310845+0000","last_fullsized":"2024-04-23T19:00:26.310845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313406+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:00:26.313406+0000","last_peered":"2024-04-23T19:00:26.313406+0000","last_clean":"2024-04-23T19:00:26.313406+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:00:26.313406+0000","last_undegraded":"2024-04-23T19:00:26.313406+0000","last_fullsized":"2024-04-23T19:00:26.313406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.345815+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:00:26.345815+0000","last_peered":"2024-04-23T19:00:26.345815+0000","last_clean":"2024-04-23T19:00:26.345815+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:00:26.345815+0000","last_undegraded":"2024-04-23T19:00:26.345815+0000","last_fullsized":"2024-04-23T19:00:26.345815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.868085+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:00:26.868085+0000","last_peered":"2024-04-23T19:00:26.868085+0000","last_clean":"2024-04-23T19:00:26.868085+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:00:26.868085+0000","last_undegraded":"2024-04-23T19:00:26.868085+0000","last_fullsized":"2024-04-23T19:00:26.868085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346341+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:00:26.346341+0000","last_peered":"2024-04-23T19:00:26.346341+0000","last_clean":"2024-04-23T19:00:26.346341+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:00:26.346341+0000","last_undegraded":"2024-04-23T19:00:26.346341+0000","last_fullsized":"2024-04-23T19:00:26.346341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332888+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:00:26.332888+0000","last_peered":"2024-04-23T19:00:26.332888+0000","last_clean":"2024-04-23T19:00:26.332888+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:00:26.332888+0000","last_undegraded":"2024-04-23T19:00:26.332888+0000","last_fullsized":"2024-04-23T19:00:26.332888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346251+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:00:26.346251+0000","last_peered":"2024-04-23T19:00:26.346251+0000","last_clean":"2024-04-23T19:00:26.346251+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:00:26.346251+0000","last_undegraded":"2024-04-23T19:00:26.346251+0000","last_fullsized":"2024-04-23T19:00:26.346251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327637+0000","last_change":"2024-04-23T19:00:15.291304+0000","last_active":"2024-04-23T19:00:26.327637+0000","last_peered":"2024-04-23T19:00:26.327637+0000","last_clean":"2024-04-23T19:00:26.327637+0000","last_became_active":"2024-04-23T19:00:15.290254+0000","last_became_peered":"2024-04-23T19:00:15.290254+0000","last_unstale":"2024-04-23T19:00:26.327637+0000","last_undegraded":"2024-04-23T19:00:26.327637+0000","last_fullsized":"2024-04-23T19:00:26.327637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.318594+0000","last_change":"2024-04-23T19:00:19.302840+0000","last_active":"2024-04-23T19:00:26.318594+0000","last_peered":"2024-04-23T19:00:26.318594+0000","last_clean":"2024-04-23T19:00:26.318594+0000","last_became_active":"2024-04-23T19:00:19.302069+0000","last_became_peered":"2024-04-23T19:00:19.302069+0000","last_unstale":"2024-04-23T19:00:26.318594+0000","last_undegraded":"2024-04-23T19:00:26.318594+0000","last_fullsized":"2024-04-23T19:00:26.318594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:15.157506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.638930+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:00:26.638930+0000","last_peered":"2024-04-23T19:00:26.638930+0000","last_clean":"2024-04-23T19:00:26.638930+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:00:26.638930+0000","last_undegraded":"2024-04-23T19:00:26.638930+0000","last_fullsized":"2024-04-23T19:00:26.638930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322571+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:00:26.322571+0000","last_peered":"2024-04-23T19:00:26.322571+0000","last_clean":"2024-04-23T19:00:26.322571+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:00:26.322571+0000","last_undegraded":"2024-04-23T19:00:26.322571+0000","last_fullsized":"2024-04-23T19:00:26.322571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346739+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:00:26.346739+0000","last_peered":"2024-04-23T19:00:26.346739+0000","last_clean":"2024-04-23T19:00:26.346739+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:00:26.346739+0000","last_undegraded":"2024-04-23T19:00:26.346739+0000","last_fullsized":"2024-04-23T19:00:26.346739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322061+0000","last_change":"2024-04-23T19:00:17.315323+0000","last_active":"2024-04-23T19:00:26.322061+0000","last_peered":"2024-04-23T19:00:26.322061+0000","last_clean":"2024-04-23T19:00:26.322061+0000","last_became_active":"2024-04-23T19:00:17.315077+0000","last_became_peered":"2024-04-23T19:00:17.315077+0000","last_unstale":"2024-04-23T19:00:26.322061+0000","last_undegraded":"2024-04-23T19:00:26.322061+0000","last_fullsized":"2024-04-23T19:00:26.322061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339654+0000","last_change":"2024-04-23T19:00:15.262041+0000","last_active":"2024-04-23T19:00:26.339654+0000","last_peered":"2024-04-23T19:00:26.339654+0000","last_clean":"2024-04-23T19:00:26.339654+0000","last_became_active":"2024-04-23T19:00:15.261175+0000","last_became_peered":"2024-04-23T19:00:15.261175+0000","last_unstale":"2024-04-23T19:00:26.339654+0000","last_undegraded":"2024-04-23T19:00:26.339654+0000","last_fullsized":"2024-04-23T19:00:26.339654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321087+0000","last_change":"2024-04-23T19:00:17.297003+0000","last_active":"2024-04-23T19:00:26.321087+0000","last_peered":"2024-04-23T19:00:26.321087+0000","last_clean":"2024-04-23T19:00:26.321087+0000","last_became_active":"2024-04-23T19:00:17.295108+0000","last_became_peered":"2024-04-23T19:00:17.295108+0000","last_unstale":"2024-04-23T19:00:26.321087+0000","last_undegraded":"2024-04-23T19:00:26.321087+0000","last_fullsized":"2024-04-23T19:00:26.321087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307390+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:00:26.307390+0000","last_peered":"2024-04-23T19:00:26.307390+0000","last_clean":"2024-04-23T19:00:26.307390+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:00:26.307390+0000","last_undegraded":"2024-04-23T19:00:26.307390+0000","last_fullsized":"2024-04-23T19:00:26.307390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310747+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:00:26.310747+0000","last_peered":"2024-04-23T19:00:26.310747+0000","last_clean":"2024-04-23T19:00:26.310747+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:00:26.310747+0000","last_undegraded":"2024-04-23T19:00:26.310747+0000","last_fullsized":"2024-04-23T19:00:26.310747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311946+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:00:26.311946+0000","last_peered":"2024-04-23T19:00:26.311946+0000","last_clean":"2024-04-23T19:00:26.311946+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:00:26.311946+0000","last_undegraded":"2024-04-23T19:00:26.311946+0000","last_fullsized":"2024-04-23T19:00:26.311946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320373+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:00:26.320373+0000","last_peered":"2024-04-23T19:00:26.320373+0000","last_clean":"2024-04-23T19:00:26.320373+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:00:26.320373+0000","last_undegraded":"2024-04-23T19:00:26.320373+0000","last_fullsized":"2024-04-23T19:00:26.320373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323419+0000","last_change":"2024-04-23T19:00:15.258608+0000","last_active":"2024-04-23T19:00:26.323419+0000","last_peered":"2024-04-23T19:00:26.323419+0000","last_clean":"2024-04-23T19:00:26.323419+0000","last_became_active":"2024-04-23T19:00:15.258276+0000","last_became_peered":"2024-04-23T19:00:15.258276+0000","last_unstale":"2024-04-23T19:00:26.323419+0000","last_undegraded":"2024-04-23T19:00:26.323419+0000","last_fullsized":"2024-04-23T19:00:26.323419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312982+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:00:26.312982+0000","last_peered":"2024-04-23T19:00:26.312982+0000","last_clean":"2024-04-23T19:00:26.312982+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:00:26.312982+0000","last_undegraded":"2024-04-23T19:00:26.312982+0000","last_fullsized":"2024-04-23T19:00:26.312982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314069+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:00:26.314069+0000","last_peered":"2024-04-23T19:00:26.314069+0000","last_clean":"2024-04-23T19:00:26.314069+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:00:26.314069+0000","last_undegraded":"2024-04-23T19:00:26.314069+0000","last_fullsized":"2024-04-23T19:00:26.314069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348137+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:00:26.348137+0000","last_peered":"2024-04-23T19:00:26.348137+0000","last_clean":"2024-04-23T19:00:26.348137+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:00:26.348137+0000","last_undegraded":"2024-04-23T19:00:26.348137+0000","last_fullsized":"2024-04-23T19:00:26.348137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320765+0000","last_change":"2024-04-23T19:00:15.251155+0000","last_active":"2024-04-23T19:00:26.320765+0000","last_peered":"2024-04-23T19:00:26.320765+0000","last_clean":"2024-04-23T19:00:26.320765+0000","last_became_active":"2024-04-23T19:00:15.250798+0000","last_became_peered":"2024-04-23T19:00:15.250798+0000","last_unstale":"2024-04-23T19:00:26.320765+0000","last_undegraded":"2024-04-23T19:00:26.320765+0000","last_fullsized":"2024-04-23T19:00:26.320765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310382+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:00:26.310382+0000","last_peered":"2024-04-23T19:00:26.310382+0000","last_clean":"2024-04-23T19:00:26.310382+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:00:26.310382+0000","last_undegraded":"2024-04-23T19:00:26.310382+0000","last_fullsized":"2024-04-23T19:00:26.310382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341946+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:00:26.341946+0000","last_peered":"2024-04-23T19:00:26.341946+0000","last_clean":"2024-04-23T19:00:26.341946+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:00:26.341946+0000","last_undegraded":"2024-04-23T19:00:26.341946+0000","last_fullsized":"2024-04-23T19:00:26.341946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339541+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:00:26.339541+0000","last_peered":"2024-04-23T19:00:26.339541+0000","last_clean":"2024-04-23T19:00:26.339541+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:00:26.339541+0000","last_undegraded":"2024-04-23T19:00:26.339541+0000","last_fullsized":"2024-04-23T19:00:26.339541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313637+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:00:26.313637+0000","last_peered":"2024-04-23T19:00:26.313637+0000","last_clean":"2024-04-23T19:00:26.313637+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:00:26.313637+0000","last_undegraded":"2024-04-23T19:00:26.313637+0000","last_fullsized":"2024-04-23T19:00:26.313637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327399+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:00:26.327399+0000","last_peered":"2024-04-23T19:00:26.327399+0000","last_clean":"2024-04-23T19:00:26.327399+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:00:26.327399+0000","last_undegraded":"2024-04-23T19:00:26.327399+0000","last_fullsized":"2024-04-23T19:00:26.327399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311173+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:00:26.311173+0000","last_peered":"2024-04-23T19:00:26.311173+0000","last_clean":"2024-04-23T19:00:26.311173+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:00:26.311173+0000","last_undegraded":"2024-04-23T19:00:26.311173+0000","last_fullsized":"2024-04-23T19:00:26.311173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.349391+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:00:26.349391+0000","last_peered":"2024-04-23T19:00:26.349391+0000","last_clean":"2024-04-23T19:00:26.349391+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:00:26.349391+0000","last_undegraded":"2024-04-23T19:00:26.349391+0000","last_fullsized":"2024-04-23T19:00:26.349391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310988+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:00:26.310988+0000","last_peered":"2024-04-23T19:00:26.310988+0000","last_clean":"2024-04-23T19:00:26.310988+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:00:26.310988+0000","last_undegraded":"2024-04-23T19:00:26.310988+0000","last_fullsized":"2024-04-23T19:00:26.310988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309514+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:00:26.309514+0000","last_peered":"2024-04-23T19:00:26.309514+0000","last_clean":"2024-04-23T19:00:26.309514+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:00:26.309514+0000","last_undegraded":"2024-04-23T19:00:26.309514+0000","last_fullsized":"2024-04-23T19:00:26.309514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310589+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:00:26.310589+0000","last_peered":"2024-04-23T19:00:26.310589+0000","last_clean":"2024-04-23T19:00:26.310589+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:00:26.310589+0000","last_undegraded":"2024-04-23T19:00:26.310589+0000","last_fullsized":"2024-04-23T19:00:26.310589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347777+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:00:26.347777+0000","last_peered":"2024-04-23T19:00:26.347777+0000","last_clean":"2024-04-23T19:00:26.347777+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:00:26.347777+0000","last_undegraded":"2024-04-23T19:00:26.347777+0000","last_fullsized":"2024-04-23T19:00:26.347777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323885+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:00:26.323885+0000","last_peered":"2024-04-23T19:00:26.323885+0000","last_clean":"2024-04-23T19:00:26.323885+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:00:26.323885+0000","last_undegraded":"2024-04-23T19:00:26.323885+0000","last_fullsized":"2024-04-23T19:00:26.323885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331738+0000","last_change":"2024-04-23T19:00:17.307225+0000","last_active":"2024-04-23T19:00:26.331738+0000","last_peered":"2024-04-23T19:00:26.331738+0000","last_clean":"2024-04-23T19:00:26.331738+0000","last_became_active":"2024-04-23T19:00:17.306510+0000","last_became_peered":"2024-04-23T19:00:17.306510+0000","last_unstale":"2024-04-23T19:00:26.331738+0000","last_undegraded":"2024-04-23T19:00:26.331738+0000","last_fullsized":"2024-04-23T19:00:26.331738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340694+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:00:26.340694+0000","last_peered":"2024-04-23T19:00:26.340694+0000","last_clean":"2024-04-23T19:00:26.340694+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:00:26.340694+0000","last_undegraded":"2024-04-23T19:00:26.340694+0000","last_fullsized":"2024-04-23T19:00:26.340694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322803+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:00:26.322803+0000","last_peered":"2024-04-23T19:00:26.322803+0000","last_clean":"2024-04-23T19:00:26.322803+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:00:26.322803+0000","last_undegraded":"2024-04-23T19:00:26.322803+0000","last_fullsized":"2024-04-23T19:00:26.322803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333437+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:00:26.333437+0000","last_peered":"2024-04-23T19:00:26.333437+0000","last_clean":"2024-04-23T19:00:26.333437+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:00:26.333437+0000","last_undegraded":"2024-04-23T19:00:26.333437+0000","last_fullsized":"2024-04-23T19:00:26.333437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310167+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:00:26.310167+0000","last_peered":"2024-04-23T19:00:26.310167+0000","last_clean":"2024-04-23T19:00:26.310167+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:00:26.310167+0000","last_undegraded":"2024-04-23T19:00:26.310167+0000","last_fullsized":"2024-04-23T19:00:26.310167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311197+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:00:26.311197+0000","last_peered":"2024-04-23T19:00:26.311197+0000","last_clean":"2024-04-23T19:00:26.311197+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:00:26.311197+0000","last_undegraded":"2024-04-23T19:00:26.311197+0000","last_fullsized":"2024-04-23T19:00:26.311197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330507+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:00:26.330507+0000","last_peered":"2024-04-23T19:00:26.330507+0000","last_clean":"2024-04-23T19:00:26.330507+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:00:26.330507+0000","last_undegraded":"2024-04-23T19:00:26.330507+0000","last_fullsized":"2024-04-23T19:00:26.330507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312334+0000","last_change":"2024-04-23T19:00:15.270249+0000","last_active":"2024-04-23T19:00:26.312334+0000","last_peered":"2024-04-23T19:00:26.312334+0000","last_clean":"2024-04-23T19:00:26.312334+0000","last_became_active":"2024-04-23T19:00:15.266595+0000","last_became_peered":"2024-04-23T19:00:15.266595+0000","last_unstale":"2024-04-23T19:00:26.312334+0000","last_undegraded":"2024-04-23T19:00:26.312334+0000","last_fullsized":"2024-04-23T19:00:26.312334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310135+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:00:26.310135+0000","last_peered":"2024-04-23T19:00:26.310135+0000","last_clean":"2024-04-23T19:00:26.310135+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:00:26.310135+0000","last_undegraded":"2024-04-23T19:00:26.310135+0000","last_fullsized":"2024-04-23T19:00:26.310135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327379+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:00:26.327379+0000","last_peered":"2024-04-23T19:00:26.327379+0000","last_clean":"2024-04-23T19:00:26.327379+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:00:26.327379+0000","last_undegraded":"2024-04-23T19:00:26.327379+0000","last_fullsized":"2024-04-23T19:00:26.327379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319815+0000","last_change":"2024-04-23T19:00:15.270216+0000","last_active":"2024-04-23T19:00:26.319815+0000","last_peered":"2024-04-23T19:00:26.319815+0000","last_clean":"2024-04-23T19:00:26.319815+0000","last_became_active":"2024-04-23T19:00:15.269392+0000","last_became_peered":"2024-04-23T19:00:15.269392+0000","last_unstale":"2024-04-23T19:00:26.319815+0000","last_undegraded":"2024-04-23T19:00:26.319815+0000","last_fullsized":"2024-04-23T19:00:26.319815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311648+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:00:26.311648+0000","last_peered":"2024-04-23T19:00:26.311648+0000","last_clean":"2024-04-23T19:00:26.311648+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:00:26.311648+0000","last_undegraded":"2024-04-23T19:00:26.311648+0000","last_fullsized":"2024-04-23T19:00:26.311648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":529,"num_read_kb":341,"num_write":311,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":750597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":159569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":159404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":158074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":158972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":157918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":150284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":749006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:00:33.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:00:33.635 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:33.642 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:00:33.661 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-23T19:00:31.883818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":649,"num_read_kb":445,"num_write":480,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":473,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224488,"kb_used_data":4160,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750232,"statfs":{"total":773094113280,"available":772864237568,"internally_reserved":0,"allocated":4259840,"data_stored":2443824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":529,"num_read_kb":341,"num_write":311,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.586559"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333035+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:00:26.333035+0000","last_peered":"2024-04-23T19:00:26.333035+0000","last_clean":"2024-04-23T19:00:26.333035+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:00:26.333035+0000","last_undegraded":"2024-04-23T19:00:26.333035+0000","last_fullsized":"2024-04-23T19:00:26.333035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309295+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:00:26.309295+0000","last_peered":"2024-04-23T19:00:26.309295+0000","last_clean":"2024-04-23T19:00:26.309295+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:00:26.309295+0000","last_undegraded":"2024-04-23T19:00:26.309295+0000","last_fullsized":"2024-04-23T19:00:26.309295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321276+0000","last_change":"2024-04-23T19:00:15.257176+0000","last_active":"2024-04-23T19:00:26.321276+0000","last_peered":"2024-04-23T19:00:26.321276+0000","last_clean":"2024-04-23T19:00:26.321276+0000","last_became_active":"2024-04-23T19:00:15.256794+0000","last_became_peered":"2024-04-23T19:00:15.256794+0000","last_unstale":"2024-04-23T19:00:26.321276+0000","last_undegraded":"2024-04-23T19:00:26.321276+0000","last_fullsized":"2024-04-23T19:00:26.321276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330971+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:00:26.330971+0000","last_peered":"2024-04-23T19:00:26.330971+0000","last_clean":"2024-04-23T19:00:26.330971+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:00:26.330971+0000","last_undegraded":"2024-04-23T19:00:26.330971+0000","last_fullsized":"2024-04-23T19:00:26.330971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325572+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:00:26.325572+0000","last_peered":"2024-04-23T19:00:26.325572+0000","last_clean":"2024-04-23T19:00:26.325572+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:00:26.325572+0000","last_undegraded":"2024-04-23T19:00:26.325572+0000","last_fullsized":"2024-04-23T19:00:26.325572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347209+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:00:26.347209+0000","last_peered":"2024-04-23T19:00:26.347209+0000","last_clean":"2024-04-23T19:00:26.347209+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:00:26.347209+0000","last_undegraded":"2024-04-23T19:00:26.347209+0000","last_fullsized":"2024-04-23T19:00:26.347209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311555+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:00:26.311555+0000","last_peered":"2024-04-23T19:00:26.311555+0000","last_clean":"2024-04-23T19:00:26.311555+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:00:26.311555+0000","last_undegraded":"2024-04-23T19:00:26.311555+0000","last_fullsized":"2024-04-23T19:00:26.311555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323180+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:00:26.323180+0000","last_peered":"2024-04-23T19:00:26.323180+0000","last_clean":"2024-04-23T19:00:26.323180+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:00:26.323180+0000","last_undegraded":"2024-04-23T19:00:26.323180+0000","last_fullsized":"2024-04-23T19:00:26.323180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332000+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:00:26.332000+0000","last_peered":"2024-04-23T19:00:26.332000+0000","last_clean":"2024-04-23T19:00:26.332000+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:00:26.332000+0000","last_undegraded":"2024-04-23T19:00:26.332000+0000","last_fullsized":"2024-04-23T19:00:26.332000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340437+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:00:26.340437+0000","last_peered":"2024-04-23T19:00:26.340437+0000","last_clean":"2024-04-23T19:00:26.340437+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:00:26.340437+0000","last_undegraded":"2024-04-23T19:00:26.340437+0000","last_fullsized":"2024-04-23T19:00:26.340437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309980+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:00:26.309980+0000","last_peered":"2024-04-23T19:00:26.309980+0000","last_clean":"2024-04-23T19:00:26.309980+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:00:26.309980+0000","last_undegraded":"2024-04-23T19:00:26.309980+0000","last_fullsized":"2024-04-23T19:00:26.309980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347761+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:00:26.347761+0000","last_peered":"2024-04-23T19:00:26.347761+0000","last_clean":"2024-04-23T19:00:26.347761+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:00:26.347761+0000","last_undegraded":"2024-04-23T19:00:26.347761+0000","last_fullsized":"2024-04-23T19:00:26.347761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331295+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:00:26.331295+0000","last_peered":"2024-04-23T19:00:26.331295+0000","last_clean":"2024-04-23T19:00:26.331295+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:00:26.331295+0000","last_undegraded":"2024-04-23T19:00:26.331295+0000","last_fullsized":"2024-04-23T19:00:26.331295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311432+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:00:26.311432+0000","last_peered":"2024-04-23T19:00:26.311432+0000","last_clean":"2024-04-23T19:00:26.311432+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:00:26.311432+0000","last_undegraded":"2024-04-23T19:00:26.311432+0000","last_fullsized":"2024-04-23T19:00:26.311432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310790+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:00:26.310790+0000","last_peered":"2024-04-23T19:00:26.310790+0000","last_clean":"2024-04-23T19:00:26.310790+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:00:26.310790+0000","last_undegraded":"2024-04-23T19:00:26.310790+0000","last_fullsized":"2024-04-23T19:00:26.310790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309948+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:00:26.309948+0000","last_peered":"2024-04-23T19:00:26.309948+0000","last_clean":"2024-04-23T19:00:26.309948+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:00:26.309948+0000","last_undegraded":"2024-04-23T19:00:26.309948+0000","last_fullsized":"2024-04-23T19:00:26.309948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346115+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:00:26.346115+0000","last_peered":"2024-04-23T19:00:26.346115+0000","last_clean":"2024-04-23T19:00:26.346115+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:00:26.346115+0000","last_undegraded":"2024-04-23T19:00:26.346115+0000","last_fullsized":"2024-04-23T19:00:26.346115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333080+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:00:26.333080+0000","last_peered":"2024-04-23T19:00:26.333080+0000","last_clean":"2024-04-23T19:00:26.333080+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:00:26.333080+0000","last_undegraded":"2024-04-23T19:00:26.333080+0000","last_fullsized":"2024-04-23T19:00:26.333080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331190+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:00:26.331190+0000","last_peered":"2024-04-23T19:00:26.331190+0000","last_clean":"2024-04-23T19:00:26.331190+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:00:26.331190+0000","last_undegraded":"2024-04-23T19:00:26.331190+0000","last_fullsized":"2024-04-23T19:00:26.331190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341724+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:00:26.341724+0000","last_peered":"2024-04-23T19:00:26.341724+0000","last_clean":"2024-04-23T19:00:26.341724+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:00:26.341724+0000","last_undegraded":"2024-04-23T19:00:26.341724+0000","last_fullsized":"2024-04-23T19:00:26.341724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310390+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:00:26.310390+0000","last_peered":"2024-04-23T19:00:26.310390+0000","last_clean":"2024-04-23T19:00:26.310390+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:00:26.310390+0000","last_undegraded":"2024-04-23T19:00:26.310390+0000","last_fullsized":"2024-04-23T19:00:26.310390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341440+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:00:26.341440+0000","last_peered":"2024-04-23T19:00:26.341440+0000","last_clean":"2024-04-23T19:00:26.341440+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:00:26.341440+0000","last_undegraded":"2024-04-23T19:00:26.341440+0000","last_fullsized":"2024-04-23T19:00:26.341440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.308460+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:00:26.308460+0000","last_peered":"2024-04-23T19:00:26.308460+0000","last_clean":"2024-04-23T19:00:26.308460+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:00:26.308460+0000","last_undegraded":"2024-04-23T19:00:26.308460+0000","last_fullsized":"2024-04-23T19:00:26.308460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347085+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:00:26.347085+0000","last_peered":"2024-04-23T19:00:26.347085+0000","last_clean":"2024-04-23T19:00:26.347085+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:00:26.347085+0000","last_undegraded":"2024-04-23T19:00:26.347085+0000","last_fullsized":"2024-04-23T19:00:26.347085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309045+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:00:26.309045+0000","last_peered":"2024-04-23T19:00:26.309045+0000","last_clean":"2024-04-23T19:00:26.309045+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:00:26.309045+0000","last_undegraded":"2024-04-23T19:00:26.309045+0000","last_fullsized":"2024-04-23T19:00:26.309045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312271+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:00:26.312271+0000","last_peered":"2024-04-23T19:00:26.312271+0000","last_clean":"2024-04-23T19:00:26.312271+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:00:26.312271+0000","last_undegraded":"2024-04-23T19:00:26.312271+0000","last_fullsized":"2024-04-23T19:00:26.312271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348017+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:00:26.348017+0000","last_peered":"2024-04-23T19:00:26.348017+0000","last_clean":"2024-04-23T19:00:26.348017+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:00:26.348017+0000","last_undegraded":"2024-04-23T19:00:26.348017+0000","last_fullsized":"2024-04-23T19:00:26.348017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323409+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:00:26.323409+0000","last_peered":"2024-04-23T19:00:26.323409+0000","last_clean":"2024-04-23T19:00:26.323409+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:00:26.323409+0000","last_undegraded":"2024-04-23T19:00:26.323409+0000","last_fullsized":"2024-04-23T19:00:26.323409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346107+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:00:26.346107+0000","last_peered":"2024-04-23T19:00:26.346107+0000","last_clean":"2024-04-23T19:00:26.346107+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:00:26.346107+0000","last_undegraded":"2024-04-23T19:00:26.346107+0000","last_fullsized":"2024-04-23T19:00:26.346107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313576+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:00:26.313576+0000","last_peered":"2024-04-23T19:00:26.313576+0000","last_clean":"2024-04-23T19:00:26.313576+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:00:26.313576+0000","last_undegraded":"2024-04-23T19:00:26.313576+0000","last_fullsized":"2024-04-23T19:00:26.313576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332142+0000","last_change":"2024-04-23T19:00:15.286378+0000","last_active":"2024-04-23T19:00:26.332142+0000","last_peered":"2024-04-23T19:00:26.332142+0000","last_clean":"2024-04-23T19:00:26.332142+0000","last_became_active":"2024-04-23T19:00:15.281478+0000","last_became_peered":"2024-04-23T19:00:15.281478+0000","last_unstale":"2024-04-23T19:00:26.332142+0000","last_undegraded":"2024-04-23T19:00:26.332142+0000","last_fullsized":"2024-04-23T19:00:26.332142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:02.135753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310275+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:00:26.310275+0000","last_peered":"2024-04-23T19:00:26.310275+0000","last_clean":"2024-04-23T19:00:26.310275+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:00:26.310275+0000","last_undegraded":"2024-04-23T19:00:26.310275+0000","last_fullsized":"2024-04-23T19:00:26.310275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.720309+0000","last_change":"2024-04-23T19:00:21.316254+0000","last_active":"2024-04-23T19:00:26.720309+0000","last_peered":"2024-04-23T19:00:26.720309+0000","last_clean":"2024-04-23T19:00:26.720309+0000","last_became_active":"2024-04-23T19:00:21.315622+0000","last_became_peered":"2024-04-23T19:00:21.315622+0000","last_unstale":"2024-04-23T19:00:26.720309+0000","last_undegraded":"2024-04-23T19:00:26.720309+0000","last_fullsized":"2024-04-23T19:00:26.720309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332739+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:00:26.332739+0000","last_peered":"2024-04-23T19:00:26.332739+0000","last_clean":"2024-04-23T19:00:26.332739+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:00:26.332739+0000","last_undegraded":"2024-04-23T19:00:26.332739+0000","last_fullsized":"2024-04-23T19:00:26.332739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309565+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:00:26.309565+0000","last_peered":"2024-04-23T19:00:26.309565+0000","last_clean":"2024-04-23T19:00:26.309565+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:00:26.309565+0000","last_undegraded":"2024-04-23T19:00:26.309565+0000","last_fullsized":"2024-04-23T19:00:26.309565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311480+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:00:26.311480+0000","last_peered":"2024-04-23T19:00:26.311480+0000","last_clean":"2024-04-23T19:00:26.311480+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:00:26.311480+0000","last_undegraded":"2024-04-23T19:00:26.311480+0000","last_fullsized":"2024-04-23T19:00:26.311480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323409+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:00:26.323409+0000","last_peered":"2024-04-23T19:00:26.323409+0000","last_clean":"2024-04-23T19:00:26.323409+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:00:26.323409+0000","last_undegraded":"2024-04-23T19:00:26.323409+0000","last_fullsized":"2024-04-23T19:00:26.323409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312934+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:00:26.312934+0000","last_peered":"2024-04-23T19:00:26.312934+0000","last_clean":"2024-04-23T19:00:26.312934+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:00:26.312934+0000","last_undegraded":"2024-04-23T19:00:26.312934+0000","last_fullsized":"2024-04-23T19:00:26.312934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.752395+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:00:26.752395+0000","last_peered":"2024-04-23T19:00:26.752395+0000","last_clean":"2024-04-23T19:00:26.752395+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:00:26.752395+0000","last_undegraded":"2024-04-23T19:00:26.752395+0000","last_fullsized":"2024-04-23T19:00:26.752395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348853+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:00:26.348853+0000","last_peered":"2024-04-23T19:00:26.348853+0000","last_clean":"2024-04-23T19:00:26.348853+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:00:26.348853+0000","last_undegraded":"2024-04-23T19:00:26.348853+0000","last_fullsized":"2024-04-23T19:00:26.348853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323133+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:00:26.323133+0000","last_peered":"2024-04-23T19:00:26.323133+0000","last_clean":"2024-04-23T19:00:26.323133+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:00:26.323133+0000","last_undegraded":"2024-04-23T19:00:26.323133+0000","last_fullsized":"2024-04-23T19:00:26.323133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326582+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:00:26.326582+0000","last_peered":"2024-04-23T19:00:26.326582+0000","last_clean":"2024-04-23T19:00:26.326582+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:00:26.326582+0000","last_undegraded":"2024-04-23T19:00:26.326582+0000","last_fullsized":"2024-04-23T19:00:26.326582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331446+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:00:26.331446+0000","last_peered":"2024-04-23T19:00:26.331446+0000","last_clean":"2024-04-23T19:00:26.331446+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:00:26.331446+0000","last_undegraded":"2024-04-23T19:00:26.331446+0000","last_fullsized":"2024-04-23T19:00:26.331446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314653+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:00:26.314653+0000","last_peered":"2024-04-23T19:00:26.314653+0000","last_clean":"2024-04-23T19:00:26.314653+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:00:26.314653+0000","last_undegraded":"2024-04-23T19:00:26.314653+0000","last_fullsized":"2024-04-23T19:00:26.314653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.459735+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:00:26.459735+0000","last_peered":"2024-04-23T19:00:26.459735+0000","last_clean":"2024-04-23T19:00:26.459735+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:00:26.459735+0000","last_undegraded":"2024-04-23T19:00:26.459735+0000","last_fullsized":"2024-04-23T19:00:26.459735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332215+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:00:26.332215+0000","last_peered":"2024-04-23T19:00:26.332215+0000","last_clean":"2024-04-23T19:00:26.332215+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:00:26.332215+0000","last_undegraded":"2024-04-23T19:00:26.332215+0000","last_fullsized":"2024-04-23T19:00:26.332215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347035+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:00:26.347035+0000","last_peered":"2024-04-23T19:00:26.347035+0000","last_clean":"2024-04-23T19:00:26.347035+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:00:26.347035+0000","last_undegraded":"2024-04-23T19:00:26.347035+0000","last_fullsized":"2024-04-23T19:00:26.347035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313339+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:00:26.313339+0000","last_peered":"2024-04-23T19:00:26.313339+0000","last_clean":"2024-04-23T19:00:26.313339+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:00:26.313339+0000","last_undegraded":"2024-04-23T19:00:26.313339+0000","last_fullsized":"2024-04-23T19:00:26.313339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340270+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:00:26.340270+0000","last_peered":"2024-04-23T19:00:26.340270+0000","last_clean":"2024-04-23T19:00:26.340270+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:00:26.340270+0000","last_undegraded":"2024-04-23T19:00:26.340270+0000","last_fullsized":"2024-04-23T19:00:26.340270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311137+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:00:26.311137+0000","last_peered":"2024-04-23T19:00:26.311137+0000","last_clean":"2024-04-23T19:00:26.311137+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:00:26.311137+0000","last_undegraded":"2024-04-23T19:00:26.311137+0000","last_fullsized":"2024-04-23T19:00:26.311137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.738947+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:00:26.738947+0000","last_peered":"2024-04-23T19:00:26.738947+0000","last_clean":"2024-04-23T19:00:26.738947+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:00:26.738947+0000","last_undegraded":"2024-04-23T19:00:26.738947+0000","last_fullsized":"2024-04-23T19:00:26.738947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312411+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:00:26.312411+0000","last_peered":"2024-04-23T19:00:26.312411+0000","last_clean":"2024-04-23T19:00:26.312411+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:00:26.312411+0000","last_undegraded":"2024-04-23T19:00:26.312411+0000","last_fullsized":"2024-04-23T19:00:26.312411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309873+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:00:26.309873+0000","last_peered":"2024-04-23T19:00:26.309873+0000","last_clean":"2024-04-23T19:00:26.309873+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:00:26.309873+0000","last_undegraded":"2024-04-23T19:00:26.309873+0000","last_fullsized":"2024-04-23T19:00:26.309873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333307+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:00:26.333307+0000","last_peered":"2024-04-23T19:00:26.333307+0000","last_clean":"2024-04-23T19:00:26.333307+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:00:26.333307+0000","last_undegraded":"2024-04-23T19:00:26.333307+0000","last_fullsized":"2024-04-23T19:00:26.333307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330586+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:00:26.330586+0000","last_peered":"2024-04-23T19:00:26.330586+0000","last_clean":"2024-04-23T19:00:26.330586+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:00:26.330586+0000","last_undegraded":"2024-04-23T19:00:26.330586+0000","last_fullsized":"2024-04-23T19:00:26.330586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.811948+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:00:26.811948+0000","last_peered":"2024-04-23T19:00:26.811948+0000","last_clean":"2024-04-23T19:00:26.811948+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:00:26.811948+0000","last_undegraded":"2024-04-23T19:00:26.811948+0000","last_fullsized":"2024-04-23T19:00:26.811948+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319179+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:00:26.319179+0000","last_peered":"2024-04-23T19:00:26.319179+0000","last_clean":"2024-04-23T19:00:26.319179+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:00:26.319179+0000","last_undegraded":"2024-04-23T19:00:26.319179+0000","last_fullsized":"2024-04-23T19:00:26.319179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310975+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:00:26.310975+0000","last_peered":"2024-04-23T19:00:26.310975+0000","last_clean":"2024-04-23T19:00:26.310975+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:00:26.310975+0000","last_undegraded":"2024-04-23T19:00:26.310975+0000","last_fullsized":"2024-04-23T19:00:26.310975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346364+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:00:26.346364+0000","last_peered":"2024-04-23T19:00:26.346364+0000","last_clean":"2024-04-23T19:00:26.346364+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:00:26.346364+0000","last_undegraded":"2024-04-23T19:00:26.346364+0000","last_fullsized":"2024-04-23T19:00:26.346364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333106+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:00:26.333106+0000","last_peered":"2024-04-23T19:00:26.333106+0000","last_clean":"2024-04-23T19:00:26.333106+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:00:26.333106+0000","last_undegraded":"2024-04-23T19:00:26.333106+0000","last_fullsized":"2024-04-23T19:00:26.333106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307295+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:00:26.307295+0000","last_peered":"2024-04-23T19:00:26.307295+0000","last_clean":"2024-04-23T19:00:26.307295+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:00:26.307295+0000","last_undegraded":"2024-04-23T19:00:26.307295+0000","last_fullsized":"2024-04-23T19:00:26.307295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.727404+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:00:26.727404+0000","last_peered":"2024-04-23T19:00:26.727404+0000","last_clean":"2024-04-23T19:00:26.727404+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:00:26.727404+0000","last_undegraded":"2024-04-23T19:00:26.727404+0000","last_fullsized":"2024-04-23T19:00:26.727404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309482+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:00:26.309482+0000","last_peered":"2024-04-23T19:00:26.309482+0000","last_clean":"2024-04-23T19:00:26.309482+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:00:26.309482+0000","last_undegraded":"2024-04-23T19:00:26.309482+0000","last_fullsized":"2024-04-23T19:00:26.309482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340946+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:00:26.340946+0000","last_peered":"2024-04-23T19:00:26.340946+0000","last_clean":"2024-04-23T19:00:26.340946+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:00:26.340946+0000","last_undegraded":"2024-04-23T19:00:26.340946+0000","last_fullsized":"2024-04-23T19:00:26.340946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340517+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:00:26.340517+0000","last_peered":"2024-04-23T19:00:26.340517+0000","last_clean":"2024-04-23T19:00:26.340517+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:00:26.340517+0000","last_undegraded":"2024-04-23T19:00:26.340517+0000","last_fullsized":"2024-04-23T19:00:26.340517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333161+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:00:26.333161+0000","last_peered":"2024-04-23T19:00:26.333161+0000","last_clean":"2024-04-23T19:00:26.333161+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:00:26.333161+0000","last_undegraded":"2024-04-23T19:00:26.333161+0000","last_fullsized":"2024-04-23T19:00:26.333161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.308977+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:00:26.308977+0000","last_peered":"2024-04-23T19:00:26.308977+0000","last_clean":"2024-04-23T19:00:26.308977+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:00:26.308977+0000","last_undegraded":"2024-04-23T19:00:26.308977+0000","last_fullsized":"2024-04-23T19:00:26.308977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'13","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.879328+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:00:26.879328+0000","last_peered":"2024-04-23T19:00:26.879328+0000","last_clean":"2024-04-23T19:00:26.879328+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:00:26.879328+0000","last_undegraded":"2024-04-23T19:00:26.879328+0000","last_fullsized":"2024-04-23T19:00:26.879328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321992+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:00:26.321992+0000","last_peered":"2024-04-23T19:00:26.321992+0000","last_clean":"2024-04-23T19:00:26.321992+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:00:26.321992+0000","last_undegraded":"2024-04-23T19:00:26.321992+0000","last_fullsized":"2024-04-23T19:00:26.321992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326008+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:00:26.326008+0000","last_peered":"2024-04-23T19:00:26.326008+0000","last_clean":"2024-04-23T19:00:26.326008+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:00:26.326008+0000","last_undegraded":"2024-04-23T19:00:26.326008+0000","last_fullsized":"2024-04-23T19:00:26.326008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.324725+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:00:26.324725+0000","last_peered":"2024-04-23T19:00:26.324725+0000","last_clean":"2024-04-23T19:00:26.324725+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:00:26.324725+0000","last_undegraded":"2024-04-23T19:00:26.324725+0000","last_fullsized":"2024-04-23T19:00:26.324725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312231+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:00:26.312231+0000","last_peered":"2024-04-23T19:00:26.312231+0000","last_clean":"2024-04-23T19:00:26.312231+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:00:26.312231+0000","last_undegraded":"2024-04-23T19:00:26.312231+0000","last_fullsized":"2024-04-23T19:00:26.312231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307929+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:00:26.307929+0000","last_peered":"2024-04-23T19:00:26.307929+0000","last_clean":"2024-04-23T19:00:26.307929+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:00:26.307929+0000","last_undegraded":"2024-04-23T19:00:26.307929+0000","last_fullsized":"2024-04-23T19:00:26.307929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.681700+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:00:26.681700+0000","last_peered":"2024-04-23T19:00:26.681700+0000","last_clean":"2024-04-23T19:00:26.681700+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:00:26.681700+0000","last_undegraded":"2024-04-23T19:00:26.681700+0000","last_fullsized":"2024-04-23T19:00:26.681700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307252+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:00:26.307252+0000","last_peered":"2024-04-23T19:00:26.307252+0000","last_clean":"2024-04-23T19:00:26.307252+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:00:26.307252+0000","last_undegraded":"2024-04-23T19:00:26.307252+0000","last_fullsized":"2024-04-23T19:00:26.307252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321805+0000","last_change":"2024-04-23T19:00:25.352691+0000","last_active":"2024-04-23T19:00:26.321805+0000","last_peered":"2024-04-23T19:00:26.321805+0000","last_clean":"2024-04-23T19:00:26.321805+0000","last_became_active":"2024-04-23T19:00:25.351805+0000","last_became_peered":"2024-04-23T19:00:25.351805+0000","last_unstale":"2024-04-23T19:00:26.321805+0000","last_undegraded":"2024-04-23T19:00:26.321805+0000","last_fullsized":"2024-04-23T19:00:26.321805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:41.939230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347582+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:00:26.347582+0000","last_peered":"2024-04-23T19:00:26.347582+0000","last_clean":"2024-04-23T19:00:26.347582+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:00:26.347582+0000","last_undegraded":"2024-04-23T19:00:26.347582+0000","last_fullsized":"2024-04-23T19:00:26.347582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311834+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:00:26.311834+0000","last_peered":"2024-04-23T19:00:26.311834+0000","last_clean":"2024-04-23T19:00:26.311834+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:00:26.311834+0000","last_undegraded":"2024-04-23T19:00:26.311834+0000","last_fullsized":"2024-04-23T19:00:26.311834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.308966+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:00:26.308966+0000","last_peered":"2024-04-23T19:00:26.308966+0000","last_clean":"2024-04-23T19:00:26.308966+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:00:26.308966+0000","last_undegraded":"2024-04-23T19:00:26.308966+0000","last_fullsized":"2024-04-23T19:00:26.308966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.653055+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:00:26.653055+0000","last_peered":"2024-04-23T19:00:26.653055+0000","last_clean":"2024-04-23T19:00:26.653055+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:00:26.653055+0000","last_undegraded":"2024-04-23T19:00:26.653055+0000","last_fullsized":"2024-04-23T19:00:26.653055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327214+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:00:26.327214+0000","last_peered":"2024-04-23T19:00:26.327214+0000","last_clean":"2024-04-23T19:00:26.327214+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:00:26.327214+0000","last_undegraded":"2024-04-23T19:00:26.327214+0000","last_fullsized":"2024-04-23T19:00:26.327214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309708+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:00:26.309708+0000","last_peered":"2024-04-23T19:00:26.309708+0000","last_clean":"2024-04-23T19:00:26.309708+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:00:26.309708+0000","last_undegraded":"2024-04-23T19:00:26.309708+0000","last_fullsized":"2024-04-23T19:00:26.309708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348263+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:00:26.348263+0000","last_peered":"2024-04-23T19:00:26.348263+0000","last_clean":"2024-04-23T19:00:26.348263+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:00:26.348263+0000","last_undegraded":"2024-04-23T19:00:26.348263+0000","last_fullsized":"2024-04-23T19:00:26.348263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340794+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:00:26.340794+0000","last_peered":"2024-04-23T19:00:26.340794+0000","last_clean":"2024-04-23T19:00:26.340794+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:00:26.340794+0000","last_undegraded":"2024-04-23T19:00:26.340794+0000","last_fullsized":"2024-04-23T19:00:26.340794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319324+0000","last_change":"2024-04-23T19:00:19.306483+0000","last_active":"2024-04-23T19:00:26.319324+0000","last_peered":"2024-04-23T19:00:26.319324+0000","last_clean":"2024-04-23T19:00:26.319324+0000","last_became_active":"2024-04-23T19:00:19.305544+0000","last_became_peered":"2024-04-23T19:00:19.305544+0000","last_unstale":"2024-04-23T19:00:26.319324+0000","last_undegraded":"2024-04-23T19:00:26.319324+0000","last_fullsized":"2024-04-23T19:00:26.319324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:57.250293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.826953+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:00:26.826953+0000","last_peered":"2024-04-23T19:00:26.826953+0000","last_clean":"2024-04-23T19:00:26.826953+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:00:26.826953+0000","last_undegraded":"2024-04-23T19:00:26.826953+0000","last_fullsized":"2024-04-23T19:00:26.826953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310380+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:00:26.310380+0000","last_peered":"2024-04-23T19:00:26.310380+0000","last_clean":"2024-04-23T19:00:26.310380+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:00:26.310380+0000","last_undegraded":"2024-04-23T19:00:26.310380+0000","last_fullsized":"2024-04-23T19:00:26.310380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319401+0000","last_change":"2024-04-23T19:00:25.341628+0000","last_active":"2024-04-23T19:00:26.319401+0000","last_peered":"2024-04-23T19:00:26.319401+0000","last_clean":"2024-04-23T19:00:26.319401+0000","last_became_active":"2024-04-23T19:00:25.341011+0000","last_became_peered":"2024-04-23T19:00:25.341011+0000","last_unstale":"2024-04-23T19:00:26.319401+0000","last_undegraded":"2024-04-23T19:00:26.319401+0000","last_fullsized":"2024-04-23T19:00:26.319401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:34.837079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.349501+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:00:26.349501+0000","last_peered":"2024-04-23T19:00:26.349501+0000","last_clean":"2024-04-23T19:00:26.349501+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:00:26.349501+0000","last_undegraded":"2024-04-23T19:00:26.349501+0000","last_fullsized":"2024-04-23T19:00:26.349501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346879+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:00:26.346879+0000","last_peered":"2024-04-23T19:00:26.346879+0000","last_clean":"2024-04-23T19:00:26.346879+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:00:26.346879+0000","last_undegraded":"2024-04-23T19:00:26.346879+0000","last_fullsized":"2024-04-23T19:00:26.346879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310499+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:00:26.310499+0000","last_peered":"2024-04-23T19:00:26.310499+0000","last_clean":"2024-04-23T19:00:26.310499+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:00:26.310499+0000","last_undegraded":"2024-04-23T19:00:26.310499+0000","last_fullsized":"2024-04-23T19:00:26.310499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.618961+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:00:26.618961+0000","last_peered":"2024-04-23T19:00:26.618961+0000","last_clean":"2024-04-23T19:00:26.618961+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:00:26.618961+0000","last_undegraded":"2024-04-23T19:00:26.618961+0000","last_fullsized":"2024-04-23T19:00:26.618961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340992+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:00:26.340992+0000","last_peered":"2024-04-23T19:00:26.340992+0000","last_clean":"2024-04-23T19:00:26.340992+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:00:26.340992+0000","last_undegraded":"2024-04-23T19:00:26.340992+0000","last_fullsized":"2024-04-23T19:00:26.340992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348863+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:00:26.348863+0000","last_peered":"2024-04-23T19:00:26.348863+0000","last_clean":"2024-04-23T19:00:26.348863+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:00:26.348863+0000","last_undegraded":"2024-04-23T19:00:26.348863+0000","last_fullsized":"2024-04-23T19:00:26.348863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322284+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:00:26.322284+0000","last_peered":"2024-04-23T19:00:26.322284+0000","last_clean":"2024-04-23T19:00:26.322284+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:00:26.322284+0000","last_undegraded":"2024-04-23T19:00:26.322284+0000","last_fullsized":"2024-04-23T19:00:26.322284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311055+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:00:26.311055+0000","last_peered":"2024-04-23T19:00:26.311055+0000","last_clean":"2024-04-23T19:00:26.311055+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:00:26.311055+0000","last_undegraded":"2024-04-23T19:00:26.311055+0000","last_fullsized":"2024-04-23T19:00:26.311055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.349276+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:00:26.349276+0000","last_peered":"2024-04-23T19:00:26.349276+0000","last_clean":"2024-04-23T19:00:26.349276+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:00:26.349276+0000","last_undegraded":"2024-04-23T19:00:26.349276+0000","last_fullsized":"2024-04-23T19:00:26.349276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'13","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.899172+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:00:26.899172+0000","last_peered":"2024-04-23T19:00:26.899172+0000","last_clean":"2024-04-23T19:00:26.899172+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:00:26.899172+0000","last_undegraded":"2024-04-23T19:00:26.899172+0000","last_fullsized":"2024-04-23T19:00:26.899172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":15,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339967+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:00:26.339967+0000","last_peered":"2024-04-23T19:00:26.339967+0000","last_clean":"2024-04-23T19:00:26.339967+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:00:26.339967+0000","last_undegraded":"2024-04-23T19:00:26.339967+0000","last_fullsized":"2024-04-23T19:00:26.339967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319164+0000","last_change":"2024-04-23T19:00:25.337128+0000","last_active":"2024-04-23T19:00:26.319164+0000","last_peered":"2024-04-23T19:00:26.319164+0000","last_clean":"2024-04-23T19:00:26.319164+0000","last_became_active":"2024-04-23T19:00:25.336132+0000","last_became_peered":"2024-04-23T19:00:25.336132+0000","last_unstale":"2024-04-23T19:00:26.319164+0000","last_undegraded":"2024-04-23T19:00:26.319164+0000","last_fullsized":"2024-04-23T19:00:26.319164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:40.547819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341287+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:00:26.341287+0000","last_peered":"2024-04-23T19:00:26.341287+0000","last_clean":"2024-04-23T19:00:26.341287+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:00:26.341287+0000","last_undegraded":"2024-04-23T19:00:26.341287+0000","last_fullsized":"2024-04-23T19:00:26.341287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330921+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:00:26.330921+0000","last_peered":"2024-04-23T19:00:26.330921+0000","last_clean":"2024-04-23T19:00:26.330921+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:00:26.330921+0000","last_undegraded":"2024-04-23T19:00:26.330921+0000","last_fullsized":"2024-04-23T19:00:26.330921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310569+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:00:26.310569+0000","last_peered":"2024-04-23T19:00:26.310569+0000","last_clean":"2024-04-23T19:00:26.310569+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:00:26.310569+0000","last_undegraded":"2024-04-23T19:00:26.310569+0000","last_fullsized":"2024-04-23T19:00:26.310569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311949+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:00:26.311949+0000","last_peered":"2024-04-23T19:00:26.311949+0000","last_clean":"2024-04-23T19:00:26.311949+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:00:26.311949+0000","last_undegraded":"2024-04-23T19:00:26.311949+0000","last_fullsized":"2024-04-23T19:00:26.311949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331929+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:00:26.331929+0000","last_peered":"2024-04-23T19:00:26.331929+0000","last_clean":"2024-04-23T19:00:26.331929+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:00:26.331929+0000","last_undegraded":"2024-04-23T19:00:26.331929+0000","last_fullsized":"2024-04-23T19:00:26.331929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.651759+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:00:26.651759+0000","last_peered":"2024-04-23T19:00:26.651759+0000","last_clean":"2024-04-23T19:00:26.651759+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:00:26.651759+0000","last_undegraded":"2024-04-23T19:00:26.651759+0000","last_fullsized":"2024-04-23T19:00:26.651759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326032+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:00:26.326032+0000","last_peered":"2024-04-23T19:00:26.326032+0000","last_clean":"2024-04-23T19:00:26.326032+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:00:26.326032+0000","last_undegraded":"2024-04-23T19:00:26.326032+0000","last_fullsized":"2024-04-23T19:00:26.326032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339574+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:00:26.339574+0000","last_peered":"2024-04-23T19:00:26.339574+0000","last_clean":"2024-04-23T19:00:26.339574+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:00:26.339574+0000","last_undegraded":"2024-04-23T19:00:26.339574+0000","last_fullsized":"2024-04-23T19:00:26.339574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326377+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:00:26.326377+0000","last_peered":"2024-04-23T19:00:26.326377+0000","last_clean":"2024-04-23T19:00:26.326377+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:00:26.326377+0000","last_undegraded":"2024-04-23T19:00:26.326377+0000","last_fullsized":"2024-04-23T19:00:26.326377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330679+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:00:26.330679+0000","last_peered":"2024-04-23T19:00:26.330679+0000","last_clean":"2024-04-23T19:00:26.330679+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:00:26.330679+0000","last_undegraded":"2024-04-23T19:00:26.330679+0000","last_fullsized":"2024-04-23T19:00:26.330679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322361+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:00:26.322361+0000","last_peered":"2024-04-23T19:00:26.322361+0000","last_clean":"2024-04-23T19:00:26.322361+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:00:26.322361+0000","last_undegraded":"2024-04-23T19:00:26.322361+0000","last_fullsized":"2024-04-23T19:00:26.322361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311580+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:00:26.311580+0000","last_peered":"2024-04-23T19:00:26.311580+0000","last_clean":"2024-04-23T19:00:26.311580+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:00:26.311580+0000","last_undegraded":"2024-04-23T19:00:26.311580+0000","last_fullsized":"2024-04-23T19:00:26.311580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'19","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.806801+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:00:26.806801+0000","last_peered":"2024-04-23T19:00:26.806801+0000","last_clean":"2024-04-23T19:00:26.806801+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:00:26.806801+0000","last_undegraded":"2024-04-23T19:00:26.806801+0000","last_fullsized":"2024-04-23T19:00:26.806801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":23,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332472+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:00:26.332472+0000","last_peered":"2024-04-23T19:00:26.332472+0000","last_clean":"2024-04-23T19:00:26.332472+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:00:26.332472+0000","last_undegraded":"2024-04-23T19:00:26.332472+0000","last_fullsized":"2024-04-23T19:00:26.332472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.318924+0000","last_change":"2024-04-23T19:00:25.337116+0000","last_active":"2024-04-23T19:00:26.318924+0000","last_peered":"2024-04-23T19:00:26.318924+0000","last_clean":"2024-04-23T19:00:26.318924+0000","last_became_active":"2024-04-23T19:00:25.336196+0000","last_became_peered":"2024-04-23T19:00:25.336196+0000","last_unstale":"2024-04-23T19:00:26.318924+0000","last_undegraded":"2024-04-23T19:00:26.318924+0000","last_fullsized":"2024-04-23T19:00:26.318924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:14.525312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322503+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:00:26.322503+0000","last_peered":"2024-04-23T19:00:26.322503+0000","last_clean":"2024-04-23T19:00:26.322503+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:00:26.322503+0000","last_undegraded":"2024-04-23T19:00:26.322503+0000","last_fullsized":"2024-04-23T19:00:26.322503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307730+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:00:26.307730+0000","last_peered":"2024-04-23T19:00:26.307730+0000","last_clean":"2024-04-23T19:00:26.307730+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:00:26.307730+0000","last_undegraded":"2024-04-23T19:00:26.307730+0000","last_fullsized":"2024-04-23T19:00:26.307730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319614+0000","last_change":"2024-04-23T19:00:15.254230+0000","last_active":"2024-04-23T19:00:26.319614+0000","last_peered":"2024-04-23T19:00:26.319614+0000","last_clean":"2024-04-23T19:00:26.319614+0000","last_became_active":"2024-04-23T19:00:15.253857+0000","last_became_peered":"2024-04-23T19:00:15.253857+0000","last_unstale":"2024-04-23T19:00:26.319614+0000","last_undegraded":"2024-04-23T19:00:26.319614+0000","last_fullsized":"2024-04-23T19:00:26.319614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310512+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:00:26.310512+0000","last_peered":"2024-04-23T19:00:26.310512+0000","last_clean":"2024-04-23T19:00:26.310512+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:00:26.310512+0000","last_undegraded":"2024-04-23T19:00:26.310512+0000","last_fullsized":"2024-04-23T19:00:26.310512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.778400+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:00:26.778400+0000","last_peered":"2024-04-23T19:00:26.778400+0000","last_clean":"2024-04-23T19:00:26.778400+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:00:26.778400+0000","last_undegraded":"2024-04-23T19:00:26.778400+0000","last_fullsized":"2024-04-23T19:00:26.778400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":9,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.324924+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:00:26.324924+0000","last_peered":"2024-04-23T19:00:26.324924+0000","last_clean":"2024-04-23T19:00:26.324924+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:00:26.324924+0000","last_undegraded":"2024-04-23T19:00:26.324924+0000","last_fullsized":"2024-04-23T19:00:26.324924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313504+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:00:26.313504+0000","last_peered":"2024-04-23T19:00:26.313504+0000","last_clean":"2024-04-23T19:00:26.313504+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:00:26.313504+0000","last_undegraded":"2024-04-23T19:00:26.313504+0000","last_fullsized":"2024-04-23T19:00:26.313504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319853+0000","last_change":"2024-04-23T19:00:17.298132+0000","last_active":"2024-04-23T19:00:26.319853+0000","last_peered":"2024-04-23T19:00:26.319853+0000","last_clean":"2024-04-23T19:00:26.319853+0000","last_became_active":"2024-04-23T19:00:17.297866+0000","last_became_peered":"2024-04-23T19:00:17.297866+0000","last_unstale":"2024-04-23T19:00:26.319853+0000","last_undegraded":"2024-04-23T19:00:26.319853+0000","last_fullsized":"2024-04-23T19:00:26.319853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310869+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:00:26.310869+0000","last_peered":"2024-04-23T19:00:26.310869+0000","last_clean":"2024-04-23T19:00:26.310869+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:00:26.310869+0000","last_undegraded":"2024-04-23T19:00:26.310869+0000","last_fullsized":"2024-04-23T19:00:26.310869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348238+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:00:26.348238+0000","last_peered":"2024-04-23T19:00:26.348238+0000","last_clean":"2024-04-23T19:00:26.348238+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:00:26.348238+0000","last_undegraded":"2024-04-23T19:00:26.348238+0000","last_fullsized":"2024-04-23T19:00:26.348238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325238+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:00:26.325238+0000","last_peered":"2024-04-23T19:00:26.325238+0000","last_clean":"2024-04-23T19:00:26.325238+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:00:26.325238+0000","last_undegraded":"2024-04-23T19:00:26.325238+0000","last_fullsized":"2024-04-23T19:00:26.325238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.855355+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:00:26.855355+0000","last_peered":"2024-04-23T19:00:26.855355+0000","last_clean":"2024-04-23T19:00:26.855355+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:00:26.855355+0000","last_undegraded":"2024-04-23T19:00:26.855355+0000","last_fullsized":"2024-04-23T19:00:26.855355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341383+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:00:26.341383+0000","last_peered":"2024-04-23T19:00:26.341383+0000","last_clean":"2024-04-23T19:00:26.341383+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:00:26.341383+0000","last_undegraded":"2024-04-23T19:00:26.341383+0000","last_fullsized":"2024-04-23T19:00:26.341383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309179+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:00:26.309179+0000","last_peered":"2024-04-23T19:00:26.309179+0000","last_clean":"2024-04-23T19:00:26.309179+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:00:26.309179+0000","last_undegraded":"2024-04-23T19:00:26.309179+0000","last_fullsized":"2024-04-23T19:00:26.309179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321073+0000","last_change":"2024-04-23T19:00:17.323700+0000","last_active":"2024-04-23T19:00:26.321073+0000","last_peered":"2024-04-23T19:00:26.321073+0000","last_clean":"2024-04-23T19:00:26.321073+0000","last_became_active":"2024-04-23T19:00:17.323443+0000","last_became_peered":"2024-04-23T19:00:17.323443+0000","last_unstale":"2024-04-23T19:00:26.321073+0000","last_undegraded":"2024-04-23T19:00:26.321073+0000","last_fullsized":"2024-04-23T19:00:26.321073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311967+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:00:26.311967+0000","last_peered":"2024-04-23T19:00:26.311967+0000","last_clean":"2024-04-23T19:00:26.311967+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:00:26.311967+0000","last_undegraded":"2024-04-23T19:00:26.311967+0000","last_fullsized":"2024-04-23T19:00:26.311967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320381+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:00:26.320381+0000","last_peered":"2024-04-23T19:00:26.320381+0000","last_clean":"2024-04-23T19:00:26.320381+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:00:26.320381+0000","last_undegraded":"2024-04-23T19:00:26.320381+0000","last_fullsized":"2024-04-23T19:00:26.320381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323660+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:00:26.323660+0000","last_peered":"2024-04-23T19:00:26.323660+0000","last_clean":"2024-04-23T19:00:26.323660+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:00:26.323660+0000","last_undegraded":"2024-04-23T19:00:26.323660+0000","last_fullsized":"2024-04-23T19:00:26.323660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.887476+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:00:26.887476+0000","last_peered":"2024-04-23T19:00:26.887476+0000","last_clean":"2024-04-23T19:00:26.887476+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:00:26.887476+0000","last_undegraded":"2024-04-23T19:00:26.887476+0000","last_fullsized":"2024-04-23T19:00:26.887476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":16,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346094+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:00:26.346094+0000","last_peered":"2024-04-23T19:00:26.346094+0000","last_clean":"2024-04-23T19:00:26.346094+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:00:26.346094+0000","last_undegraded":"2024-04-23T19:00:26.346094+0000","last_fullsized":"2024-04-23T19:00:26.346094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325640+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:00:26.325640+0000","last_peered":"2024-04-23T19:00:26.325640+0000","last_clean":"2024-04-23T19:00:26.325640+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:00:26.325640+0000","last_undegraded":"2024-04-23T19:00:26.325640+0000","last_fullsized":"2024-04-23T19:00:26.325640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.324600+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:00:26.324600+0000","last_peered":"2024-04-23T19:00:26.324600+0000","last_clean":"2024-04-23T19:00:26.324600+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:00:26.324600+0000","last_undegraded":"2024-04-23T19:00:26.324600+0000","last_fullsized":"2024-04-23T19:00:26.324600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320139+0000","last_change":"2024-04-23T19:00:15.252825+0000","last_active":"2024-04-23T19:00:26.320139+0000","last_peered":"2024-04-23T19:00:26.320139+0000","last_clean":"2024-04-23T19:00:26.320139+0000","last_became_active":"2024-04-23T19:00:15.247413+0000","last_became_peered":"2024-04-23T19:00:15.247413+0000","last_unstale":"2024-04-23T19:00:26.320139+0000","last_undegraded":"2024-04-23T19:00:26.320139+0000","last_fullsized":"2024-04-23T19:00:26.320139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333431+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:00:26.333431+0000","last_peered":"2024-04-23T19:00:26.333431+0000","last_clean":"2024-04-23T19:00:26.333431+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:00:26.333431+0000","last_undegraded":"2024-04-23T19:00:26.333431+0000","last_fullsized":"2024-04-23T19:00:26.333431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340026+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:00:26.340026+0000","last_peered":"2024-04-23T19:00:26.340026+0000","last_clean":"2024-04-23T19:00:26.340026+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:00:26.340026+0000","last_undegraded":"2024-04-23T19:00:26.340026+0000","last_fullsized":"2024-04-23T19:00:26.340026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.908673+0000","last_change":"2024-04-23T19:00:21.313162+0000","last_active":"2024-04-23T19:00:26.908673+0000","last_peered":"2024-04-23T19:00:26.908673+0000","last_clean":"2024-04-23T19:00:26.908673+0000","last_became_active":"2024-04-23T19:00:21.312313+0000","last_became_peered":"2024-04-23T19:00:21.312313+0000","last_unstale":"2024-04-23T19:00:26.908673+0000","last_undegraded":"2024-04-23T19:00:26.908673+0000","last_fullsized":"2024-04-23T19:00:26.908673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:05.309099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311767+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:00:26.311767+0000","last_peered":"2024-04-23T19:00:26.311767+0000","last_clean":"2024-04-23T19:00:26.311767+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:00:26.311767+0000","last_undegraded":"2024-04-23T19:00:26.311767+0000","last_fullsized":"2024-04-23T19:00:26.311767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314138+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:00:26.314138+0000","last_peered":"2024-04-23T19:00:26.314138+0000","last_clean":"2024-04-23T19:00:26.314138+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:00:26.314138+0000","last_undegraded":"2024-04-23T19:00:26.314138+0000","last_fullsized":"2024-04-23T19:00:26.314138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310529+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:00:26.310529+0000","last_peered":"2024-04-23T19:00:26.310529+0000","last_clean":"2024-04-23T19:00:26.310529+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:00:26.310529+0000","last_undegraded":"2024-04-23T19:00:26.310529+0000","last_fullsized":"2024-04-23T19:00:26.310529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313120+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:00:26.313120+0000","last_peered":"2024-04-23T19:00:26.313120+0000","last_clean":"2024-04-23T19:00:26.313120+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:00:26.313120+0000","last_undegraded":"2024-04-23T19:00:26.313120+0000","last_fullsized":"2024-04-23T19:00:26.313120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321385+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:00:26.321385+0000","last_peered":"2024-04-23T19:00:26.321385+0000","last_clean":"2024-04-23T19:00:26.321385+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:00:26.321385+0000","last_undegraded":"2024-04-23T19:00:26.321385+0000","last_fullsized":"2024-04-23T19:00:26.321385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346223+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:00:26.346223+0000","last_peered":"2024-04-23T19:00:26.346223+0000","last_clean":"2024-04-23T19:00:26.346223+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:00:26.346223+0000","last_undegraded":"2024-04-23T19:00:26.346223+0000","last_fullsized":"2024-04-23T19:00:26.346223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.574119+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:00:26.574119+0000","last_peered":"2024-04-23T19:00:26.574119+0000","last_clean":"2024-04-23T19:00:26.574119+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:00:26.574119+0000","last_undegraded":"2024-04-23T19:00:26.574119+0000","last_fullsized":"2024-04-23T19:00:26.574119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314164+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:00:26.314164+0000","last_peered":"2024-04-23T19:00:26.314164+0000","last_clean":"2024-04-23T19:00:26.314164+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:00:26.314164+0000","last_undegraded":"2024-04-23T19:00:26.314164+0000","last_fullsized":"2024-04-23T19:00:26.314164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.325240+0000","last_change":"2024-04-23T19:00:25.339039+0000","last_active":"2024-04-23T19:00:26.325240+0000","last_peered":"2024-04-23T19:00:26.325240+0000","last_clean":"2024-04-23T19:00:26.325240+0000","last_became_active":"2024-04-23T19:00:25.337875+0000","last_became_peered":"2024-04-23T19:00:25.337875+0000","last_unstale":"2024-04-23T19:00:26.325240+0000","last_undegraded":"2024-04-23T19:00:26.325240+0000","last_fullsized":"2024-04-23T19:00:26.325240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346478+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:00:26.346478+0000","last_peered":"2024-04-23T19:00:26.346478+0000","last_clean":"2024-04-23T19:00:26.346478+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:00:26.346478+0000","last_undegraded":"2024-04-23T19:00:26.346478+0000","last_fullsized":"2024-04-23T19:00:26.346478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326624+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:00:26.326624+0000","last_peered":"2024-04-23T19:00:26.326624+0000","last_clean":"2024-04-23T19:00:26.326624+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:00:26.326624+0000","last_undegraded":"2024-04-23T19:00:26.326624+0000","last_fullsized":"2024-04-23T19:00:26.326624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341699+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:00:26.341699+0000","last_peered":"2024-04-23T19:00:26.341699+0000","last_clean":"2024-04-23T19:00:26.341699+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:00:26.341699+0000","last_undegraded":"2024-04-23T19:00:26.341699+0000","last_fullsized":"2024-04-23T19:00:26.341699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310285+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:00:26.310285+0000","last_peered":"2024-04-23T19:00:26.310285+0000","last_clean":"2024-04-23T19:00:26.310285+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:00:26.310285+0000","last_undegraded":"2024-04-23T19:00:26.310285+0000","last_fullsized":"2024-04-23T19:00:26.310285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'15","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.818494+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:00:26.818494+0000","last_peered":"2024-04-23T19:00:26.818494+0000","last_clean":"2024-04-23T19:00:26.818494+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:00:26.818494+0000","last_undegraded":"2024-04-23T19:00:26.818494+0000","last_fullsized":"2024-04-23T19:00:26.818494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":21,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311640+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:00:26.311640+0000","last_peered":"2024-04-23T19:00:26.311640+0000","last_clean":"2024-04-23T19:00:26.311640+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:00:26.311640+0000","last_undegraded":"2024-04-23T19:00:26.311640+0000","last_fullsized":"2024-04-23T19:00:26.311640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312148+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:00:26.312148+0000","last_peered":"2024-04-23T19:00:26.312148+0000","last_clean":"2024-04-23T19:00:26.312148+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:00:26.312148+0000","last_undegraded":"2024-04-23T19:00:26.312148+0000","last_fullsized":"2024-04-23T19:00:26.312148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327223+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:00:26.327223+0000","last_peered":"2024-04-23T19:00:26.327223+0000","last_clean":"2024-04-23T19:00:26.327223+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:00:26.327223+0000","last_undegraded":"2024-04-23T19:00:26.327223+0000","last_fullsized":"2024-04-23T19:00:26.327223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347442+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:00:26.347442+0000","last_peered":"2024-04-23T19:00:26.347442+0000","last_clean":"2024-04-23T19:00:26.347442+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:00:26.347442+0000","last_undegraded":"2024-04-23T19:00:26.347442+0000","last_fullsized":"2024-04-23T19:00:26.347442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347076+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:00:26.347076+0000","last_peered":"2024-04-23T19:00:26.347076+0000","last_clean":"2024-04-23T19:00:26.347076+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:00:26.347076+0000","last_undegraded":"2024-04-23T19:00:26.347076+0000","last_fullsized":"2024-04-23T19:00:26.347076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320599+0000","last_change":"2024-04-23T19:00:19.302914+0000","last_active":"2024-04-23T19:00:26.320599+0000","last_peered":"2024-04-23T19:00:26.320599+0000","last_clean":"2024-04-23T19:00:26.320599+0000","last_became_active":"2024-04-23T19:00:19.302271+0000","last_became_peered":"2024-04-23T19:00:19.302271+0000","last_unstale":"2024-04-23T19:00:26.320599+0000","last_undegraded":"2024-04-23T19:00:26.320599+0000","last_fullsized":"2024-04-23T19:00:26.320599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:39.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.665010+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:00:26.665010+0000","last_peered":"2024-04-23T19:00:26.665010+0000","last_clean":"2024-04-23T19:00:26.665010+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:00:26.665010+0000","last_undegraded":"2024-04-23T19:00:26.665010+0000","last_fullsized":"2024-04-23T19:00:26.665010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310153+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:00:26.310153+0000","last_peered":"2024-04-23T19:00:26.310153+0000","last_clean":"2024-04-23T19:00:26.310153+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:00:26.310153+0000","last_undegraded":"2024-04-23T19:00:26.310153+0000","last_fullsized":"2024-04-23T19:00:26.310153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312904+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:00:26.312904+0000","last_peered":"2024-04-23T19:00:26.312904+0000","last_clean":"2024-04-23T19:00:26.312904+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:00:26.312904+0000","last_undegraded":"2024-04-23T19:00:26.312904+0000","last_fullsized":"2024-04-23T19:00:26.312904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319368+0000","last_change":"2024-04-23T19:00:17.321501+0000","last_active":"2024-04-23T19:00:26.319368+0000","last_peered":"2024-04-23T19:00:26.319368+0000","last_clean":"2024-04-23T19:00:26.319368+0000","last_became_active":"2024-04-23T19:00:17.321203+0000","last_became_peered":"2024-04-23T19:00:17.321203+0000","last_unstale":"2024-04-23T19:00:26.319368+0000","last_undegraded":"2024-04-23T19:00:26.319368+0000","last_fullsized":"2024-04-23T19:00:26.319368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333084+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:00:26.333084+0000","last_peered":"2024-04-23T19:00:26.333084+0000","last_clean":"2024-04-23T19:00:26.333084+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:00:26.333084+0000","last_undegraded":"2024-04-23T19:00:26.333084+0000","last_fullsized":"2024-04-23T19:00:26.333084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312535+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:00:26.312535+0000","last_peered":"2024-04-23T19:00:26.312535+0000","last_clean":"2024-04-23T19:00:26.312535+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:00:26.312535+0000","last_undegraded":"2024-04-23T19:00:26.312535+0000","last_fullsized":"2024-04-23T19:00:26.312535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.687487+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:00:26.687487+0000","last_peered":"2024-04-23T19:00:26.687487+0000","last_clean":"2024-04-23T19:00:26.687487+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:00:26.687487+0000","last_undegraded":"2024-04-23T19:00:26.687487+0000","last_fullsized":"2024-04-23T19:00:26.687487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331021+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:00:26.331021+0000","last_peered":"2024-04-23T19:00:26.331021+0000","last_clean":"2024-04-23T19:00:26.331021+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:00:26.331021+0000","last_undegraded":"2024-04-23T19:00:26.331021+0000","last_fullsized":"2024-04-23T19:00:26.331021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322734+0000","last_change":"2024-04-23T19:00:25.342813+0000","last_active":"2024-04-23T19:00:26.322734+0000","last_peered":"2024-04-23T19:00:26.322734+0000","last_clean":"2024-04-23T19:00:26.322734+0000","last_became_active":"2024-04-23T19:00:25.342143+0000","last_became_peered":"2024-04-23T19:00:25.342143+0000","last_unstale":"2024-04-23T19:00:26.322734+0000","last_undegraded":"2024-04-23T19:00:26.322734+0000","last_fullsized":"2024-04-23T19:00:26.322734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310609+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:00:26.310609+0000","last_peered":"2024-04-23T19:00:26.310609+0000","last_clean":"2024-04-23T19:00:26.310609+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:00:26.310609+0000","last_undegraded":"2024-04-23T19:00:26.310609+0000","last_fullsized":"2024-04-23T19:00:26.310609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311877+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:00:26.311877+0000","last_peered":"2024-04-23T19:00:26.311877+0000","last_clean":"2024-04-23T19:00:26.311877+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:00:26.311877+0000","last_undegraded":"2024-04-23T19:00:26.311877+0000","last_fullsized":"2024-04-23T19:00:26.311877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330117+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:00:26.330117+0000","last_peered":"2024-04-23T19:00:26.330117+0000","last_clean":"2024-04-23T19:00:26.330117+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:00:26.330117+0000","last_undegraded":"2024-04-23T19:00:26.330117+0000","last_fullsized":"2024-04-23T19:00:26.330117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.760933+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:00:26.760933+0000","last_peered":"2024-04-23T19:00:26.760933+0000","last_clean":"2024-04-23T19:00:26.760933+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:00:26.760933+0000","last_undegraded":"2024-04-23T19:00:26.760933+0000","last_fullsized":"2024-04-23T19:00:26.760933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340142+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:00:26.340142+0000","last_peered":"2024-04-23T19:00:26.340142+0000","last_clean":"2024-04-23T19:00:26.340142+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:00:26.340142+0000","last_undegraded":"2024-04-23T19:00:26.340142+0000","last_fullsized":"2024-04-23T19:00:26.340142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311043+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:00:26.311043+0000","last_peered":"2024-04-23T19:00:26.311043+0000","last_clean":"2024-04-23T19:00:26.311043+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:00:26.311043+0000","last_undegraded":"2024-04-23T19:00:26.311043+0000","last_fullsized":"2024-04-23T19:00:26.311043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310786+0000","last_change":"2024-04-23T19:00:17.291645+0000","last_active":"2024-04-23T19:00:26.310786+0000","last_peered":"2024-04-23T19:00:26.310786+0000","last_clean":"2024-04-23T19:00:26.310786+0000","last_became_active":"2024-04-23T19:00:17.291365+0000","last_became_peered":"2024-04-23T19:00:17.291365+0000","last_unstale":"2024-04-23T19:00:26.310786+0000","last_undegraded":"2024-04-23T19:00:26.310786+0000","last_fullsized":"2024-04-23T19:00:26.310786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327647+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:00:26.327647+0000","last_peered":"2024-04-23T19:00:26.327647+0000","last_clean":"2024-04-23T19:00:26.327647+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:00:26.327647+0000","last_undegraded":"2024-04-23T19:00:26.327647+0000","last_fullsized":"2024-04-23T19:00:26.327647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339964+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:00:26.339964+0000","last_peered":"2024-04-23T19:00:26.339964+0000","last_clean":"2024-04-23T19:00:26.339964+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:00:26.339964+0000","last_undegraded":"2024-04-23T19:00:26.339964+0000","last_fullsized":"2024-04-23T19:00:26.339964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.891657+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:00:26.891657+0000","last_peered":"2024-04-23T19:00:26.891657+0000","last_clean":"2024-04-23T19:00:26.891657+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:00:26.891657+0000","last_undegraded":"2024-04-23T19:00:26.891657+0000","last_fullsized":"2024-04-23T19:00:26.891657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322819+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:00:26.322819+0000","last_peered":"2024-04-23T19:00:26.322819+0000","last_clean":"2024-04-23T19:00:26.322819+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:00:26.322819+0000","last_undegraded":"2024-04-23T19:00:26.322819+0000","last_fullsized":"2024-04-23T19:00:26.322819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341563+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:00:26.341563+0000","last_peered":"2024-04-23T19:00:26.341563+0000","last_clean":"2024-04-23T19:00:26.341563+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:00:26.341563+0000","last_undegraded":"2024-04-23T19:00:26.341563+0000","last_fullsized":"2024-04-23T19:00:26.341563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311028+0000","last_change":"2024-04-23T19:00:15.256663+0000","last_active":"2024-04-23T19:00:26.311028+0000","last_peered":"2024-04-23T19:00:26.311028+0000","last_clean":"2024-04-23T19:00:26.311028+0000","last_became_active":"2024-04-23T19:00:15.256378+0000","last_became_peered":"2024-04-23T19:00:15.256378+0000","last_unstale":"2024-04-23T19:00:26.311028+0000","last_undegraded":"2024-04-23T19:00:26.311028+0000","last_fullsized":"2024-04-23T19:00:26.311028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326150+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:00:26.326150+0000","last_peered":"2024-04-23T19:00:26.326150+0000","last_clean":"2024-04-23T19:00:26.326150+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:00:26.326150+0000","last_undegraded":"2024-04-23T19:00:26.326150+0000","last_fullsized":"2024-04-23T19:00:26.326150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.599831+0000","last_change":"2024-04-23T19:00:21.317917+0000","last_active":"2024-04-23T19:00:26.599831+0000","last_peered":"2024-04-23T19:00:26.599831+0000","last_clean":"2024-04-23T19:00:26.599831+0000","last_became_active":"2024-04-23T19:00:21.317050+0000","last_became_peered":"2024-04-23T19:00:21.317050+0000","last_unstale":"2024-04-23T19:00:26.599831+0000","last_undegraded":"2024-04-23T19:00:26.599831+0000","last_fullsized":"2024-04-23T19:00:26.599831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:14.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311283+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:00:26.311283+0000","last_peered":"2024-04-23T19:00:26.311283+0000","last_clean":"2024-04-23T19:00:26.311283+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:00:26.311283+0000","last_undegraded":"2024-04-23T19:00:26.311283+0000","last_fullsized":"2024-04-23T19:00:26.311283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312089+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:00:26.312089+0000","last_peered":"2024-04-23T19:00:26.312089+0000","last_clean":"2024-04-23T19:00:26.312089+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:00:26.312089+0000","last_undegraded":"2024-04-23T19:00:26.312089+0000","last_fullsized":"2024-04-23T19:00:26.312089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.326290+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:00:26.326290+0000","last_peered":"2024-04-23T19:00:26.326290+0000","last_clean":"2024-04-23T19:00:26.326290+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:00:26.326290+0000","last_undegraded":"2024-04-23T19:00:26.326290+0000","last_fullsized":"2024-04-23T19:00:26.326290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319712+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:00:26.319712+0000","last_peered":"2024-04-23T19:00:26.319712+0000","last_clean":"2024-04-23T19:00:26.319712+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:00:26.319712+0000","last_undegraded":"2024-04-23T19:00:26.319712+0000","last_fullsized":"2024-04-23T19:00:26.319712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341429+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:00:26.341429+0000","last_peered":"2024-04-23T19:00:26.341429+0000","last_clean":"2024-04-23T19:00:26.341429+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:00:26.341429+0000","last_undegraded":"2024-04-23T19:00:26.341429+0000","last_fullsized":"2024-04-23T19:00:26.341429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.692507+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:00:26.692507+0000","last_peered":"2024-04-23T19:00:26.692507+0000","last_clean":"2024-04-23T19:00:26.692507+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:00:26.692507+0000","last_undegraded":"2024-04-23T19:00:26.692507+0000","last_fullsized":"2024-04-23T19:00:26.692507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319960+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:00:26.319960+0000","last_peered":"2024-04-23T19:00:26.319960+0000","last_clean":"2024-04-23T19:00:26.319960+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:00:26.319960+0000","last_undegraded":"2024-04-23T19:00:26.319960+0000","last_fullsized":"2024-04-23T19:00:26.319960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339845+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:00:26.339845+0000","last_peered":"2024-04-23T19:00:26.339845+0000","last_clean":"2024-04-23T19:00:26.339845+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:00:26.339845+0000","last_undegraded":"2024-04-23T19:00:26.339845+0000","last_fullsized":"2024-04-23T19:00:26.339845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312943+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:00:26.312943+0000","last_peered":"2024-04-23T19:00:26.312943+0000","last_clean":"2024-04-23T19:00:26.312943+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:00:26.312943+0000","last_undegraded":"2024-04-23T19:00:26.312943+0000","last_fullsized":"2024-04-23T19:00:26.312943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348388+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:00:26.348388+0000","last_peered":"2024-04-23T19:00:26.348388+0000","last_clean":"2024-04-23T19:00:26.348388+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:00:26.348388+0000","last_undegraded":"2024-04-23T19:00:26.348388+0000","last_fullsized":"2024-04-23T19:00:26.348388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348073+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:00:26.348073+0000","last_peered":"2024-04-23T19:00:26.348073+0000","last_clean":"2024-04-23T19:00:26.348073+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:00:26.348073+0000","last_undegraded":"2024-04-23T19:00:26.348073+0000","last_fullsized":"2024-04-23T19:00:26.348073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.700075+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:00:26.700075+0000","last_peered":"2024-04-23T19:00:26.700075+0000","last_clean":"2024-04-23T19:00:26.700075+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:00:26.700075+0000","last_undegraded":"2024-04-23T19:00:26.700075+0000","last_fullsized":"2024-04-23T19:00:26.700075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320791+0000","last_change":"2024-04-23T19:00:23.344133+0000","last_active":"2024-04-23T19:00:26.320791+0000","last_peered":"2024-04-23T19:00:26.320791+0000","last_clean":"2024-04-23T19:00:26.320791+0000","last_became_active":"2024-04-23T19:00:23.343020+0000","last_became_peered":"2024-04-23T19:00:23.343020+0000","last_unstale":"2024-04-23T19:00:26.320791+0000","last_undegraded":"2024-04-23T19:00:26.320791+0000","last_fullsized":"2024-04-23T19:00:26.320791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:16.330420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311051+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:00:26.311051+0000","last_peered":"2024-04-23T19:00:26.311051+0000","last_clean":"2024-04-23T19:00:26.311051+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:00:26.311051+0000","last_undegraded":"2024-04-23T19:00:26.311051+0000","last_fullsized":"2024-04-23T19:00:26.311051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309161+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:00:26.309161+0000","last_peered":"2024-04-23T19:00:26.309161+0000","last_clean":"2024-04-23T19:00:26.309161+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:00:26.309161+0000","last_undegraded":"2024-04-23T19:00:26.309161+0000","last_fullsized":"2024-04-23T19:00:26.309161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322943+0000","last_change":"2024-04-23T19:00:15.277198+0000","last_active":"2024-04-23T19:00:26.322943+0000","last_peered":"2024-04-23T19:00:26.322943+0000","last_clean":"2024-04-23T19:00:26.322943+0000","last_became_active":"2024-04-23T19:00:15.276676+0000","last_became_peered":"2024-04-23T19:00:15.276676+0000","last_unstale":"2024-04-23T19:00:26.322943+0000","last_undegraded":"2024-04-23T19:00:26.322943+0000","last_fullsized":"2024-04-23T19:00:26.322943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320346+0000","last_change":"2024-04-23T19:00:19.306559+0000","last_active":"2024-04-23T19:00:26.320346+0000","last_peered":"2024-04-23T19:00:26.320346+0000","last_clean":"2024-04-23T19:00:26.320346+0000","last_became_active":"2024-04-23T19:00:19.305854+0000","last_became_peered":"2024-04-23T19:00:19.305854+0000","last_unstale":"2024-04-23T19:00:26.320346+0000","last_undegraded":"2024-04-23T19:00:26.320346+0000","last_fullsized":"2024-04-23T19:00:26.320346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.859985+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:00:26.859985+0000","last_peered":"2024-04-23T19:00:26.859985+0000","last_clean":"2024-04-23T19:00:26.859985+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:00:26.859985+0000","last_undegraded":"2024-04-23T19:00:26.859985+0000","last_fullsized":"2024-04-23T19:00:26.859985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341276+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:00:26.341276+0000","last_peered":"2024-04-23T19:00:26.341276+0000","last_clean":"2024-04-23T19:00:26.341276+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:00:26.341276+0000","last_undegraded":"2024-04-23T19:00:26.341276+0000","last_fullsized":"2024-04-23T19:00:26.341276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330444+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:00:26.330444+0000","last_peered":"2024-04-23T19:00:26.330444+0000","last_clean":"2024-04-23T19:00:26.330444+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:00:26.330444+0000","last_undegraded":"2024-04-23T19:00:26.330444+0000","last_fullsized":"2024-04-23T19:00:26.330444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347185+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:00:26.347185+0000","last_peered":"2024-04-23T19:00:26.347185+0000","last_clean":"2024-04-23T19:00:26.347185+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:00:26.347185+0000","last_undegraded":"2024-04-23T19:00:26.347185+0000","last_fullsized":"2024-04-23T19:00:26.347185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311812+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:00:26.311812+0000","last_peered":"2024-04-23T19:00:26.311812+0000","last_clean":"2024-04-23T19:00:26.311812+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:00:26.311812+0000","last_undegraded":"2024-04-23T19:00:26.311812+0000","last_fullsized":"2024-04-23T19:00:26.311812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331174+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:00:26.331174+0000","last_peered":"2024-04-23T19:00:26.331174+0000","last_clean":"2024-04-23T19:00:26.331174+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:00:26.331174+0000","last_undegraded":"2024-04-23T19:00:26.331174+0000","last_fullsized":"2024-04-23T19:00:26.331174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.839602+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:00:26.839602+0000","last_peered":"2024-04-23T19:00:26.839602+0000","last_clean":"2024-04-23T19:00:26.839602+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:00:26.839602+0000","last_undegraded":"2024-04-23T19:00:26.839602+0000","last_fullsized":"2024-04-23T19:00:26.839602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321701+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:00:26.321701+0000","last_peered":"2024-04-23T19:00:26.321701+0000","last_clean":"2024-04-23T19:00:26.321701+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:00:26.321701+0000","last_undegraded":"2024-04-23T19:00:26.321701+0000","last_fullsized":"2024-04-23T19:00:26.321701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333638+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:00:26.333638+0000","last_peered":"2024-04-23T19:00:26.333638+0000","last_clean":"2024-04-23T19:00:26.333638+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:00:26.333638+0000","last_undegraded":"2024-04-23T19:00:26.333638+0000","last_fullsized":"2024-04-23T19:00:26.333638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347708+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:00:26.347708+0000","last_peered":"2024-04-23T19:00:26.347708+0000","last_clean":"2024-04-23T19:00:26.347708+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:00:26.347708+0000","last_undegraded":"2024-04-23T19:00:26.347708+0000","last_fullsized":"2024-04-23T19:00:26.347708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311718+0000","last_change":"2024-04-23T19:00:15.264129+0000","last_active":"2024-04-23T19:00:26.311718+0000","last_peered":"2024-04-23T19:00:26.311718+0000","last_clean":"2024-04-23T19:00:26.311718+0000","last_became_active":"2024-04-23T19:00:15.263412+0000","last_became_peered":"2024-04-23T19:00:15.263412+0000","last_unstale":"2024-04-23T19:00:26.311718+0000","last_undegraded":"2024-04-23T19:00:26.311718+0000","last_fullsized":"2024-04-23T19:00:26.311718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:02.135753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310179+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:00:26.310179+0000","last_peered":"2024-04-23T19:00:26.310179+0000","last_clean":"2024-04-23T19:00:26.310179+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:00:26.310179+0000","last_undegraded":"2024-04-23T19:00:26.310179+0000","last_fullsized":"2024-04-23T19:00:26.310179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.633206+0000","last_change":"2024-04-23T19:00:21.320263+0000","last_active":"2024-04-23T19:00:26.633206+0000","last_peered":"2024-04-23T19:00:26.633206+0000","last_clean":"2024-04-23T19:00:26.633206+0000","last_became_active":"2024-04-23T19:00:21.319483+0000","last_became_peered":"2024-04-23T19:00:21.319483+0000","last_unstale":"2024-04-23T19:00:26.633206+0000","last_undegraded":"2024-04-23T19:00:26.633206+0000","last_fullsized":"2024-04-23T19:00:26.633206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:49.400487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339605+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:00:26.339605+0000","last_peered":"2024-04-23T19:00:26.339605+0000","last_clean":"2024-04-23T19:00:26.339605+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:00:26.339605+0000","last_undegraded":"2024-04-23T19:00:26.339605+0000","last_fullsized":"2024-04-23T19:00:26.339605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312964+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:00:26.312964+0000","last_peered":"2024-04-23T19:00:26.312964+0000","last_clean":"2024-04-23T19:00:26.312964+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:00:26.312964+0000","last_undegraded":"2024-04-23T19:00:26.312964+0000","last_fullsized":"2024-04-23T19:00:26.312964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310845+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:00:26.310845+0000","last_peered":"2024-04-23T19:00:26.310845+0000","last_clean":"2024-04-23T19:00:26.310845+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:00:26.310845+0000","last_undegraded":"2024-04-23T19:00:26.310845+0000","last_fullsized":"2024-04-23T19:00:26.310845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313406+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:00:26.313406+0000","last_peered":"2024-04-23T19:00:26.313406+0000","last_clean":"2024-04-23T19:00:26.313406+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:00:26.313406+0000","last_undegraded":"2024-04-23T19:00:26.313406+0000","last_fullsized":"2024-04-23T19:00:26.313406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.345815+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:00:26.345815+0000","last_peered":"2024-04-23T19:00:26.345815+0000","last_clean":"2024-04-23T19:00:26.345815+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:00:26.345815+0000","last_undegraded":"2024-04-23T19:00:26.345815+0000","last_fullsized":"2024-04-23T19:00:26.345815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.868085+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:00:26.868085+0000","last_peered":"2024-04-23T19:00:26.868085+0000","last_clean":"2024-04-23T19:00:26.868085+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:00:26.868085+0000","last_undegraded":"2024-04-23T19:00:26.868085+0000","last_fullsized":"2024-04-23T19:00:26.868085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346341+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:00:26.346341+0000","last_peered":"2024-04-23T19:00:26.346341+0000","last_clean":"2024-04-23T19:00:26.346341+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:00:26.346341+0000","last_undegraded":"2024-04-23T19:00:26.346341+0000","last_fullsized":"2024-04-23T19:00:26.346341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.332888+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:00:26.332888+0000","last_peered":"2024-04-23T19:00:26.332888+0000","last_clean":"2024-04-23T19:00:26.332888+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:00:26.332888+0000","last_undegraded":"2024-04-23T19:00:26.332888+0000","last_fullsized":"2024-04-23T19:00:26.332888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346251+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:00:26.346251+0000","last_peered":"2024-04-23T19:00:26.346251+0000","last_clean":"2024-04-23T19:00:26.346251+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:00:26.346251+0000","last_undegraded":"2024-04-23T19:00:26.346251+0000","last_fullsized":"2024-04-23T19:00:26.346251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327637+0000","last_change":"2024-04-23T19:00:15.291304+0000","last_active":"2024-04-23T19:00:26.327637+0000","last_peered":"2024-04-23T19:00:26.327637+0000","last_clean":"2024-04-23T19:00:26.327637+0000","last_became_active":"2024-04-23T19:00:15.290254+0000","last_became_peered":"2024-04-23T19:00:15.290254+0000","last_unstale":"2024-04-23T19:00:26.327637+0000","last_undegraded":"2024-04-23T19:00:26.327637+0000","last_fullsized":"2024-04-23T19:00:26.327637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.318594+0000","last_change":"2024-04-23T19:00:19.302840+0000","last_active":"2024-04-23T19:00:26.318594+0000","last_peered":"2024-04-23T19:00:26.318594+0000","last_clean":"2024-04-23T19:00:26.318594+0000","last_became_active":"2024-04-23T19:00:19.302069+0000","last_became_peered":"2024-04-23T19:00:19.302069+0000","last_unstale":"2024-04-23T19:00:26.318594+0000","last_undegraded":"2024-04-23T19:00:26.318594+0000","last_fullsized":"2024-04-23T19:00:26.318594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:15.157506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.638930+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:00:26.638930+0000","last_peered":"2024-04-23T19:00:26.638930+0000","last_clean":"2024-04-23T19:00:26.638930+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:00:26.638930+0000","last_undegraded":"2024-04-23T19:00:26.638930+0000","last_fullsized":"2024-04-23T19:00:26.638930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322571+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:00:26.322571+0000","last_peered":"2024-04-23T19:00:26.322571+0000","last_clean":"2024-04-23T19:00:26.322571+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:00:26.322571+0000","last_undegraded":"2024-04-23T19:00:26.322571+0000","last_fullsized":"2024-04-23T19:00:26.322571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.346739+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:00:26.346739+0000","last_peered":"2024-04-23T19:00:26.346739+0000","last_clean":"2024-04-23T19:00:26.346739+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:00:26.346739+0000","last_undegraded":"2024-04-23T19:00:26.346739+0000","last_fullsized":"2024-04-23T19:00:26.346739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322061+0000","last_change":"2024-04-23T19:00:17.315323+0000","last_active":"2024-04-23T19:00:26.322061+0000","last_peered":"2024-04-23T19:00:26.322061+0000","last_clean":"2024-04-23T19:00:26.322061+0000","last_became_active":"2024-04-23T19:00:17.315077+0000","last_became_peered":"2024-04-23T19:00:17.315077+0000","last_unstale":"2024-04-23T19:00:26.322061+0000","last_undegraded":"2024-04-23T19:00:26.322061+0000","last_fullsized":"2024-04-23T19:00:26.322061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339654+0000","last_change":"2024-04-23T19:00:15.262041+0000","last_active":"2024-04-23T19:00:26.339654+0000","last_peered":"2024-04-23T19:00:26.339654+0000","last_clean":"2024-04-23T19:00:26.339654+0000","last_became_active":"2024-04-23T19:00:15.261175+0000","last_became_peered":"2024-04-23T19:00:15.261175+0000","last_unstale":"2024-04-23T19:00:26.339654+0000","last_undegraded":"2024-04-23T19:00:26.339654+0000","last_fullsized":"2024-04-23T19:00:26.339654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.321087+0000","last_change":"2024-04-23T19:00:17.297003+0000","last_active":"2024-04-23T19:00:26.321087+0000","last_peered":"2024-04-23T19:00:26.321087+0000","last_clean":"2024-04-23T19:00:26.321087+0000","last_became_active":"2024-04-23T19:00:17.295108+0000","last_became_peered":"2024-04-23T19:00:17.295108+0000","last_unstale":"2024-04-23T19:00:26.321087+0000","last_undegraded":"2024-04-23T19:00:26.321087+0000","last_fullsized":"2024-04-23T19:00:26.321087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.307390+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:00:26.307390+0000","last_peered":"2024-04-23T19:00:26.307390+0000","last_clean":"2024-04-23T19:00:26.307390+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:00:26.307390+0000","last_undegraded":"2024-04-23T19:00:26.307390+0000","last_fullsized":"2024-04-23T19:00:26.307390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310747+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:00:26.310747+0000","last_peered":"2024-04-23T19:00:26.310747+0000","last_clean":"2024-04-23T19:00:26.310747+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:00:26.310747+0000","last_undegraded":"2024-04-23T19:00:26.310747+0000","last_fullsized":"2024-04-23T19:00:26.310747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311946+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:00:26.311946+0000","last_peered":"2024-04-23T19:00:26.311946+0000","last_clean":"2024-04-23T19:00:26.311946+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:00:26.311946+0000","last_undegraded":"2024-04-23T19:00:26.311946+0000","last_fullsized":"2024-04-23T19:00:26.311946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320373+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:00:26.320373+0000","last_peered":"2024-04-23T19:00:26.320373+0000","last_clean":"2024-04-23T19:00:26.320373+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:00:26.320373+0000","last_undegraded":"2024-04-23T19:00:26.320373+0000","last_fullsized":"2024-04-23T19:00:26.320373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323419+0000","last_change":"2024-04-23T19:00:15.258608+0000","last_active":"2024-04-23T19:00:26.323419+0000","last_peered":"2024-04-23T19:00:26.323419+0000","last_clean":"2024-04-23T19:00:26.323419+0000","last_became_active":"2024-04-23T19:00:15.258276+0000","last_became_peered":"2024-04-23T19:00:15.258276+0000","last_unstale":"2024-04-23T19:00:26.323419+0000","last_undegraded":"2024-04-23T19:00:26.323419+0000","last_fullsized":"2024-04-23T19:00:26.323419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312982+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:00:26.312982+0000","last_peered":"2024-04-23T19:00:26.312982+0000","last_clean":"2024-04-23T19:00:26.312982+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:00:26.312982+0000","last_undegraded":"2024-04-23T19:00:26.312982+0000","last_fullsized":"2024-04-23T19:00:26.312982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.314069+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:00:26.314069+0000","last_peered":"2024-04-23T19:00:26.314069+0000","last_clean":"2024-04-23T19:00:26.314069+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:00:26.314069+0000","last_undegraded":"2024-04-23T19:00:26.314069+0000","last_fullsized":"2024-04-23T19:00:26.314069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.348137+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:00:26.348137+0000","last_peered":"2024-04-23T19:00:26.348137+0000","last_clean":"2024-04-23T19:00:26.348137+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:00:26.348137+0000","last_undegraded":"2024-04-23T19:00:26.348137+0000","last_fullsized":"2024-04-23T19:00:26.348137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.320765+0000","last_change":"2024-04-23T19:00:15.251155+0000","last_active":"2024-04-23T19:00:26.320765+0000","last_peered":"2024-04-23T19:00:26.320765+0000","last_clean":"2024-04-23T19:00:26.320765+0000","last_became_active":"2024-04-23T19:00:15.250798+0000","last_became_peered":"2024-04-23T19:00:15.250798+0000","last_unstale":"2024-04-23T19:00:26.320765+0000","last_undegraded":"2024-04-23T19:00:26.320765+0000","last_fullsized":"2024-04-23T19:00:26.320765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310382+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:00:26.310382+0000","last_peered":"2024-04-23T19:00:26.310382+0000","last_clean":"2024-04-23T19:00:26.310382+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:00:26.310382+0000","last_undegraded":"2024-04-23T19:00:26.310382+0000","last_fullsized":"2024-04-23T19:00:26.310382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.341946+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:00:26.341946+0000","last_peered":"2024-04-23T19:00:26.341946+0000","last_clean":"2024-04-23T19:00:26.341946+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:00:26.341946+0000","last_undegraded":"2024-04-23T19:00:26.341946+0000","last_fullsized":"2024-04-23T19:00:26.341946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.339541+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:00:26.339541+0000","last_peered":"2024-04-23T19:00:26.339541+0000","last_clean":"2024-04-23T19:00:26.339541+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:00:26.339541+0000","last_undegraded":"2024-04-23T19:00:26.339541+0000","last_fullsized":"2024-04-23T19:00:26.339541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.313637+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:00:26.313637+0000","last_peered":"2024-04-23T19:00:26.313637+0000","last_clean":"2024-04-23T19:00:26.313637+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:00:26.313637+0000","last_undegraded":"2024-04-23T19:00:26.313637+0000","last_fullsized":"2024-04-23T19:00:26.313637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327399+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:00:26.327399+0000","last_peered":"2024-04-23T19:00:26.327399+0000","last_clean":"2024-04-23T19:00:26.327399+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:00:26.327399+0000","last_undegraded":"2024-04-23T19:00:26.327399+0000","last_fullsized":"2024-04-23T19:00:26.327399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311173+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:00:26.311173+0000","last_peered":"2024-04-23T19:00:26.311173+0000","last_clean":"2024-04-23T19:00:26.311173+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:00:26.311173+0000","last_undegraded":"2024-04-23T19:00:26.311173+0000","last_fullsized":"2024-04-23T19:00:26.311173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.349391+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:00:26.349391+0000","last_peered":"2024-04-23T19:00:26.349391+0000","last_clean":"2024-04-23T19:00:26.349391+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:00:26.349391+0000","last_undegraded":"2024-04-23T19:00:26.349391+0000","last_fullsized":"2024-04-23T19:00:26.349391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310988+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:00:26.310988+0000","last_peered":"2024-04-23T19:00:26.310988+0000","last_clean":"2024-04-23T19:00:26.310988+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:00:26.310988+0000","last_undegraded":"2024-04-23T19:00:26.310988+0000","last_fullsized":"2024-04-23T19:00:26.310988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.309514+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:00:26.309514+0000","last_peered":"2024-04-23T19:00:26.309514+0000","last_clean":"2024-04-23T19:00:26.309514+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:00:26.309514+0000","last_undegraded":"2024-04-23T19:00:26.309514+0000","last_fullsized":"2024-04-23T19:00:26.309514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310589+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:00:26.310589+0000","last_peered":"2024-04-23T19:00:26.310589+0000","last_clean":"2024-04-23T19:00:26.310589+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:00:26.310589+0000","last_undegraded":"2024-04-23T19:00:26.310589+0000","last_fullsized":"2024-04-23T19:00:26.310589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.347777+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:00:26.347777+0000","last_peered":"2024-04-23T19:00:26.347777+0000","last_clean":"2024-04-23T19:00:26.347777+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:00:26.347777+0000","last_undegraded":"2024-04-23T19:00:26.347777+0000","last_fullsized":"2024-04-23T19:00:26.347777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.323885+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:00:26.323885+0000","last_peered":"2024-04-23T19:00:26.323885+0000","last_clean":"2024-04-23T19:00:26.323885+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:00:26.323885+0000","last_undegraded":"2024-04-23T19:00:26.323885+0000","last_fullsized":"2024-04-23T19:00:26.323885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.331738+0000","last_change":"2024-04-23T19:00:17.307225+0000","last_active":"2024-04-23T19:00:26.331738+0000","last_peered":"2024-04-23T19:00:26.331738+0000","last_clean":"2024-04-23T19:00:26.331738+0000","last_became_active":"2024-04-23T19:00:17.306510+0000","last_became_peered":"2024-04-23T19:00:17.306510+0000","last_unstale":"2024-04-23T19:00:26.331738+0000","last_undegraded":"2024-04-23T19:00:26.331738+0000","last_fullsized":"2024-04-23T19:00:26.331738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.340694+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:00:26.340694+0000","last_peered":"2024-04-23T19:00:26.340694+0000","last_clean":"2024-04-23T19:00:26.340694+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:00:26.340694+0000","last_undegraded":"2024-04-23T19:00:26.340694+0000","last_fullsized":"2024-04-23T19:00:26.340694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.322803+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:00:26.322803+0000","last_peered":"2024-04-23T19:00:26.322803+0000","last_clean":"2024-04-23T19:00:26.322803+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:00:26.322803+0000","last_undegraded":"2024-04-23T19:00:26.322803+0000","last_fullsized":"2024-04-23T19:00:26.322803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.333437+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:00:26.333437+0000","last_peered":"2024-04-23T19:00:26.333437+0000","last_clean":"2024-04-23T19:00:26.333437+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:00:26.333437+0000","last_undegraded":"2024-04-23T19:00:26.333437+0000","last_fullsized":"2024-04-23T19:00:26.333437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310167+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:00:26.310167+0000","last_peered":"2024-04-23T19:00:26.310167+0000","last_clean":"2024-04-23T19:00:26.310167+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:00:26.310167+0000","last_undegraded":"2024-04-23T19:00:26.310167+0000","last_fullsized":"2024-04-23T19:00:26.310167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311197+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:00:26.311197+0000","last_peered":"2024-04-23T19:00:26.311197+0000","last_clean":"2024-04-23T19:00:26.311197+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:00:26.311197+0000","last_undegraded":"2024-04-23T19:00:26.311197+0000","last_fullsized":"2024-04-23T19:00:26.311197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.330507+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:00:26.330507+0000","last_peered":"2024-04-23T19:00:26.330507+0000","last_clean":"2024-04-23T19:00:26.330507+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:00:26.330507+0000","last_undegraded":"2024-04-23T19:00:26.330507+0000","last_fullsized":"2024-04-23T19:00:26.330507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.312334+0000","last_change":"2024-04-23T19:00:15.270249+0000","last_active":"2024-04-23T19:00:26.312334+0000","last_peered":"2024-04-23T19:00:26.312334+0000","last_clean":"2024-04-23T19:00:26.312334+0000","last_became_active":"2024-04-23T19:00:15.266595+0000","last_became_peered":"2024-04-23T19:00:15.266595+0000","last_unstale":"2024-04-23T19:00:26.312334+0000","last_undegraded":"2024-04-23T19:00:26.312334+0000","last_fullsized":"2024-04-23T19:00:26.312334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.310135+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:00:26.310135+0000","last_peered":"2024-04-23T19:00:26.310135+0000","last_clean":"2024-04-23T19:00:26.310135+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:00:26.310135+0000","last_undegraded":"2024-04-23T19:00:26.310135+0000","last_fullsized":"2024-04-23T19:00:26.310135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.327379+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:00:26.327379+0000","last_peered":"2024-04-23T19:00:26.327379+0000","last_clean":"2024-04-23T19:00:26.327379+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:00:26.327379+0000","last_undegraded":"2024-04-23T19:00:26.327379+0000","last_fullsized":"2024-04-23T19:00:26.327379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.319815+0000","last_change":"2024-04-23T19:00:15.270216+0000","last_active":"2024-04-23T19:00:26.319815+0000","last_peered":"2024-04-23T19:00:26.319815+0000","last_clean":"2024-04-23T19:00:26.319815+0000","last_became_active":"2024-04-23T19:00:15.269392+0000","last_became_peered":"2024-04-23T19:00:15.269392+0000","last_unstale":"2024-04-23T19:00:26.319815+0000","last_undegraded":"2024-04-23T19:00:26.319815+0000","last_fullsized":"2024-04-23T19:00:26.319815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-23T19:00:26.311648+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:00:26.311648+0000","last_peered":"2024-04-23T19:00:26.311648+0000","last_clean":"2024-04-23T19:00:26.311648+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:00:26.311648+0000","last_undegraded":"2024-04-23T19:00:26.311648+0000","last_fullsized":"2024-04-23T19:00:26.311648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":529,"num_read_kb":341,"num_write":311,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1003520,"data_stored":750597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":159569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":159404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":158074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":158972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":157918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":150284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":749006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:00:33.671 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T19:00:33.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-23T19:00:34.005 INFO:teuthology.orchestra.run.smithi169.stdout:epoch 32 2024-04-23T19:00:34.005 INFO:teuthology.orchestra.run.smithi169.stdout:fsid 4bb45736-c8eb-4572-abb0-38f9ff40b613 2024-04-23T19:00:34.005 INFO:teuthology.orchestra.run.smithi169.stdout:created 2024-04-23T18:59:49.133644+0000 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:modified 2024-04-23T19:00:26.300595+0000 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:crush_version 4 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:full_ratio 0.95 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:backfillfull_ratio 0.9 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:nearfull_ratio 0.85 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:require_min_compat_client luminous 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:min_compat_client jewel 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:require_osd_release squid 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:stretch_mode_enabled false 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-04-23T19:00:34.006 INFO:teuthology.orchestra.run.smithi169.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:max_osd 8 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/2480149234,v1:172.21.15.169:6809/2480149234] [v2:172.21.15.169:6810/2480149234,v1:172.21.15.169:6811/2480149234] exists,up 19702f2e-d87b-4f04-91b1-933211c92efc 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/2143529353,v1:172.21.15.169:6818/2143529353] [v2:172.21.15.169:6821/2143529353,v1:172.21.15.169:6823/2143529353] exists,up 6f9fa56c-0fcb-4f45-9440-e60fe043be19 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6817/2796580003,v1:172.21.15.169:6819/2796580003] [v2:172.21.15.169:6820/2796580003,v1:172.21.15.169:6822/2796580003] exists,up a45daf8f-561c-4931-954a-ae4cda4e9383 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/3764305788,v1:172.21.15.169:6801/3764305788] [v2:172.21.15.169:6802/3764305788,v1:172.21.15.169:6803/3764305788] exists,up 9ae3c352-4546-4115-8a2e-07ccb88ea066 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6800/519231085,v1:172.21.15.193:6801/519231085] [v2:172.21.15.193:6802/519231085,v1:172.21.15.193:6803/519231085] exists,up feff8989-ac80-433d-8d4d-61c64acbb0e7 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6816/3321647745,v1:172.21.15.193:6818/3321647745] [v2:172.21.15.193:6819/3321647745,v1:172.21.15.193:6821/3321647745] exists,up 3ceb25a3-bc75-4611-8353-9a4ab397b27e 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6804/46529429,v1:172.21.15.193:6806/46529429] [v2:172.21.15.193:6808/46529429,v1:172.21.15.193:6809/46529429] exists,up b958ec69-6670-4132-a39d-30ba2027eaaf 2024-04-23T19:00:34.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6817/1901200038,v1:172.21.15.193:6820/1901200038] [v2:172.21.15.193:6823/1901200038,v1:172.21.15.193:6826/1901200038] exists,up ab2626db-9460-443c-aa97-6f6c38f8b72c 2024-04-23T19:00:34.024 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/2480149234,v1:172.21.15.169:6809/2480149234] [v2:172.21.15.169:6810/2480149234,v1:172.21.15.169:6811/2480149234] exists,up 19702f2e-d87b-4f04-91b1-933211c92efc', 'osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/2143529353,v1:172.21.15.169:6818/2143529353] [v2:172.21.15.169:6821/2143529353,v1:172.21.15.169:6823/2143529353] exists,up 6f9fa56c-0fcb-4f45-9440-e60fe043be19', 'osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6817/2796580003,v1:172.21.15.169:6819/2796580003] [v2:172.21.15.169:6820/2796580003,v1:172.21.15.169:6822/2796580003] exists,up a45daf8f-561c-4931-954a-ae4cda4e9383', 'osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/3764305788,v1:172.21.15.169:6801/3764305788] [v2:172.21.15.169:6802/3764305788,v1:172.21.15.169:6803/3764305788] exists,up 9ae3c352-4546-4115-8a2e-07ccb88ea066', 'osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6800/519231085,v1:172.21.15.193:6801/519231085] [v2:172.21.15.193:6802/519231085,v1:172.21.15.193:6803/519231085] exists,up feff8989-ac80-433d-8d4d-61c64acbb0e7', 'osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6816/3321647745,v1:172.21.15.193:6818/3321647745] [v2:172.21.15.193:6819/3321647745,v1:172.21.15.193:6821/3321647745] exists,up 3ceb25a3-bc75-4611-8353-9a4ab397b27e', 'osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6804/46529429,v1:172.21.15.193:6806/46529429] [v2:172.21.15.193:6808/46529429,v1:172.21.15.193:6809/46529429] exists,up b958ec69-6670-4132-a39d-30ba2027eaaf', 'osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6817/1901200038,v1:172.21.15.193:6820/1901200038] [v2:172.21.15.193:6823/1901200038,v1:172.21.15.193:6826/1901200038] exists,up ab2626db-9460-443c-aa97-6f6c38f8b72c'] 2024-04-23T19:00:34.024 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-23T19:00:34.141 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:34.141 INFO:teuthology.orchestra.run.smithi169.stdout: "name": "mon.a", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "cluster": "ceph", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "admin_socket_mode": "", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_client_required": "cephx, none", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_cluster_required": "cephx", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_debug": "true", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_service_required": "cephx", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "auth_supported": "cephx", 2024-04-23T19:00:34.142 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_aio": "true", 2024-04-23T19:00:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-23T19:00:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_aio_poll_ms": "250", 2024-04-23T19:00:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_aio_reap_max": "16", 2024-04-23T19:00:34.143 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_async_discard_threads": "0", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_block_size": "4096", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_debug_aio": "false", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_debug_inflight_ios": "false", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_enable_discard": "false", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_flock_retry": "3", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_inject_crash": "0", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_ioring": "false", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_ioring_hipri": "false", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-23T19:00:34.144 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bdev_type": "", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_alloc_size": "1048576", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_allocator": "hybrid", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_buffered_io": "true", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_check_for_zeros": "false", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_compact_log_sync": "false", 2024-04-23T19:00:34.145 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_max_log_runway": "4194304", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_max_prefetch": "1048576", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_min_flush_size": "524288", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_min_log_runway": "1048576", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_replay_recovery": "false", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_sync_write": "false", 2024-04-23T19:00:34.146 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_allocation_from_file": "true", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_allocator": "hybrid", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_create": "true", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_db_create": "false", 2024-04-23T19:00:34.147 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_db_path": "", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_db_size": "0", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_path": "", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_preallocate_file": "false", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_size": "107374182400", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_wal_create": "false", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_wal_path": "", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_block_wal_size": "100663296", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_bluefs": "true", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-23T19:00:34.148 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-23T19:00:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-23T19:00:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_autotune": "true", 2024-04-23T19:00:34.149 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_size": "0", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_type": "2q", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_clone_cow": "true", 2024-04-23T19:00:34.150 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_mode": "none", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_csum_type": "crc32c", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_freelist": "false", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-23T19:00:34.151 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_small_allocations": "0", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_default_buffered_read": "true", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_default_buffered_write": "false", 2024-04-23T19:00:34.152 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fail_eio": "false", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-23T19:00:34.153 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_on_mount": "false", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_on_umount": "false", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-23T19:00:34.154 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_ignore_data_csum": "false", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_log_op_age": "5.000000", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_max_alloc_size": "0", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_max_blob_size": "0", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_max_deferred_txc": "32", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_min_alloc_size": "0", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-23T19:00:34.155 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_nid_prealloc": "1024", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_retry_disk_reads": "3", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_rocksdb_cf": "true", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-23T19:00:34.156 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_spdk_mem": "512", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_tracing": "false", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-23T19:00:34.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_zero_block_detection": "false", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-23T19:00:34.158 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_cluster_require_signatures": "false", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_cluster_require_version": "2", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_require_signatures": "false", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_require_version": "2", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_service_require_signatures": "false", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_service_require_version": "2", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "cephx_sign_messages": "true", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "chdir": "", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_acl_type": "", 2024-04-23T19:00:34.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_asio_thread_count": "2", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_cache_mid": "0.750000", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_cache_size": "16384", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_caps_release_delay": "5", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_check_pool_perm": "true", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_debug_force_sync_read": "false", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_debug_getattr_caps": "false", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_debug_inject_tick_delay": "0", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_die_on_failed_remount": "false", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_dirsize_rbytes": "true", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_force_lazyio": "false", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_fs": "", 2024-04-23T19:00:34.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_inject_release_failure": "false", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_max_inline_size": "4096", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_mds_namespace": "", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_metadata": "", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_mount_gid": "-1", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_mount_timeout": "300", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_mount_uid": "-1", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_mountpoint": "/", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_notify_timeout": "10", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_oc": "true", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_oc_max_dirty": "104857600", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_oc_max_objects": "1000", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_oc_size": "209715200", 2024-04-23T19:00:34.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_oc_target_dirty": "8388608", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_permissions": "true", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_quota": "true", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_quota_df": "true", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_readahead_max_bytes": "0", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_readahead_max_periods": "4", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_readahead_min": "131072", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_reconnect_stale": "false", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_shutdown_timeout": "30", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_snapdir": ".snap", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_tick_interval": "1", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_trace": "", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_try_dentry_invalidate": "false", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_use_faked_inos": "false", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_use_random_mds": "false", 2024-04-23T19:00:34.162 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_graylog": "false", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_graylog_port": "12201", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_monitors": "default=true", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_syslog": "false", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "clog_to_syslog_level": "info", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "cluster_addr": "-", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "cluster_network": "", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "cluster_network_interface": "", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "compressor_zlib_isal": "false", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "compressor_zlib_level": "5", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "compressor_zlib_winsize": "-15", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "compressor_zstd_level": "1", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-23T19:00:34.163 INFO:teuthology.orchestra.run.smithi169.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crimson_alien_op_num_threads": "6", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crimson_osd_stat_interval": "0", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crimson_seastar_cpu_cores": "", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crush_location": "", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crush_location_hook": "", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "crush_location_hook_timeout": "10", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "daemonize": "false", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "daos_pool": "tank", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-23T19:00:34.164 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_alienstore": "0/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_allow_any_pool_priority": "false", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_asok": "1/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_asok_assert_abort": "false", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_asserts_on_shutdown": "true", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_auth": "20/20", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_bdev": "1/3", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_bluefs": "1/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_bluestore": "1/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_buffer": "0/1", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_ceph_exporter": "1/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_cephfs_mirror": "0/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_cephsqlite": "0/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_client": "0/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_compressor": "1/5", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_context": "0/1", 2024-04-23T19:00:34.165 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_crimson_interrupt": "0/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_crush": "1/1", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_crypto": "1/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_cyanstore": "0/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_deliberately_leak_memory": "false", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_disable_randomized_ping": "false", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_dpdk": "1/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_eventtrace": "1/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_filer": "0/1", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_filestore": "1/3", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_finisher": "1/1", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_fuse": "1/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_heartbeat_testing_span": "0", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_heartbeatmap": "1/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-23T19:00:34.166 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_javaclient": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_journal": "1/3", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_journaler": "0/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_kstore": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_lockdep": "0/1", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mclock": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds_balancer": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds_locker": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds_log": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds_log_expire": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds_migrator": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mds_quiesce": "3/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_memstore": "1/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mgr": "2/5", 2024-04-23T19:00:34.167 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mgrc": "1/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_mon": "20/20", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_monc": "0/10", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_ms": "1/1", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_none": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_objclass": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_objectcacher": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_objecter": "0/1", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_optracker": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_osd": "1/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_paxos": "20/20", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_perfcounter": "1/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_prioritycache": "1/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rados": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rbd": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rbd_mirror": "0/5", 2024-04-23T19:00:34.168 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rbd_pwl": "0/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rbd_replay": "0/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_refs": "0/0", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_reserver": "1/1", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_access": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_datacache": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_dbstore": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_flight": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_notification": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rgw_sync": "1/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_rocksdb": "4/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore": "0/5", 2024-04-23T19:00:34.169 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_backref": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_cache": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_cleaner": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_device": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_epm": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_journal": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_lba": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_odata": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_omap": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_onode": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_t": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_seastore_tm": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_striper": "0/1", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_test": "0/5", 2024-04-23T19:00:34.170 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_throttle": "1/1", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_timer": "0/1", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_tp": "0/5", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "debug_trace": "1/5", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "device_failure_prediction_mode": "none", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "err_to_graylog": "false", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "err_to_journald": "false", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "err_to_stderr": "true", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "err_to_syslog": "false", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event_tracing": "false", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "exporter_addr": "0.0.0.0", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "exporter_http_port": "9926", 2024-04-23T19:00:34.171 INFO:teuthology.orchestra.run.smithi169.stdout: "exporter_prio_limit": "5", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "exporter_sort_metrics": "true", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "exporter_stats_period": "5", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "fake_statfs_for_testing": "0", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "fatal_signal_handlers": "true", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filer_max_purge_ops": "10", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filer_max_truncate_ops": "128", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_apply_finisher_threads": "1", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_blackhole": "false", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_btrfs_clone_range": "true", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_btrfs_snap": "true", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_caller_concurrency": "10", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_collect_device_partition_information": "true", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_commit_timeout": "600.000000", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_debug_inject_read_err": "false", 2024-04-23T19:00:34.172 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_debug_omap_check": "false", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_debug_verify_split": "false", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_dump_file": "", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fadvise": "true", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fail_eio": "true", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fd_cache_shards": "16", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fd_cache_size": "128", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fiemap": "false", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fiemap_threshold": "4096", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_inject_stall": "0", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_journal_parallel": "false", 2024-04-23T19:00:34.173 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_journal_trailing": "false", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_journal_writeahead": "false", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_kill_at": "0", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattrs": "0", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_xattr_value_size": "0", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-23T19:00:34.174 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_merge_threshold": "-10", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_odsync_write": "false", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_omap_backend": "rocksdb", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_omap_backend_path": "", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_op_thread_timeout": "60", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_op_threads": "2", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_punch_hole": "false", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-23T19:00:34.175 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_queue_max_ops": "50", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_seek_data_hole": "false", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_sloppy_crc": "false", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_splice": "false", 2024-04-23T19:00:34.176 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_split_multiple": "2", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_split_rand_factor": "20", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_update_to": "1000", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_enable": "true", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-23T19:00:34.177 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_xfs_extsize": "false", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "filestore_zfs_snap": "false", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fio_dir": "/tmp/fio", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fsid": "4bb45736-c8eb-4572-abb0-38f9ff40b613", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_allow_other": "true", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_atomic_o_trunc": "true", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_big_writes": "true", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_debug": "false", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_default_permissions": "false", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_disable_pagecache": "false", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_max_write": "0", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_multithreaded": "true", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_require_active_mds": "true", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_set_user_groups": "true", 2024-04-23T19:00:34.178 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_splice_move": "true", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_splice_read": "true", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_splice_write": "true", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "fuse_use_invalidate_cb": "true", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "gss_target_name": "ceph", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "heartbeat_file": "", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "heartbeat_inject_failure": "0", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "heartbeat_interval": "5", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "host": "smithi169", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-23T19:00:34.179 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "inject_early_sigterm": "false", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "jaeger_agent_port": "6799", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "jaeger_tracing_enable": "false", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_aio": "true", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_align_min_size": "65536", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_block_align": "true", 2024-04-23T19:00:34.180 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_block_size": "4096", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_dio": "true", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_discard": "false", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_force_aio": "false", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_ignore_corruption": "false", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_max_write_bytes": "10485760", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_max_write_entries": "100", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_replay_from": "0", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_write_header_frequency": "0", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journal_zero_on_create": "false", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journaler_prefetch_periods": "10", 2024-04-23T19:00:34.181 INFO:teuthology.orchestra.run.smithi169.stdout: "journaler_prezero_periods": "5", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "journaler_write_head_interval": "15", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "key": "", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "keyfile": "", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_backend": "rocksdb", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_default_stripe_size": "65536", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_fsck_on_mount": "false", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_max_bytes": "67108864", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_max_ops": "512", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_nid_prealloc": "1024", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_onode_map_size": "1024", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_sync_submit_transaction": "false", 2024-04-23T19:00:34.182 INFO:teuthology.orchestra.run.smithi169.stdout: "kstore_sync_transaction": "false", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "librados_thread_count": "2", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "lockdep": "false", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "lockdep_force_backtrace": "false", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_coarse_timestamps": "true", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_flush_on_exit": "false", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_graylog_host": "127.0.0.1", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_graylog_port": "12201", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_max_new": "1000", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_max_recent": "10000", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_stderr_prefix": "", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_stop_at_utilization": "0.970000", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_to_file": "true", 2024-04-23T19:00:34.183 INFO:teuthology.orchestra.run.smithi169.stdout: "log_to_graylog": "false", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "log_to_journald": "false", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "log_to_stderr": "false", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "log_to_syslog": "false", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "max_rotating_auth_attempts": "10", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_action_on_write_error": "1", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_alternate_name_max": "8192", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_asio_thread_count": "2", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_export_pin": "true", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_fragment_dirs": "true", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_fragment_interval": "5", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-23T19:00:34.184 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_interval": "10", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_max": "-1", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_max_until": "-1", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_merge_size": "50", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_midchunk": "0.300000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_min_start": "0.200000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_minchunk": "0.001000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_mode": "0", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_need_max": "1.200000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_need_min": "0.800000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_overload_epochs": "2", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_split_bits": "3", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-23T19:00:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_split_size": "10000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_target_decay": "10.000000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_beacon_grace": "15.000000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_beacon_interval": "4.000000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_mid": "0.700000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_quiesce_delay": "0", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-23T19:00:34.186 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_release_free_interval": "10", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_reservation": "0.050000", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_trim_interval": "1", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache_trim_threshold": "262144", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_client_prealloc_inos": "1000", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_connect_bootstrapping": "false", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_damage_table_max_entries": "10000", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_debug_auth_pins": "false", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_debug_frag": "false", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_debug_scatterstat": "false", 2024-04-23T19:00:34.187 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_debug_subtrees": "false", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_decay_halflife": "5.000000", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_default_dir_hash": "2", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_defer_session_stale": "true", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_deny_all_reconnect": "false", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dir_keys_per_op": "16384", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dir_max_commit_size": "10", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dir_max_entries": "0", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dir_prefetch": "true", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dump_cache_on_map": "false", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-23T19:00:34.188 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_early_reply": "true", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_enable_op_tracker": "true", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_enforce_unique_name": "true", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_export_ephemeral_random": "true", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_health_summarize_threshold": "10", 2024-04-23T19:00:34.189 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_inject_health_dummy": "false", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_inject_migrator_session_race": "false", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_join_fs": "", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_journal_format": "1", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_create_at": "0", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_export_at": "0", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_import_at": "0", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_journal_at": "0", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_journal_expire_at": "0", 2024-04-23T19:00:34.190 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_journal_replay_at": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_link_at": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_mdstable_at": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_openc_at": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_rename_at": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_shutdown_at": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_event_large_threshold": "524288", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_events_per_segment": "1024", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_max_events": "-1", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_max_segments": "128", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_pause": "false", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_segment_size": "0", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-23T19:00:34.191 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_trim_threshold": "128", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log_warn_factor": "2.000000", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_caps_per_client": "1048576", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_completed_flushes": "100000", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_completed_requests": "100000", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_export_size": "20971520", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_file_recover": "32", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_purge_files": "64", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_purge_ops": "8192", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_max_snaps_per_dir": "100", 2024-04-23T19:00:34.192 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_metrics_update_interval": "2", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_min_caps_per_client": "100", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_min_caps_working_set": "10000", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_numa_node": "-1", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_op_complaint_time": "30.000000", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_op_history_duration": "600", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_op_history_size": "20", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_op_history_slow_op_size": "20", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_op_log_threshold": "5", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_ping_grace": "15", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_ping_interval": "5", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-23T19:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_recall_max_caps": "30000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_recall_warning_threshold": "262144", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_replay_interval": "1.000000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_root_ino_gid": "0", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_root_ino_uid": "0", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-23T19:00:34.194 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_shutdown_check": "0", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_skip_ino": "0", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_snap_max_uid": "4294967294", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_snap_min_uid": "0", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_snap_rstat": "false", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_standby_replay_damaged": "false", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_symlink_recovery": "true", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-23T19:00:34.195 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_thrash_exports": "0", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_thrash_fragments": "0", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_tick_interval": "5.000000", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_valgrind_exit": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_verify_backtrace": "1", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_verify_scatter": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_wipe_sessions": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool_debug": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "memstore_device_bytes": "1073741824", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "memstore_page_set": "false", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "memstore_page_size": "65536", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_client_bytes": "134217728", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_client_messages": "512", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-23T19:00:34.196 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_disabled_modules": "", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_max_pg_creating": "1024", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_max_pg_num_change": "128", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_mds_bytes": "134217728", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_mds_messages": "128", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_mon_bytes": "134217728", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_mon_messages": "128", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_osd_bytes": "536870912", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_osd_messages": "8192", 2024-04-23T19:00:34.197 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_pool": "true", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_standby_modules": "true", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_stats_period": "5", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_stats_threshold": "5", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_tick_period": "2", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_allow_pool_delete": "true", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_allow_pool_size_one": "true", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_auth_validate_all_caps": "true", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_bytes": "104857600", 2024-04-23T19:00:34.198 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_directed_command_retry": "2", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_hunt_parallel": "3", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_log_interval": "1.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_ping_interval": "10.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_client_target_rank": "-1", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-23T19:00:34.199 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_file_level": "debug", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_file": "true", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_journald": "false", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_compact_on_bootstrap": "false", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_compact_on_start": "false", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_compact_on_trim": "true", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-23T19:00:34.200 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_cpu_threads": "4", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_crush_min_required_version": "hammer", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_daemon_bytes": "419430400", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_data_avail_crit": "5", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_data_avail_warn": "5", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_data_size_warn": "16106127360", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_dump_json": "false", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_dump_transactions": "false", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_extra_checks": "false", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-23T19:00:34.201 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_no_require_reef": "false", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_no_require_squid": "false", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_down_mkfs_grace": "120", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_down_uptime_grace": "60", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_election_default_strategy": "1", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_election_timeout": "5.000000", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_elector_ping_divisor": "2", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_enable_op_tracker": "true", 2024-04-23T19:00:34.202 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_fake_pool_delete": "false", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_force_quorum_join": "false", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_globalid_prealloc": "10000", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_health_detail_to_clog": "false", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_health_log_update_period": "5", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_health_max_detail": "50", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_health_to_clog": "true", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_health_to_clog_interval": "600", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_host": "172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790],172.21.15.193", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_host_override": "", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_initial_members": "", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-23T19:00:34.203 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_lease": "5.000000", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_log_full_interval": "50", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_log_max": "10000", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_log_max_summary": "50", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_log_epochs": "500", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_osd": "10000", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_pg_per_osd": "10000", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_pool_pg_num": "65536", 2024-04-23T19:00:34.204 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mds_force_trim_to": "0", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mds_skip_sanity": "false", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_memory_autotune": "true", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_memory_target": "2147483648", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mgr_beacon_grace": "30", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mgr_digest_period": "5", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mgr_inactive_grace": "60", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_min_osdmap_epochs": "500", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_op_complaint_time": "30", 2024-04-23T19:00:34.205 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_op_history_duration": "600", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_op_history_size": "20", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_op_history_slow_op_size": "20", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_op_log_threshold": "5", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_auto_mark_in": "false", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-23T19:00:34.206 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_cache_size": "500", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_down_out_interval": "600", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_force_trim_to": "0", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-23T19:00:34.207 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_min_down_reporters": "2", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_report_timeout": "900", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-23T19:00:34.208 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pg_stuck_threshold": "60", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_probe_timeout": "2.000000", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_reweight_max_change": "0.050000", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_reweight_max_osds": "4", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-23T19:00:34.209 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_scrub_interval": "86400", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_scrub_max_keys": "100", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_scrub_timeout": "300", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_session_timeout": "300", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_smart_report_timeout": "5", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_stat_smooth_intervals": "6", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_stretch_pool_min_size": "2", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_stretch_pool_size": "4", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_sync_debug": "false", 2024-04-23T19:00:34.210 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_sync_provider_kill_at": "0", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_sync_requester_kill_at": "0", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_sync_timeout": "60.000000", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_target_pg_per_osd": "100", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_tick_interval": "5", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_timecheck_interval": "300.000000", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_use_min_delay_socket": "false", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_older_version_delay": "604800", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-23T19:00:34.211 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_misplaced": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_older_version": "true", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-23T19:00:34.212 INFO:teuthology.orchestra.run.smithi169.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "monmap": "", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "motr_tracing_enabled": "false", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_op_threads": "3", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_cm": "false", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_device_name": "", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_dscp": "96", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-23T19:00:34.213 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_local_gid": "", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_port_num": "1", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_sl": "3", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_support_srq": "true", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_rdma_type": "ib", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_async_reap_threshold": "5", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_before_connect": "false", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_ipv4": "true", 2024-04-23T19:00:34.214 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_ipv6": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_msgr1": "true", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_msgr2": "true", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_port_max": "7568", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_port_min": "6800", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_retry_count": "3", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_bind_retry_delay": "5", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_blackhole_client": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_blackhole_mds": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_blackhole_mgr": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_blackhole_mon": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_blackhole_osd": "false", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_client_mode": "crc secure", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_cluster_mode": "crc secure", 2024-04-23T19:00:34.215 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_cluster_type": "", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_compress_secure": "false", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_connection_idle_timeout": "900", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_connection_ready_timeout": "10", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_crc_data": "true", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_crc_header": "true", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_die_on_bad_msg": "false", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_die_on_bug": "true", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_die_on_old_message": "true", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_die_on_skipped_message": "false", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_coremask": "0xF", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-23T19:00:34.216 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_enable_tso": "true", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_hugepages": "", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_lro": "true", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_memory_channel": "4", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_pmd": "", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_port_id": "0", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_dump_on_send": "false", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_initial_backoff": "0.200000", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_inject_delay_max": "1.000000", 2024-04-23T19:00:34.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_inject_delay_type": "", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_inject_network_congestion": "0", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_inject_socket_failures": "0", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_learn_addr_from_peer": "true", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_max_accept_failures": "4", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_max_backoff": "15.000000", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_mon_client_mode": "secure crc", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_mon_service_mode": "secure crc", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_osd_compress_min_size": "1024", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_osd_compress_mode": "none", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-23T19:00:34.218 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_pq_min_cost": "65536", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_public_type": "", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_service_mode": "crc secure", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_tcp_listen_backlog": "512", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_tcp_nodelay": "true", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_tcp_rcvbuf": "0", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "ms_type": "async+posix", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "no_config_file": "false", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_completion_locks_per_session": "32", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_inflight_ops": "1024", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-23T19:00:34.219 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_tick_interval": "5.000000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter_timeout": "10.000000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "objectstore_blackhole": "false", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "openssl_engine_opts": "", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_delay_time": "5.000000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_hist_halflife": "1000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_max_low_ops": "2", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_max_ops": "4", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_agent_slop": "0.020000", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-23T19:00:34.220 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_asio_thread_count": "2", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_async_recovery_min_cost": "100", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_backfill_scan_max": "512", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_backfill_scan_min": "64", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_backoff_on_degraded": "false", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_backoff_on_peering": "false", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_backoff_on_unfound": "true", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_beacon_report_interval": "300", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bench_duration": "30", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bench_max_block_size": "67108864", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_blkin_trace_all": "false", 2024-04-23T19:00:34.221 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_check_for_log_corruption": "false", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_class_update_on_start": "true", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_client_message_cap": "256", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_client_message_size_cap": "524288000", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_client_op_priority": "63", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_client_watch_timeout": "30", 2024-04-23T19:00:34.222 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_command_max_records": "256", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_compact_on_start": "false", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_crush_update_on_start": "true", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_crush_update_weight_set": "true", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_feed_pullee": "-1", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-23T19:00:34.223 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_misdirected_ops": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_no_acting_change": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_no_purge_strays": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_op_order": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_shutdown": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_trim_objects": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-23T19:00:34.224 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_verify_snaps": "false", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_keys": "1024", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_stride": "524288", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_default_notify_timeout": "30", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_delete_sleep": "0.000000", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-23T19:00:34.225 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_discard_disconnected_ops": "true", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_enable_op_tracker": "true", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_fast_info": "true", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_fast_shutdown": "true", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-23T19:00:34.226 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_function_tracing": "false", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_grace": "20", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_interval": "6", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_min_peers": "10", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_min_size": "2000", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_stale": "600", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_hit_set_max_size": "100000", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_hit_set_min_size": "1000", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-23T19:00:34.227 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_journal_size": "5120", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_kill_backfill_at": "0", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_map_cache_size": "50", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_map_dedup": "true", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_map_message_max": "40", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_map_share_max_epochs": "40", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_attr_name_len": "100", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_attr_size": "0", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_backfills": "1", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_markdown_count": "5", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_markdown_period": "600", 2024-04-23T19:00:34.228 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_object_name_len": "2048", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_object_namespace_len": "256", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_object_size": "134217728", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_pg_blocked_by": "16", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_pg_log_entries": "10000", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_pgls": "1024", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_push_cost": "8388608", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_push_objects": "10", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_scrubs": "3", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_trimming_pgs": "2", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_write_op_reply_len": "64", 2024-04-23T19:00:34.229 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_max_write_size": "90", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_profile": "balanced", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-23T19:00:34.230 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_base": "805306368", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_cache_min": "134217728", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_target": "4294967296", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_target_autotune": "false", 2024-04-23T19:00:34.231 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_min_pg_log_entries": "250", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_min_recovery_priority": "0", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mon_report_interval": "5", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_num_cache_shards": "32", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_num_op_tracker_shard": "32", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_numa_auto_affinity": "true", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_numa_node": "-1", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_numa_prefer_iface": "true", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_objecter_finishers": "1", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_objectstore": "bluestore", 2024-04-23T19:00:34.232 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_objectstore_fuse": "false", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_objectstore_tracing": "false", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_complaint_time": "30.000000", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_history_duration": "600", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_history_size": "20", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_history_slow_op_size": "20", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_log_threshold": "5", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_num_shards": "0", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_num_shards_hdd": "5", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_num_shards_ssd": "8", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-23T19:00:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_pq_min_cost": "65536", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_queue_cut_off": "high", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_op_thread_timeout": "15", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_open_classes_on_start": "true", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_os_flags": "0", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_peering_op_priority": "255", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_delete_cost": "1048576", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_delete_priority": "5", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-23T19:00:34.234 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_log_trim_max": "10000", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_log_trim_min": "100", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_crimson": "false", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-23T19:00:34.235 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_flags": "0", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_min_size": "0", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_pg_num": "32", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_pgp_num": "0", 2024-04-23T19:00:34.236 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_read_ratio": "70", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_size": "2", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_default_type": "replicated", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_push_per_object_cost": "1000", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recover_clone_overlap": "true", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_cost": "20971520", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_max_active": "0", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-23T19:00:34.237 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_max_single_start": "1", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_op_priority": "3", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_priority": "5", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_sleep": "0.000000", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_repair_during_recovery": "false", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_requested_scrub_priority": "120", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-23T19:00:34.238 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_auto_repair": "false", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_begin_hour": "0", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_begin_week_day": "0", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_chunk_max": "25", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_chunk_min": "5", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_cost": "52428800", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_during_recovery": "false", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_end_hour": "0", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_end_week_day": "0", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_event_cost": "4096", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-23T19:00:34.239 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_invalid_stats": "true", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_max_preemptions": "5", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_priority": "5", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_scrub_sleep": "0.000000", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_skip_data_digest": "false", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_smart_report_timeout": "5", 2024-04-23T19:00:34.240 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_snap_trim_cost": "1048576", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_snap_trim_priority": "5", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_target_transaction_size": "30", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-23T19:00:34.241 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_tracing": "false", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_use_stale_snap": "false", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "osdc_blkin_trace_all": "false", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_kill_at": "0", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_max_join_drift": "10", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_min": "500", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_min_wait": "0.050000", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_propose_interval": "1.000000", 2024-04-23T19:00:34.242 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_service_trim_max": "500", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_service_trim_min": "250", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_stash_full_interval": "25", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_trim_max": "500", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "paxos_trim_min": "250", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "perf": "true", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "public_addr": "-", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "public_addrv": "", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "public_bind_addr": "-", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "public_network": "", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "public_network_interface": "", 2024-04-23T19:00:34.243 INFO:teuthology.orchestra.run.smithi169.stdout: "qat_compressor_enabled": "false", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "qat_compressor_session_max_number": "256", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rados_mon_op_timeout": "0", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rados_osd_op_timeout": "0", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rados_tracing": "false", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_atime_update_interval": "60", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_balance_parent_reads": "false", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_balance_snap_reads": "false", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_blkin_trace_all": "false", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache": "true", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-23T19:00:34.244 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_policy": "writearound", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_size": "33554432", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_clone_copy_on_read": "false", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_compression_hint": "none", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_concurrent_management_ops": "10", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_clone_format": "auto", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_data_pool": "", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_features": "61", 2024-04-23T19:00:34.245 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_format": "2", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_map_options": "", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_order": "22", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_pool": "rbd", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_stripe_count": "0", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_default_stripe_unit": "0", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_enable_alloc_hint": "true", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_io_scheduler": "simple", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-23T19:00:34.246 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_order": "24", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_pool": "", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_journal_splay_width": "4", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_localize_parent_reads": "false", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_localize_snap_reads": "false", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-23T19:00:34.247 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-23T19:00:34.248 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_mtime_update_interval": "60", 2024-04-23T19:00:34.249 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_non_blocking_aio": "true", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_op_thread_timeout": "60", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_op_threads": "1", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_parent_cache_enabled": "false", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_plugins": "", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_bps_burst": "0", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_bps_limit": "0", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_exclude_ops": "0", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_iops_burst": "0", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-23T19:00:34.250 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_iops_limit": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-23T19:00:34.251 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_read_from_replica_policy": "default", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_skip_partial_discard": "true", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_tracing": "false", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_validate_names": "true", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rbd_validate_pool": "true", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "restapi_base_url": "", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "restapi_log_level": "", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_acl_grants_max_num": "100", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_admin_entry": "admin", 2024-04-23T19:00:34.252 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_backend_store": "rados", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_barbican_url": "", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_beast_enable_async": "true", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_counters_cache": "false", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_cache_enabled": "true", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_cache_expiry_interval": "900", 2024-04-23T19:00:34.253 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_cache_lru_size": "10000", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_config_store": "rados", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_content_length_compat": "false", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_copy_obj_progress": "true", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_cors_rules_max_num": "100", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_cross_domain_policy": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_addr": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-23T19:00:34.254 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_password": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_kmip_username": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_require_ssl": "true", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-23T19:00:34.255 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_addr": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_auth": "token", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_namespace": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_prefix": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_token_file": "", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_curl_buffersize": "524288", 2024-04-23T19:00:34.256 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_curl_low_speed_time": "300", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-23T19:00:34.257 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_d4n_port": "6379", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_log_changes_size": "1000", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_log_num_shards": "128", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_log_window": "30", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-23T19:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-23T19:00:34.259 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dns_name": "", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dns_s3website_name": "", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_dynamic_resharding": "true", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_gc_threads": "true", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_lc_threads": "true", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_ops_log": "false", 2024-04-23T19:00:34.260 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_quota_threads": "true", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_static_website": "false", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enable_usage_log": "false", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_enforce_swift_acls": "true", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_exit_timeout_secs": "120", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_expose_bucket": "false", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_extended_http_attrs": "", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_filter": "none", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_frontends": "beast port=7480", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_max_deferred": "50", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_max_objs": "32", 2024-04-23T19:00:34.261 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_gc_processor_period": "3600", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_init_timeout": "300", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_kafka_connection_idle": "300", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-23T19:00:34.262 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_domain": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_password": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_password_path": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_project": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_tenant": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_token": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_token_path": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_admin_user": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_api_version": "2", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_barbican_domain": "", 2024-04-23T19:00:34.263 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_barbican_password": "", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_barbican_project": "", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_barbican_user": "", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_url": "", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_debug_interval": "-1", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_lock_max_time": "90", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_max_objs": "32", 2024-04-23T19:00:34.264 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_max_rules": "1000", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_max_worker": "3", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lc_thread_delay": "0", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ldap_dnattr": "uid", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ldap_searchfilter": "", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ldap_uri": "", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-23T19:00:34.265 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_log_http_headers": "", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_log_object_name_utc": "false", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_attr_name_len": "0", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_attr_size": "0", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_chunk_size": "4194304", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-23T19:00:34.266 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_listing_results": "1000", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_notify_retries": "10", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_put_param_size": "1048576", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_put_size": "5368709120", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_max_slo_entries": "1000", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_md_log_max_shards": "64", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_mp_lock_max_time": "600", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-23T19:00:34.267 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_max_gc": "300", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_num_async_rados_threads": "32", 2024-04-23T19:00:34.268 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_num_control_oids": "8", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_numa_node": "-1", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_objexp_chunk_size": "100", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_objexp_gc_interval": "600", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_op_thread_timeout": "600", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_op_tracing": "false", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_opa_token": "", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_opa_url": "", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_opa_verify_ssl": "true", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-23T19:00:34.269 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ops_log_rados": "false", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_ops_log_socket_path": "", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_period_push_interval": "2.000000", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_posix_cache_lanes": "3", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_posix_cache_partitions": "3", 2024-04-23T19:00:34.270 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_print_continue": "true", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_rados_tracing": "false", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_realm": "", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_realm_id": "", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_region": "", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-23T19:00:34.271 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_request_uri": "", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_reshard_batch_size": "64", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_reshard_max_aio": "128", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_reshard_num_logs": "16", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_reshard_thread_interval": "600", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_resolve_cname": "false", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_run_sync_thread": "true", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-23T19:00:34.272 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_scheduler_type": "throttler", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_script_uri": "", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_service_provider_name": "", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_client_id": "", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_client_secret": "", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_entry": "sts", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_key": "sts", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_min_session_duration": "900", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sts_token_introspection_url": "", 2024-04-23T19:00:34.273 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_account_in_url": "false", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_auth_entry": "auth", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_auth_url": "", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_custom_header": "", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_need_stats": "true", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_tenant_name": "", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_token_expiration": "86400", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_url": "", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_url_prefix": "swift", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_lease_period": "120", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-23T19:00:34.274 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_thread_pool_size": "512", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_comment": "", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_createby": "", 2024-04-23T19:00:34.275 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_encoding": "", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_flag": "false", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_origin": "", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_torrent_tracker": "", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_trust_forwarded_https": "false", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_usage_max_shards": "32", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_usage_max_user_shards": "1", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_use_opa_authz": "false", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_counters_cache": "false", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-23T19:00:34.276 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_max_buckets": "1000", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_policies_max_num": "100", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_user_unique_email": "true", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_verify_ssl": "true", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_zone": "", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_zone_id": "", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_zonegroup": "", 2024-04-23T19:00:34.277 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_zonegroup_id": "", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rgwlc_auto_session_clear": "true", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_block_size": "4096", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cache_size": "536870912", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-23T19:00:34.278 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_index_type": "binary_search", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_partition_filters": "false", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_perf": "false", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "run_dir": "/var/run/ceph", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_block_create": "true", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_cache_lru_size": "67108864", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-23T19:00:34.279 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_default_max_object_size": "16777216", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_device_size": "53687091200", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_journal_batch_capacity": "16", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_main_device_type": "SSD", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "seastore_segment_size": "67108864", 2024-04-23T19:00:34.280 INFO:teuthology.orchestra.run.smithi169.stdout: "set_keepcaps": "false", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "setgroup": "", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "setuser": "", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "setuser_match_path": "", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "thp": "false", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "threadpool_default_timeout": "60", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout: "throttler_perf_counter": "true" 2024-04-23T19:00:34.281 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:34.283 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-23T19:00:34.422 INFO:teuthology.orchestra.run.smithi169.stdout:mon.a: {} 2024-04-23T19:00:34.422 INFO:teuthology.orchestra.run.smithi169.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T19:00:34.435 INFO:teuthology.orchestra.run.smithi169.stdout:mon.b: {} 2024-04-23T19:00:34.435 INFO:teuthology.orchestra.run.smithi169.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T19:00:34.444 INFO:teuthology.orchestra.run.smithi169.stdout:mon.c: {} 2024-04-23T19:00:34.445 INFO:teuthology.orchestra.run.smithi169.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T19:00:34.460 DEBUG:teuthology.orchestra.run.smithi193:> type ceph-objectstore-tool 2024-04-23T19:00:34.466 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-23T19:00:34.467 DEBUG:teuthology.orchestra.run.smithi169:> type ceph-objectstore-tool 2024-04-23T19:00:34.472 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-23T19:00:34.472 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T19:00:34.490 INFO:tasks.workunit:Pulling workunits from ref 5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T19:00:34.490 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T19:00:34.490 DEBUG:teuthology.orchestra.run.smithi169:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T19:00:34.491 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-23T19:00:34.491 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T19:00:34.491 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T19:00:34.492 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-23T19:00:34.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-04-23T19:00:34.492 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-23T19:00:34.493 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-23T19:00:34.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:00:34.493 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-23T19:00:34.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:00:34.494 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-23T19:00:34.494 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:00:34.516 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:34.518+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:34.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T19:00:34.520 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-23T19:00:34.520 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-23T19:00:34.568 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-23T19:00:34.568 DEBUG:teuthology.orchestra.run.smithi169:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-23T19:00:34.594 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:34.595+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:34.615 INFO:tasks.workunit:timeout=3h 2024-04-23T19:00:34.615 INFO:tasks.workunit:cleanup=True 2024-04-23T19:00:34.616 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/samarahu/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-23T19:00:34.638 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:34.639 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:34.639 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:34.643 INFO:tasks.workunit.client.0.smithi169.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T19:00:34.656 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:00:34.679 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:34.679 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:34.695 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:34.695+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:34.696 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:34.696 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:34.713 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:34.713 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:34.729 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:34.730 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:34.749 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:34.750 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:34.770 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:34.771 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:34.791 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:34.791 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:34.796 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:34.795+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:34.811 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:34.811 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:34.824 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:34.824 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:moved 0 / 530 (0%) 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:avg 66.25 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:stddev 9.7179 -> 9.7179 (expected baseline 7.61372) 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:min osd.2 with 47 -> 47 pgs (0.709434 -> 0.709434 * mean) 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:max osd.3 with 81 -> 81 pgs (1.22264 -> 1.22264 * mean) 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:oload 1000 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:max_change 0.05 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:max_change_osds 4 2024-04-23T19:00:34.825 INFO:teuthology.orchestra.run.smithi169.stdout:average_utilization 0.0003 2024-04-23T19:00:34.826 INFO:teuthology.orchestra.run.smithi169.stdout:overload_utilization 0.0030 2024-04-23T19:00:34.826 INFO:teuthology.orchestra.run.smithi169.stderr:no change 2024-04-23T19:00:34.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:00:34.846 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-04-23T19:00:34.847 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-04-23T19:00:34.897 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:34.898+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:34.956 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:00:34.998 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:34.998+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:35.006 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.006 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.020 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:00:35.099 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:35.099+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:35.169 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.169 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:00:35.231 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:35.234+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:35.294 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.294 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.300 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:35.302+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:35.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:00:35.401 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:35.402+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:35.458 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.458 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.471 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:00:35.503 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:35.503+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:35.604 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:35.606+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:35.620 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.621 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.634 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:00:35.705 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:35.703+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:35.790 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.791 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.803 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:00:35.805 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:35.807+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:35.906 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:35.906+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:35.919 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:35.919 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:35.932 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:moved 5 / 530 (0.943396%) 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:avg 66.25 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:stddev 9.7179 -> 9.76921 (expected baseline 7.61372) 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:min osd.2 with 47 -> 47 pgs (0.709434 -> 0.709434 * mean) 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:max osd.3 with 81 -> 81 pgs (1.22264 -> 1.22264 * mean) 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:oload 110 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:max_change 0.05 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:max_change_osds 4 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:average_utilization 0.0003 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:overload_utilization 0.0003 2024-04-23T19:00:35.980 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0 weight 1.0000 -> 0.9500 2024-04-23T19:00:36.001 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-04-23T19:00:36.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-04-23T19:00:36.007 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:36.007+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:36.098 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:36.099 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:36.108 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:36.111+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:36.113 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:00:36.210 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:36.210+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:36.224 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:36.224 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:36.237 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:00:36.323 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:36.326+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:36.390 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:36.390 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:36.403 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:00:36.450 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:36.450+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:36.513 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:36.510+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:36.534 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:36.534 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:36.549 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:00:36.637 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:36.638+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:36.714 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:36.714 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:36.715 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:36.718+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:36.728 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:00:36.815 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:36.814+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:36.836 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:00:36.886 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:36.887 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:36.900 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:00:36.941 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:36.942+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:36.975 INFO:teuthology.orchestra.run.smithi169.stdout:moved 4 / 530 (0.754717%) 2024-04-23T19:00:36.975 INFO:teuthology.orchestra.run.smithi169.stdout:avg 66.25 2024-04-23T19:00:36.975 INFO:teuthology.orchestra.run.smithi169.stdout:stddev 9.76921 -> 9.99687 (expected baseline 7.61372) 2024-04-23T19:00:36.975 INFO:teuthology.orchestra.run.smithi169.stdout:min osd.2 with 47 -> 48 pgs (0.709434 -> 0.724528 * mean) 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:max osd.3 with 81 -> 83 pgs (1.22264 -> 1.25283 * mean) 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:oload 110 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:max_change 0.05 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:max_change_osds 4 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:average_utilization 0.0003 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:overload_utilization 0.0003 2024-04-23T19:00:36.976 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0 weight 0.9500 -> 0.9000 2024-04-23T19:00:36.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:00:37.003 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-23T19:00:37.003 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-04-23T19:00:37.007 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:37.008 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:37.017 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:37.014+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:37.027 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:37.027 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:37.046 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:37.047 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:37.067 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:37.067 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:37.072 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:37.072 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:37.087 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:00:37.098 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:37.099 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:37.119 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:37.119 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:37.133 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:37.134+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:37.142 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:37.142 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:37.161 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:37.162 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:37.218 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:37.218+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:37.253 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:37.253 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:37.253 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:00:37.253 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:00:37.253 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:37.267 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:00:37.311 INFO:teuthology.orchestra.run.smithi169.stdout:moved 0 / 530 (0%) 2024-04-23T19:00:37.311 INFO:teuthology.orchestra.run.smithi169.stdout:avg 66.25 2024-04-23T19:00:37.311 INFO:teuthology.orchestra.run.smithi169.stdout:stddev 9.99687 -> 9.99687 (expected baseline 7.61372) 2024-04-23T19:00:37.311 INFO:teuthology.orchestra.run.smithi169.stdout:min osd.2 with 48 -> 48 pgs (0.724528 -> 0.724528 * mean) 2024-04-23T19:00:37.311 INFO:teuthology.orchestra.run.smithi169.stdout:max osd.3 with 83 -> 83 pgs (1.25283 -> 1.25283 * mean) 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stdout:oload 1000 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stdout:max_change 3 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stdout:max_change_osds 4 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stdout:average_utilization 0.0003 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stdout:overload_utilization 0.0030 2024-04-23T19:00:37.312 INFO:teuthology.orchestra.run.smithi169.stderr:no change 2024-04-23T19:00:37.318 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:37.318+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:37.329 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-23T19:00:37.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-04-23T19:00:37.419 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:37.418+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:37.431 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:37.431 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.098852396, 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085602839999999996, 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.432 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 48 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331687+0000", 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331702+0000", 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.486e-05 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331735+0000", 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3272999999999998e-05 2024-04-23T19:00:37.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331758+0000", 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2633000000000002e-05 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331922+0000", 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164356 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332211+0000", 2024-04-23T19:00:37.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028900799999999999 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332486+0000", 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275044 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.334812+0000", 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023258720000000001 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340081+0000", 2024-04-23T19:00:37.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052694229999999996 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340176+0000", 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4674999999999997e-05 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340244+0000", 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7726999999999997e-05 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253696272512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.089885642, 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035096519999999998, 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 49 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340652+0000", 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:00:37.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340660+0000", 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6320000000000008e-06 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340685+0000", 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5171e-05 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340698+0000", 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2525e-05 2024-04-23T19:00:37.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340814+0000", 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011663900000000001 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340955+0000", 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014095899999999999 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.341217+0000", 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026212099999999998 2024-04-23T19:00:37.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.342176+0000", 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095870199999999997 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344001+0000", 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00182467 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344070+0000", 2024-04-23T19:00:37.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9146000000000005e-05 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344160+0000", 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0038999999999996e-05 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.120214961, 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004746737, 2024-04-23T19:00:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 205 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310325+0000", 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6739999999999999e-06 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310342+0000", 2024-04-23T19:00:37.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7062999999999999e-05 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310372+0000", 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0116000000000001e-05 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310395+0000", 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3025999999999999e-05 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310720+0000", 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000325242 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311086+0000", 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036572699999999999 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311891+0000", 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080526000000000003 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.313563+0000", 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001672251 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314820+0000", 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001256783 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314965+0000", 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144699 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.315068+0000", 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102896 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.046610475, 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003601885, 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.449 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 220 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383929+0000", 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3160000000000001e-06 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383942+0000", 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3207000000000001e-05 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383971+0000", 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8883000000000001e-05 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384007+0000", 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6335999999999999e-05 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384141+0000", 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013357899999999999 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384482+0000", 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034114099999999999 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.385195+0000", 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00071281399999999998 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.386715+0000", 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001520478 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387369+0000", 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065341900000000003 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387457+0000", 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8172999999999998e-05 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387527+0000", 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0538999999999997e-05 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.454 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.394438+0000", 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.036097474, 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034638210000000002, 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 223 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.455 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394438+0000", 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394438+0000", 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394441+0000", 2024-04-23T19:00:37.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2699999999999999e-06 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394452+0000", 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1507e-05 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394483+0000", 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0463e-05 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394498+0000", 2024-04-23T19:00:37.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5393e-05 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394633+0000", 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013455300000000001 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394837+0000", 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020451099999999999 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.395243+0000", 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040543399999999998 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.396607+0000", 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013640799999999999 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.397758+0000", 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001151011 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.397836+0000", 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8563e-05 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.397902+0000", 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6036000000000003e-05 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.028520138999999, 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038023179999999998, 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 225 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402018+0000", 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2469999999999998e-06 2024-04-23T19:00:37.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402029+0000", 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1287000000000001e-05 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402061+0000", 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1405999999999997e-05 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402075+0000", 2024-04-23T19:00:37.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4593000000000001e-05 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402208+0000", 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013251300000000001 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402559+0000", 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035087699999999998 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.403320+0000", 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076132700000000001 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.404820+0000", 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015002679999999999 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405556+0000", 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00073558499999999997 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405709+0000", 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153065 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405818+0000", 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010915 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.406087+0000", 2024-04-23T19:00:37.466 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.024448657000001, 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033769210000000002, 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 226 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406087+0000", 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406087+0000", 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406090+0000", 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406101+0000", 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1569999999999999e-05 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406132+0000", 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1279000000000003e-05 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406147+0000", 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4552999999999999e-05 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406292+0000", 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014522299999999999 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406520+0000", 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022773800000000001 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406951+0000", 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043064999999999998 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.408556+0000", 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016051349999999999 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.409307+0000", 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00075177000000000002 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.409394+0000", 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6856999999999999e-05 2024-04-23T19:00:37.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.409464+0000", 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9931999999999994e-05 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:289 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.976326654999999, 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036979719999999999, 2024-04-23T19:00:37.472 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 289 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454211+0000", 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.567e-06 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454222+0000", 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1323e-05 2024-04-23T19:00:37.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454253+0000", 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0843000000000003e-05 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454273+0000", 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9524000000000001e-05 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454663+0000", 2024-04-23T19:00:37.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039064299999999998 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454787+0000", 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123843 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455041+0000", 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025372099999999999 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.456156+0000", 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011157179999999999 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457617+0000", 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001460109 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457783+0000", 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016658499999999999 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457907+0000", 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124096 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:344 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.967824177000001, 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040128489999999998, 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.478 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 344 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462715+0000", 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7530000000000002e-06 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462725+0000", 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0334e-05 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462750+0000", 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4646000000000001e-05 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462779+0000", 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9886000000000002e-05 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462929+0000", 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014975599999999999 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463152+0000", 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022302499999999999 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463707+0000", 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00055493600000000001 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465489+0000", 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017817460000000001 2024-04-23T19:00:37.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466471+0000", 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098237600000000008 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466620+0000", 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878600000000001 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466725+0000", 2024-04-23T19:00:37.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010460500000000001 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:378 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.960995606000001, 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045344950000000004, 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 378 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469543+0000", 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3800000000000001e-06 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469558+0000", 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5216e-05 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469592+0000", 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4276999999999997e-05 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469612+0000", 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9973e-05 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469788+0000", 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017606800000000001 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469994+0000", 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020596500000000001 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.470297+0000", 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000303145 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471492+0000", 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011943139999999999 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473878+0000", 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002386371 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473972+0000", 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3603000000000005e-05 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474075+0000", 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103183 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.489 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:467 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.911039012, 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040446919999999999, 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 467 2024-04-23T19:00:37.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519499+0000", 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519510+0000", 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1073000000000001e-05 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519539+0000", 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.885e-05 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519553+0000", 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4073000000000001e-05 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519679+0000", 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012514500000000001 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519800+0000", 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121048 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520138+0000", 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033848299999999999 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.521245+0000", 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011068479999999999 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523318+0000", 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020726669999999998 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523451+0000", 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013325300000000001 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523542+0000", 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0811999999999997e-05 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.495 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:512 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.885834626999999, 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046289160000000003, 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 512 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544703+0000", 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544714+0000", 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1036000000000001e-05 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544743+0000", 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9096000000000001e-05 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544764+0000", 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0273999999999999e-05 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544903+0000", 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139147 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545058+0000", 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015533499999999999 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545435+0000", 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037699499999999998 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546776+0000", 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013404840000000001 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549119+0000", 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002342939 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549255+0000", 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013645399999999999 2024-04-23T19:00:37.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549330+0000", 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5181999999999999e-05 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:513 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'5, mlcod=32'3)", 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.884382435999999, 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005799584, 2024-04-23T19:00:37.501 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546155+0000", 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.815e-06 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546169+0000", 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3691e-05 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546201+0000", 2024-04-23T19:00:37.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546221+0000", 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0462000000000002e-05 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546368+0000", 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014708500000000001 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546409+0000", 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0970000000000002e-05 2024-04-23T19:00:37.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551835+0000", 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054259850000000004 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551953+0000", 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117716 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.505 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:518 6.1c e32/26 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 32'4, mlcod=32'2)", 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.551111+0000", 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.879424867999999, 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003384822, 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551111+0000", 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551111+0000", 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551113+0000", 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8139999999999999e-06 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551127+0000", 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4042999999999999e-05 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551163+0000", 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6451e-05 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551182+0000", 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8189000000000002e-05 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551301+0000", 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011920400000000001 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551355+0000", 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3792999999999998e-05 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.554416+0000", 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030610979999999999 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.554496+0000", 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0229999999999996e-05 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.509 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:648 6.d 6:b72b1478:::obj_delete_at_hint.0000000033:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.784805259000001, 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038820410000000001, 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 648 2024-04-23T19:00:37.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645733+0000", 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.03e-06 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645743+0000", 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0433e-05 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645773+0000", 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0153000000000001e-05 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645794+0000", 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0747e-05 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645886+0000", 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1908000000000002e-05 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.646006+0000", 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119591 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.646227+0000", 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221258 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.647077+0000", 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00085041200000000004 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649399+0000", 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023215129999999999 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649520+0000", 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120754 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649613+0000", 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3241999999999999e-05 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.515 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.828111+0000", 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.602424784, 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034574100000000002, 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 763 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828111+0000", 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828111+0000", 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828114+0000", 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.334e-06 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828125+0000", 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1643e-05 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828156+0000", 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0769000000000003e-05 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828171+0000", 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4780000000000001e-05 2024-04-23T19:00:37.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828324+0000", 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015331599999999999 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828671+0000", 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034657999999999998 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.829231+0000", 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00056020600000000005 2024-04-23T19:00:37.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.830431+0000", 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001199908 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.831305+0000", 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00087387599999999999 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.831458+0000", 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153232 2024-04-23T19:00:37.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.831569+0000", 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110766 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.835421+0000", 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.595115336999999, 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034109470000000001, 2024-04-23T19:00:37.521 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 766 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835421+0000", 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835421+0000", 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835422+0000", 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.863e-06 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835432+0000", 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8099999999999992e-06 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835458+0000", 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6097000000000001e-05 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835471+0000", 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3003000000000001e-05 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835601+0000", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013000899999999999 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835951+0000", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034924100000000003 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.836488+0000", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00053740899999999998 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.837695+0000", 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012071510000000001 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.838567+0000", 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00087227300000000002 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.838721+0000", 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153542 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.838832+0000", 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110549 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:795 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.899542+0000", 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.530994062, 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034838569999999999, 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.527 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 795 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899542+0000", 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899542+0000", 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899544+0000", 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9929999999999998e-06 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899555+0000", 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0740000000000001e-05 2024-04-23T19:00:37.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899586+0000", 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1220000000000003e-05 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899600+0000", 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4474000000000001e-05 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899728+0000", 2024-04-23T19:00:37.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127205 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899963+0000", 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023527199999999999 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.900456+0000", 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049270200000000003 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.901831+0000", 2024-04-23T19:00:37.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013756930000000001 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.902749+0000", 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091810999999999998 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.902904+0000", 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015485499999999999 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.903026+0000", 2024-04-23T19:00:37.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121593 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.083480+0000", 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.347056221000001, 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003390241, 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 874 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083480+0000", 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083480+0000", 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083482+0000", 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2730000000000001e-06 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083493+0000", 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1440000000000001e-05 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083524+0000", 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0713000000000002e-05 2024-04-23T19:00:37.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083539+0000", 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4436e-05 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083700+0000", 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016169900000000001 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.084065+0000", 2024-04-23T19:00:37.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036495100000000002 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.084608+0000", 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054302599999999995 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.085882+0000", 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012736729999999999 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.086602+0000", 2024-04-23T19:00:37.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00072053500000000001 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.086753+0000", 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015089899999999999 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.086870+0000", 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011659600000000001 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.184109732, 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035628050000000001, 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 943 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:37.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246428+0000", 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2460000000000002e-06 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246440+0000", 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1226999999999999e-05 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246470+0000", 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0695999999999999e-05 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246491+0000", 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.048e-05 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246632+0000", 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141345 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246974+0000", 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034169799999999998 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.247552+0000", 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000578375 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.248830+0000", 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00127765 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249718+0000", 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00088796000000000003 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249870+0000", 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015214199999999999 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:37.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249989+0000", 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118986 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:37.544 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:37.546 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:00:37.546 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:37.546+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:37.646 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:37.650+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:moved 0 / 530 (0%) 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:avg 66.25 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:stddev 9.99687 -> 9.99687 (expected baseline 7.61372) 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:min osd.2 with 48 -> 48 pgs (0.724528 -> 0.724528 * mean) 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:max osd.3 with 83 -> 83 pgs (1.25283 -> 1.25283 * mean) 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:oload 1000 2024-04-23T19:00:37.659 INFO:teuthology.orchestra.run.smithi169.stdout:max_change 3 2024-04-23T19:00:37.660 INFO:teuthology.orchestra.run.smithi169.stdout:max_change_osds 4 2024-04-23T19:00:37.660 INFO:teuthology.orchestra.run.smithi169.stdout:average_utilization 0.0003 2024-04-23T19:00:37.660 INFO:teuthology.orchestra.run.smithi169.stdout:overload_utilization 0.0030 2024-04-23T19:00:37.660 INFO:teuthology.orchestra.run.smithi169.stderr:no change 2024-04-23T19:00:37.714 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:00:37.715 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:37.729 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:00:37.747 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:37.750+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:37.848 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:37.846+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:37.852 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:37.852 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:37.852 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:00:37.853 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:00:37.853 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:37.867 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:00:37.949 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:37.950+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:37.983 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:00:38.041 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:38.042 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:00:38.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:00:38.042 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:00:38.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.042 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4452.0:36 5.9 e25/24 5:90f831dc:::zone_info.2fe9869b-25a1-4b09-be2c-4e9208a04c5d:head v 25'1, mlcod=0'0)", 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.701988966999998, 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038336279999999999, 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339270+0000", 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0900000000000002e-07 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339278+0000", 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1200000000000002e-06 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339294+0000", 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6725e-05 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339311+0000", 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339445+0000", 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013386600000000001 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339497+0000", 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1471999999999998e-05 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343010+0000", 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035131630000000001 2024-04-23T19:00:38.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343103+0000", 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3076000000000001e-05 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.730122734, 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.047 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.048 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:00:38.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:00:38.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:00:38.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.054 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253696271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.709610799, 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056192660000000004, 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:38.055 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331650+0000", 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.977e-06 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331663+0000", 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2255999999999999e-05 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331694+0000", 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1250000000000001e-05 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331714+0000", 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9874e-05 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331876+0000", 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016204500000000001 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332107+0000", 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000231072 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333144+0000", 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001037615 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.335757+0000", 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026121959999999998 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336906+0000", 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001149478 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337056+0000", 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000149722 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337267+0000", 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000210781 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.349763+0000", 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.691495440000001, 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021362270000000001, 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 54 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.061 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349763+0000", 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349763+0000", 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349765+0000", 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3029999999999998e-06 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349776+0000", 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1236999999999999e-05 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349803+0000", 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6883e-05 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349817+0000", 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3771000000000001e-05 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349924+0000", 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010706500000000001 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.350091+0000", 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016676700000000001 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.350293+0000", 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000202299 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351432+0000", 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011393060000000001 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351760+0000", 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032817000000000002 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351848+0000", 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7595000000000004e-05 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351899+0000", 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0831000000000002e-05 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94253696266752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.352118+0000", 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.689139871, 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022597379999999999, 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 55 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352118+0000", 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352118+0000", 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352120+0000", 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.598e-06 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352126+0000", 2024-04-23T19:00:38.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7760000000000003e-06 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352143+0000", 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7493e-05 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352154+0000", 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0822000000000001e-05 2024-04-23T19:00:38.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352233+0000", 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8911000000000004e-05 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352329+0000", 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5910999999999997e-05 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352505+0000", 2024-04-23T19:00:38.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017617800000000001 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.353313+0000", 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080771599999999999 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.354220+0000", 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000907569 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.354295+0000", 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4544999999999999e-05 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.354378+0000", 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3219000000000004e-05 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:38.073 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.446023+0000", 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.595235114999999, 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001824879, 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446023+0000", 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446023+0000", 2024-04-23T19:00:38.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446025+0000", 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7540000000000001e-06 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446036+0000", 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1246e-05 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446066+0000", 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9805999999999999e-05 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446088+0000", 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2289999999999998e-05 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446210+0000", 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000122309 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446266+0000", 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.533e-05 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.447771+0000", 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001505068 2024-04-23T19:00:38.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.447848+0000", 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7076000000000005e-05 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.334549+0000", 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.706709550999999, 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021427970000000001, 2024-04-23T19:00:38.078 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334549+0000", 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334549+0000", 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334550+0000", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334562+0000", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2143e-05 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334586+0000", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4593e-05 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334600+0000", 2024-04-23T19:00:38.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.417e-05 2024-04-23T19:00:38.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334748+0000", 2024-04-23T19:00:38.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014801199999999999 2024-04-23T19:00:38.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334795+0000", 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6483999999999997e-05 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.336618+0000", 2024-04-23T19:00:38.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018229749999999999 2024-04-23T19:00:38.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.336691+0000", 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3430000000000007e-05 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:38.085 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.367056+0000", 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.674202352, 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00181514, 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367056+0000", 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367056+0000", 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367058+0000", 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4600000000000002e-06 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367073+0000", 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5184000000000001e-05 2024-04-23T19:00:38.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367108+0000", 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4758999999999997e-05 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367132+0000", 2024-04-23T19:00:38.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3586000000000001e-05 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367270+0000", 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138503 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367329+0000", 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8532999999999997e-05 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.368761+0000", 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014318289999999999 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.368871+0000", 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011028599999999999 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:289 6.a e32/26 6:5127e642:gc::gc.21:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.455199+0000", 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.586059238000001, 2024-04-23T19:00:38.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020423699999999999, 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455199+0000", 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455199+0000", 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455201+0000", 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.81e-06 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455217+0000", 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6126000000000001e-05 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455253+0000", 2024-04-23T19:00:38.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6693000000000003e-05 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455275+0000", 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1353e-05 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455416+0000", 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141182 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455480+0000", 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3709999999999998e-05 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457138+0000", 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001658514 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457241+0000", 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102982 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:344 6.a e32/26 6:5127e642:gc::gc.21:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.463941+0000", 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.577316973, 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021116709999999999, 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463941+0000", 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463941+0000", 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463943+0000", 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.77e-06 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463957+0000", 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4107000000000001e-05 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463999+0000", 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.197e-05 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464018+0000", 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9023000000000001e-05 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464145+0000", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012739899999999999 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464195+0000", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9812999999999999e-05 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465975+0000", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00178017 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466053+0000", 2024-04-23T19:00:38.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7418999999999999e-05 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:353 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.464612+0000", 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.576645975, 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023640760000000001, 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464612+0000", 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464612+0000", 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464614+0000", 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6169999999999999e-06 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464656+0000", 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464682+0000", 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.641e-05 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464698+0000", 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6276000000000001e-05 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464857+0000", 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015858199999999999 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464915+0000", 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.838e-05 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466854+0000", 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001938351 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466976+0000", 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012251300000000001 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:356 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:38.105 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.465535+0000", 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.575723168, 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021427799999999999, 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465535+0000", 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465535+0000", 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465537+0000", 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.756e-06 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465550+0000", 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3337e-05 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465583+0000", 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2472999999999999e-05 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465602+0000", 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9224000000000001e-05 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465829+0000", 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022721800000000001 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465887+0000", 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7822000000000003e-05 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.467560+0000", 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016728909999999999 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.467678+0000", 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118059 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.110 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:465 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.524276336, 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038716359999999999, 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516983+0000", 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0300000000000001e-06 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516991+0000", 2024-04-23T19:00:38.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1329999999999999e-06 2024-04-23T19:00:38.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517005+0000", 2024-04-23T19:00:38.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3720000000000001e-05 2024-04-23T19:00:38.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517019+0000", 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4773000000000001e-05 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517142+0000", 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012258200000000001 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517196+0000", 2024-04-23T19:00:38.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3582999999999998e-05 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520763+0000", 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035673900000000001 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520853+0000", 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0425000000000002e-05 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:466 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.521390010999999, 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037160069999999999, 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.119 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.120 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:00:38.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519869+0000", 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.347e-06 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519880+0000", 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0406e-05 2024-04-23T19:00:38.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519908+0000", 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7872999999999999e-05 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519921+0000", 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2962999999999999e-05 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520041+0000", 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120579 2024-04-23T19:00:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520093+0000", 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2231000000000002e-05 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523472+0000", 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00337858 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523584+0000", 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011202800000000001 2024-04-23T19:00:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.519188148, 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041565439999999999, 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522071+0000", 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4640000000000001e-06 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522082+0000", 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0566e-05 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522106+0000", 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4502999999999999e-05 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522124+0000", 2024-04-23T19:00:38.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522233+0000", 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108633 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522268+0000", 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5200000000000002e-05 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526155+0000", 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038872030000000001 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526227+0000", 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1248999999999995e-05 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:472 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'7, mlcod=32'5)", 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:00:38.130 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.515382433999999, 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029499230000000001, 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:00:38.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:00:38.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525877+0000", 2024-04-23T19:00:38.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.793e-06 2024-04-23T19:00:38.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525893+0000", 2024-04-23T19:00:38.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5302999999999999e-05 2024-04-23T19:00:38.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525922+0000", 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8736999999999999e-05 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525940+0000", 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8683000000000001e-05 2024-04-23T19:00:38.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526091+0000", 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015075200000000001 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526144+0000", 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3359999999999997e-05 2024-04-23T19:00:38.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528717+0000", 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025726820000000002 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528826+0000", 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108613 2024-04-23T19:00:38.137 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:477 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.528931+0000", 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.512326675000001, 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024840349999999999, 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.138 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528931+0000", 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528931+0000", 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528933+0000", 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.277e-06 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528944+0000", 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1436e-05 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528970+0000", 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6120000000000001e-05 2024-04-23T19:00:38.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528983+0000", 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2867000000000001e-05 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.529123+0000", 2024-04-23T19:00:38.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013965900000000001 2024-04-23T19:00:38.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.529165+0000", 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1940000000000002e-05 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.531333+0000", 2024-04-23T19:00:38.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021684400000000002 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.531415+0000", 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2295999999999999e-05 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:544 6.15 e32/26 6:ae95b544:::obj_delete_at_hint.0000000020:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.568228+0000", 2024-04-23T19:00:38.145 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.473030075, 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002248126, 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568228+0000", 2024-04-23T19:00:38.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568228+0000", 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568230+0000", 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.714e-06 2024-04-23T19:00:38.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568243+0000", 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.313e-05 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568279+0000", 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5760000000000003e-05 2024-04-23T19:00:38.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568297+0000", 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8612999999999999e-05 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568428+0000", 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013111000000000001 2024-04-23T19:00:38.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568480+0000", 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1450999999999999e-05 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.570395+0000", 2024-04-23T19:00:38.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001915606 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.570476+0000", 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0741999999999994e-05 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.151 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.152 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.152 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:619 6.1f e32/26 6:fd8d39b6:::obj_delete_at_hint.0000000030:head v 32'4, mlcod=32'2)", 2024-04-23T19:00:38.152 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.623183+0000", 2024-04-23T19:00:38.152 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.418075302, 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001878361, 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623183+0000", 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623183+0000", 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623185+0000", 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2129999999999998e-06 2024-04-23T19:00:38.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623203+0000", 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7516999999999998e-05 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623237+0000", 2024-04-23T19:00:38.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4329999999999998e-05 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623257+0000", 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9683000000000001e-05 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623376+0000", 2024-04-23T19:00:38.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119189 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623427+0000", 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1073999999999999e-05 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.624956+0000", 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015293049999999999 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.625061+0000", 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010505000000000001 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.159 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:831 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'13, mlcod=32'11)", 2024-04-23T19:00:38.159 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:00:38.159 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.055762892000001, 2024-04-23T19:00:38.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033014849999999998, 2024-04-23T19:00:38.160 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.160 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.160 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.160 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985497+0000", 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.587e-06 2024-04-23T19:00:38.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985510+0000", 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2813000000000001e-05 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985545+0000", 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5073000000000001e-05 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985569+0000", 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3816999999999999e-05 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985696+0000", 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127355 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985732+0000", 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5923999999999997e-05 2024-04-23T19:00:38.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.988714+0000", 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029824529999999999 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.988797+0000", 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2463e-05 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.166 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:38.168 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:00:38.169 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:38.166+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:38.269 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:38.270+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:38.335 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:38.335 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:38.335 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:00:38.335 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:38.350 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:00:38.370 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:38.370+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:38.471 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:38.471 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:38.471 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:00:38.471 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:00:38.471 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:38.472 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:38.474+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:38.485 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:00:38.572 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:38.574+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 35.439485478000002, 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:00:38.612 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:00:38.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:00:38.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:00:38.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:00:38.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:00:38.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.920299792000002, 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015286536999999999, 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.620 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 36 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690290+0000", 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8000000000000005e-07 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690297+0000", 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8340000000000001e-06 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690307+0000", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9729999999999992e-06 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690315+0000", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8900000000000007e-06 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697421+0000", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071065379999999999 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697541+0000", 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119973 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697734+0000", 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019309899999999999 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699272+0000", 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015377310000000001 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705412+0000", 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061400559999999996 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705507+0000", 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4596e-05 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705576+0000", 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9066999999999994e-05 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.920262837999999, 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015476504, 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 37 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.626 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690327+0000", 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6000000000000003e-07 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690333+0000", 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2299999999999996e-06 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690343+0000", 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4760000000000004e-06 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690350+0000", 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7640000000000005e-06 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698339+0000", 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079881740000000007 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698459+0000", 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120216 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698656+0000", 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019722899999999999 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699980+0000", 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001324389 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705665+0000", 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00568412 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705744+0000", 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9759999999999995e-05 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705803+0000", 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8486000000000002e-05 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.708401469999998, 2024-04-23T19:00:38.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541634, 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 107 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902189+0000", 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7999999999999993e-07 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902194+0000", 2024-04-23T19:00:38.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8429999999999998e-06 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902205+0000", 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0703999999999999e-05 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902213+0000", 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6229999999999997e-06 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907404+0000", 2024-04-23T19:00:38.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051909859999999999 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907531+0000", 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127136 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907762+0000", 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023144800000000001 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913252+0000", 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054900720000000004 2024-04-23T19:00:38.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913434+0000", 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018157500000000001 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913603+0000", 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016911500000000001 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913729+0000", 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012615200000000001 2024-04-23T19:00:38.637 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.707581263000002, 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011579644, 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 109 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903009+0000", 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2500000000000001e-06 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903085+0000", 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6149000000000006e-05 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903116+0000", 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.082e-05 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903175+0000", 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8975999999999999e-05 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909768+0000", 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065926159999999999 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909990+0000", 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022251199999999999 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.910357+0000", 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036634699999999999 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914187+0000", 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038306870000000002 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914316+0000", 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012860899999999999 2024-04-23T19:00:38.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914469+0000", 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015297600000000001 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914587+0000", 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118702 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.643 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.707359668000002, 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01161092, 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 110 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.644 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903231+0000", 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.333e-06 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903238+0000", 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5839999999999997e-06 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903259+0000", 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0656e-05 2024-04-23T19:00:38.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903269+0000", 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5999999999999996e-06 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912042+0000", 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087729060000000005 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912257+0000", 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021572099999999999 2024-04-23T19:00:38.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912623+0000", 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036538100000000002 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914697+0000", 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002074144 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914721+0000", 2024-04-23T19:00:38.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4283000000000001e-05 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914788+0000", 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6956000000000001e-05 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914840+0000", 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2355999999999998e-05 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.649 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.707302065, 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016792776999999998, 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.650 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 111 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903288+0000", 2024-04-23T19:00:38.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0869999999999999e-06 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903298+0000", 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4460000000000007e-06 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903325+0000", 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7903e-05 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903340+0000", 2024-04-23T19:00:38.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4416999999999999e-05 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914941+0000", 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011601034 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915176+0000", 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234818 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915534+0000", 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035823000000000002 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919638+0000", 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041041519999999998 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919811+0000", 2024-04-23T19:00:38.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173062 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919950+0000", 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138832 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920080+0000", 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129796 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.707199076000002, 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:00:38.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:00:38.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:00:38.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.707029097000003, 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.661 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:00:38.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:00:38.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.706978530999997, 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.667 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:38.673 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.706836191999997, 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.679 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.680 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:38.680 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.706632890999998, 2024-04-23T19:00:38.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:00:38.680 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.680 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.680 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.681 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.681 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.681 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.681 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:00:38.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.681 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:00:38.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:00:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.688 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.706593707000003, 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.689 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:00:38.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:00:38.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.436994996000003, 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011508065, 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.695 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 137 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173595+0000", 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6400000000000002e-07 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173716+0000", 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012079900000000001 2024-04-23T19:00:38.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173730+0000", 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4623999999999999e-05 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173739+0000", 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4470000000000006e-06 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178126+0000", 2024-04-23T19:00:38.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004386849 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178205+0000", 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9653000000000005e-05 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178326+0000", 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120433 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180954+0000", 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026283019999999999 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185035+0000", 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040809979999999997 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185069+0000", 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4208000000000002e-05 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185102+0000", 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3087999999999999e-05 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.436829512999999, 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01142832, 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.701 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 138 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:38.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0400000000000005e-07 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173767+0000", 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1160000000000004e-06 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173788+0000", 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1577999999999999e-05 2024-04-23T19:00:38.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173801+0000", 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2418999999999999e-05 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178735+0000", 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049345930000000001 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178784+0000", 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9221000000000002e-05 2024-04-23T19:00:38.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178865+0000", 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1019000000000005e-05 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180957+0000", 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002092062 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185134+0000", 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041769440000000001 2024-04-23T19:00:38.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185168+0000", 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3223999999999999e-05 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185188+0000", 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0339999999999998e-05 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.436773185, 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011476916, 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 139 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173817+0000", 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.54e-07 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173824+0000", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2860000000000002e-06 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173834+0000", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8179999999999999e-06 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173841+0000", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9700000000000002e-06 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179190+0000", 2024-04-23T19:00:38.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053495629999999999 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179237+0000", 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6490999999999999e-05 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179314+0000", 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7484000000000006e-05 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180960+0000", 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016456039999999999 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185224+0000", 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042640380000000004 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185260+0000", 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5839e-05 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185293+0000", 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3068999999999998e-05 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.436735900999999, 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011673032999999999, 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 140 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173854+0000", 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173958+0000", 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104038 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173975+0000", 2024-04-23T19:00:38.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7472000000000001e-05 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173984+0000", 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3270000000000001e-06 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179865+0000", 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058815259999999998 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179915+0000", 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0185000000000001e-05 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179995+0000", 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0007999999999997e-05 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.182979+0000", 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029830109999999998 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185377+0000", 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023988239999999999 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185464+0000", 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6388e-05 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185526+0000", 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2533999999999995e-05 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.436589980999997, 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011606877999999999, 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 141 2024-04-23T19:00:38.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174000+0000", 2024-04-23T19:00:38.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.37e-07 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174006+0000", 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.156e-06 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174016+0000", 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9660000000000008e-06 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174024+0000", 2024-04-23T19:00:38.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8050000000000007e-06 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180466+0000", 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006442138 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180517+0000", 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0701999999999997e-05 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180600+0000", 2024-04-23T19:00:38.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3046000000000004e-05 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.183367+0000", 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027671900000000001 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185558+0000", 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021912889999999999 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185585+0000", 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7203e-05 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185606+0000", 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0645999999999999e-05 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.723 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.097722849999997, 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011863655000000001, 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 158 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:38.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512867+0000", 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8500000000000002e-07 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512932+0000", 2024-04-23T19:00:38.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5547000000000001e-05 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512945+0000", 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2383e-05 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512951+0000", 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3849999999999999e-06 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518504+0000", 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055528000000000001 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518641+0000", 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013751200000000001 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518866+0000", 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022416100000000001 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524269+0000", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054038189999999998 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524549+0000", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027922800000000002 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524638+0000", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9546e-05 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524730+0000", 2024-04-23T19:00:38.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1788999999999998e-05 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.097628352000001, 2024-04-23T19:00:38.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011949143000000001, 2024-04-23T19:00:38.730 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:38.730 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:38.730 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:38.730 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:38.730 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:38.730 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 159 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:38.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3000000000000001e-07 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512965+0000", 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3950000000000001e-06 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512972+0000", 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3089999999999998e-06 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512976+0000", 2024-04-23T19:00:38.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0230000000000003e-06 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520114+0000", 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071381359999999998 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520251+0000", 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013729599999999999 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520474+0000", 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000222704 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524417+0000", 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039427969999999996 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:38.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524752+0000", 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033490400000000002 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524848+0000", 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5768999999999997e-05 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524910+0000", 2024-04-23T19:00:38.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2279999999999993e-05 2024-04-23T19:00:38.739 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.739 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.739 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.739 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:38.739 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:38.739 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:38.741 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:38.738+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:38.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:00:38.842 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:38.842+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:38.861 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:38.861 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:38.861 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:38.861 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:38.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:00:38.942 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:38.946+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:38.986 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:38.986 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:38.986 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:38.986 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:38.986 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:39.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:00:39.043 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:39.046+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:39.145 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:39.146+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:39.171 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:36 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'18)", 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.475336493999997, 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071214929999999996, 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8999999999999995e-07 2024-04-23T19:00:39.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699611+0000", 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5403000000000001e-05 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699630+0000", 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8963000000000001e-05 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699644+0000", 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4194e-05 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699751+0000", 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010655200000000001 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699784+0000", 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706619+0000", 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068350549999999996 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706706+0000", 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6916000000000006e-05 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:37 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'18)", 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.474432700999998, 2024-04-23T19:00:39.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062621999999999999, 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700490+0000", 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.164e-06 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700499+0000", 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4229999999999994e-06 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700517+0000", 2024-04-23T19:00:39.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700531+0000", 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4466e-05 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700640+0000", 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108659 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700675+0000", 2024-04-23T19:00:39.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5376999999999997e-05 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706710+0000", 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060344509999999997 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706751+0000", 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0873e-05 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:39 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'25, mlcod=15'22)", 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.464979728000003, 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036678790000000002, 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709943+0000", 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2130000000000001e-06 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710100+0000", 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157899 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710120+0000", 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9953e-05 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710136+0000", 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846e-05 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710326+0000", 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018969200000000001 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710373+0000", 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7429999999999998e-05 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713518+0000", 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003145096 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713609+0000", 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0749999999999997e-05 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.432471692, 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003697348, 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:39.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742452+0000", 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2560000000000001e-06 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742582+0000", 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013084300000000001 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742612+0000", 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9280000000000001e-05 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742625+0000", 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742795+0000", 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017040499999999999 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742832+0000", 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.718e-05 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746060+0000", 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003227592 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746147+0000", 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6649000000000003e-05 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'87)", 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.995516090000002, 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005142977, 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.189 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:39.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179406+0000", 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999995e-07 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179411+0000", 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4229999999999996e-06 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179422+0000", 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0387000000000001e-05 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179427+0000", 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5040000000000002e-06 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179496+0000", 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8825000000000006e-05 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179532+0000", 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5926999999999997e-05 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184514+0000", 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049821220000000003 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184548+0000", 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4060999999999998e-05 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'88)", 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.994825925000001, 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064279039999999999, 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180096+0000", 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7299999999999996e-07 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180160+0000", 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4571000000000002e-05 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180173+0000", 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180178+0000", 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7699999999999998e-06 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180252+0000", 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3413999999999999e-05 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180267+0000", 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5481999999999998e-05 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186445+0000", 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061775190000000002 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186523+0000", 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8189000000000006e-05 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'88)", 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.994308371000002, 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059950400000000001, 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2600000000000002e-07 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180618+0000", 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9200000000000003e-06 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180627+0000", 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2089999999999994e-06 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180632+0000", 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.994e-06 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184601+0000", 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039688450000000004 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184630+0000", 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8291999999999999e-05 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186527+0000", 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001897304 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186608+0000", 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.085e-05 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'88)", 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.993868032000002, 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056351600000000002, 2024-04-23T19:00:39.202 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181054+0000", 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181058+0000", 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8539999999999996e-06 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181067+0000", 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2269999999999993e-06 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181071+0000", 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999999e-06 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184933+0000", 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038617629999999998 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184954+0000", 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1566999999999999e-05 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186611+0000", 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016566020000000001 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186688+0000", 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7422999999999994e-05 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:39.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.993139550999999, 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050014279999999996, 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.06e-07 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181841+0000", 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9286999999999997e-05 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181850+0000", 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0019999999999995e-06 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181855+0000", 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6809999999999997e-06 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185296+0000", 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034414509999999999 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185328+0000", 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331000000000002e-05 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186694+0000", 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013659010000000001 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186783+0000", 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9269000000000002e-05 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.992579024999998, 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045398979999999997, 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182343+0000", 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182347+0000", 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6530000000000002e-06 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182356+0000", 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.473e-06 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182362+0000", 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.545e-06 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186093+0000", 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003730953 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186109+0000", 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6013999999999999e-05 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186789+0000", 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000679405 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186882+0000", 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3278999999999999e-05 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.214 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.656290470999998, 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035514740000000002, 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518632+0000", 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5000000000000001e-07 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518638+0000", 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4570000000000002e-06 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518653+0000", 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5016e-05 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518660+0000", 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5969999999999997e-06 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518732+0000", 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2323000000000005e-05 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518755+0000", 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2572999999999999e-05 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522106+0000", 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033516650000000002 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522182+0000", 2024-04-23T19:00:39.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5893e-05 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'107)", 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.655290135000001, 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00546606, 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519632+0000", 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3600000000000003e-07 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519637+0000", 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-06 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519649+0000", 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046999999999999e-05 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519654+0000", 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.48e-06 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519705+0000", 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1199999999999998e-05 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519720+0000", 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-05 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525015+0000", 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052950699999999998 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525097+0000", 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1546999999999997e-05 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'107)", 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.654108784999998, 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047363459999999998, 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520813+0000", 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.093e-06 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520855+0000", 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1835000000000002e-05 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520872+0000", 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6472000000000001e-05 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520879+0000", 2024-04-23T19:00:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3950000000000003e-06 2024-04-23T19:00:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520944+0000", 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5226000000000002e-05 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520965+0000", 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0845000000000001e-05 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525458+0000", 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044924739999999998 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525549+0000", 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1006000000000002e-05 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.228 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:40 5.5 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.822365339000001, 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042657119999999996, 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352557+0000", 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.344e-06 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352565+0000", 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6830000000000008e-06 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352582+0000", 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6816999999999998e-05 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352589+0000", 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4479999999999997e-06 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352642+0000", 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3353999999999998e-05 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352739+0000", 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7002000000000004e-05 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352864+0000", 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012422400000000001 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.354003+0000", 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001139698 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356727+0000", 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027232459999999999 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356768+0000", 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1346e-05 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356821+0000", 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3550000000000001e-05 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.857746889, 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091622649999999993, 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.234 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 206 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317178+0000", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9099999999999998e-06 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317197+0000", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9052999999999999e-05 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317250+0000", 2024-04-23T19:00:39.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2939999999999998e-05 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317269+0000", 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8522999999999999e-05 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317435+0000", 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166322 2024-04-23T19:00:39.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317452+0000", 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7102999999999999e-05 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322654+0000", 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052020549999999997 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322964+0000", 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030991699999999999 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.323626+0000", 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066229199999999998 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.325293+0000", 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001666774 2024-04-23T19:00:39.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326186+0000", 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000892627 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326269+0000", 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3195999999999994e-05 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326336+0000", 2024-04-23T19:00:39.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7552999999999995e-05 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.835600789000001, 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041039689999999998, 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.241 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 210 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339323+0000", 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339333+0000", 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339363+0000", 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0170000000000001e-05 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339378+0000", 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5003e-05 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339488+0000", 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109116 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339695+0000", 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020707500000000001 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.340176+0000", 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000481607 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.341758+0000", 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001581678 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343222+0000", 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001464382 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343314+0000", 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1359000000000004e-05 2024-04-23T19:00:39.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343424+0000", 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110559 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:379 6.11 e32/26 6:8eb99c53:gc::gc.22:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.703065950999999, 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034325369999999998, 2024-04-23T19:00:39.247 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471856+0000", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471862+0000", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7409999999999998e-06 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471874+0000", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2649e-05 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471880+0000", 2024-04-23T19:00:39.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6729999999999997e-06 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471928+0000", 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7562999999999998e-05 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471940+0000", 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2754e-05 2024-04-23T19:00:39.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475244+0000", 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003303374 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475288+0000", 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3962999999999999e-05 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.251 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:572 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.584849482999999, 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036716320000000002, 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 572 2024-04-23T19:00:39.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590073+0000", 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1090000000000001e-06 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590079+0000", 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0129999999999999e-06 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590103+0000", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4426e-05 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590111+0000", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590178+0000", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7082000000000006e-05 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590288+0000", 2024-04-23T19:00:39.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109795 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590426+0000", 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013844399999999999 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.591036+0000", 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060966299999999998 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593680+0000", 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026447229999999999 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593714+0000", 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569000000000003e-05 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593743+0000", 2024-04-23T19:00:39.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9187e-05 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:631 6.18 6:1aba6385:::obj_delete_at_hint.0000000031:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.541499264, 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040515170000000001, 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.258 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 631 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633424+0000", 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633435+0000", 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046000000000001e-05 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633467+0000", 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2369999999999997e-05 2024-04-23T19:00:39.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633506+0000", 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8748999999999998e-05 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633581+0000", 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4420999999999998e-05 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633641+0000", 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0012000000000001e-05 2024-04-23T19:00:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633751+0000", 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011013100000000001 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637365+0000", 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036144179999999999 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637405+0000", 2024-04-23T19:00:39.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9804e-05 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637444+0000", 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9419000000000003e-05 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637473+0000", 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8923000000000001e-05 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:636 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.539680379, 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054414340000000002, 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 636 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:39.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635246+0000", 2024-04-23T19:00:39.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3760000000000001e-06 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635257+0000", 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0835e-05 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635263+0000", 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8020000000000003e-06 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:39.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635305+0000", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1823999999999998e-05 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635351+0000", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5884000000000003e-05 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635448+0000", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6501000000000003e-05 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637362+0000", 2024-04-23T19:00:39.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019142790000000001 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640512+0000", 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031498979999999999 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640610+0000", 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7909000000000001e-05 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640682+0000", 2024-04-23T19:00:39.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2325999999999998e-05 2024-04-23T19:00:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:39.269 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:39.269 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:39.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:00:39.272 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:00:39.272 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:39.274+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:39.372 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:39.374+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:39.443 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:39.443 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:39.443 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:39.444 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:39.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:00:39.466 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:39.466 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:39.473 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:39.474+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:39.487 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:39.487 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:39.512 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:39.512 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:39.537 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:39.537 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:39.557 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:39.557 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:39.574 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:39.574+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:39.578 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:39.579 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:39.579 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:39.579 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:39.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:00:39.601 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:39.601 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:39.623 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:39.623 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:39.683 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:39.686+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:39.710 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:39.710 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:39.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:00:39.811 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:39.814+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:39.876 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:39.878+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:39.893 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:39.894 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:39.910 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:00:39.995 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:39.998+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:40.016 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:00:40.079 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:40.078+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:40.092 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.092 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.107 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:00:40.179 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:40.178+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:40.227 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.227 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:00:40.280 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:40.278+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:40.355 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.355 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.368 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:00:40.415 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:40.418+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:40.481 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:40.482+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:40.486 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.486 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.500 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:00:40.587 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:40.590+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:40.668 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.668 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.682 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:40.682+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:40.683 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:00:40.784 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:40.786+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:40.814 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.815 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.829 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:00:40.886 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:40.886+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:40.954 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:40.954 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:40.968 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:00:41.003 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:00:41.013 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:41.014+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:41.090 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:41.090+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:41.094 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:41.094 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:41.108 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:00:41.193 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:41.194+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:41.274 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:41.274 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:41.289 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:00:41.291 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:41.294+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:41.392 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:41.390+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:41.456 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:41.456 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:41.470 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:00:41.514 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:41.514+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:41.594 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:41.594+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:41.633 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:41.633 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:41.641 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:00:41.647 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:00:41.697 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:41.698+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:41.767 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:41.767 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:41.781 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:00:41.798 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:41.798 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:41.816 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:41.816 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:41.826 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:41.826+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:41.836 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:41.853 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:41.875 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:41.876 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:41.894 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:41.896 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:41.894+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:41.913 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:41.913 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:41.933 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:41.933 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:41.946 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:41.946 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:41.946 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:00:41.946 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:00:41.947 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:41.961 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:00:41.996 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:41.997+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:42.098 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:42.097+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:42.119 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:42.119 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:00:42.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:00:42.119 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:00:42.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4452.0:36 5.9 e25/24 5:90f831dc:::zone_info.2fe9869b-25a1-4b09-be2c-4e9208a04c5d:head v 25'1, mlcod=0'0)", 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.781830992, 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038336279999999999, 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339270+0000", 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0900000000000002e-07 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339278+0000", 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1200000000000002e-06 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339294+0000", 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6725e-05 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339311+0000", 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339445+0000", 2024-04-23T19:00:42.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013386600000000001 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339497+0000", 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1471999999999998e-05 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343010+0000", 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035131630000000001 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343103+0000", 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3076000000000001e-05 2024-04-23T19:00:42.123 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.809964759, 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:42.124 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:00:42.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253696271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.789452824000001, 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056192660000000004, 2024-04-23T19:00:42.130 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331650+0000", 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.977e-06 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331663+0000", 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2255999999999999e-05 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331694+0000", 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1250000000000001e-05 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331714+0000", 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9874e-05 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331876+0000", 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016204500000000001 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332107+0000", 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000231072 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333144+0000", 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001037615 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.335757+0000", 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026121959999999998 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336906+0000", 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001149478 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337056+0000", 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000149722 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337267+0000", 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000210781 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.135 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.349763+0000", 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.771337464999998, 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021362270000000001, 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:42.136 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 54 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349763+0000", 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349763+0000", 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349765+0000", 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3029999999999998e-06 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349776+0000", 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1236999999999999e-05 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349803+0000", 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6883e-05 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349817+0000", 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3771000000000001e-05 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.349924+0000", 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010706500000000001 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.350091+0000", 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016676700000000001 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.350293+0000", 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000202299 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351432+0000", 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011393060000000001 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351760+0000", 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032817000000000002 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351848+0000", 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7595000000000004e-05 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.351899+0000", 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0831000000000002e-05 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94253696266752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.352118+0000", 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.768981896, 2024-04-23T19:00:42.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022597379999999999, 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 55 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352118+0000", 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352118+0000", 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352120+0000", 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.598e-06 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352126+0000", 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7760000000000003e-06 2024-04-23T19:00:42.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352143+0000", 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7493e-05 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352154+0000", 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0822000000000001e-05 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352233+0000", 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8911000000000004e-05 2024-04-23T19:00:42.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352329+0000", 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5910999999999997e-05 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.352505+0000", 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017617800000000001 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.353313+0000", 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080771599999999999 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.354220+0000", 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000907569 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.354295+0000", 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4544999999999999e-05 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.354378+0000", 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3219000000000004e-05 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.146 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.446023+0000", 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.675077139999999, 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001824879, 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446023+0000", 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446023+0000", 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446025+0000", 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7540000000000001e-06 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446036+0000", 2024-04-23T19:00:42.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1246e-05 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446066+0000", 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9805999999999999e-05 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446088+0000", 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2289999999999998e-05 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446210+0000", 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000122309 2024-04-23T19:00:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.446266+0000", 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.533e-05 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.447771+0000", 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001505068 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.447848+0000", 2024-04-23T19:00:42.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7076000000000005e-05 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.334549+0000", 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.786551576000001, 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021427970000000001, 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334549+0000", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334549+0000", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334550+0000", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334562+0000", 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2143e-05 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334586+0000", 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4593e-05 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334600+0000", 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.417e-05 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334748+0000", 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014801199999999999 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.334795+0000", 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6483999999999997e-05 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.336618+0000", 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018229749999999999 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.336691+0000", 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3430000000000007e-05 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.367056+0000", 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.754044377, 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00181514, 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.155 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367056+0000", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367056+0000", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367058+0000", 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4600000000000002e-06 2024-04-23T19:00:42.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367073+0000", 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5184000000000001e-05 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367108+0000", 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4758999999999997e-05 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367132+0000", 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3586000000000001e-05 2024-04-23T19:00:42.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367270+0000", 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138503 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.367329+0000", 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8532999999999997e-05 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.368761+0000", 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014318289999999999 2024-04-23T19:00:42.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.368871+0000", 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011028599999999999 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:289 6.a e32/26 6:5127e642:gc::gc.21:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.455199+0000", 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.665901263, 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020423699999999999, 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.159 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455199+0000", 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455199+0000", 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455201+0000", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.81e-06 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455217+0000", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6126000000000001e-05 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455253+0000", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6693000000000003e-05 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455275+0000", 2024-04-23T19:00:42.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1353e-05 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455416+0000", 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141182 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455480+0000", 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3709999999999998e-05 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457138+0000", 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001658514 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457241+0000", 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102982 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:344 6.a e32/26 6:5127e642:gc::gc.21:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.463941+0000", 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.657158998, 2024-04-23T19:00:42.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021116709999999999, 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463941+0000", 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463941+0000", 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463943+0000", 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.77e-06 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463957+0000", 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4107000000000001e-05 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463999+0000", 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.197e-05 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464018+0000", 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9023000000000001e-05 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464145+0000", 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012739899999999999 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464195+0000", 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9812999999999999e-05 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465975+0000", 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00178017 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466053+0000", 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7418999999999999e-05 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:353 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.464612+0000", 2024-04-23T19:00:42.167 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.656488, 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023640760000000001, 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464612+0000", 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464612+0000", 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464614+0000", 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6169999999999999e-06 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464656+0000", 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464682+0000", 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.641e-05 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464698+0000", 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6276000000000001e-05 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464857+0000", 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015858199999999999 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.464915+0000", 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.838e-05 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466854+0000", 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001938351 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466976+0000", 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012251300000000001 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.171 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:356 6.5 e32/26 6:a60f9269:lc::lua_package_allowlist:head v 32'2, mlcod=0'0)", 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.465535+0000", 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.655565192999999, 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021427799999999999, 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465535+0000", 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465535+0000", 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465537+0000", 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.756e-06 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465550+0000", 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3337e-05 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465583+0000", 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2472999999999999e-05 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465602+0000", 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9224000000000001e-05 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465829+0000", 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022721800000000001 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465887+0000", 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7822000000000003e-05 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.467560+0000", 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016728909999999999 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.467678+0000", 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118059 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.175 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:465 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.604118360999999, 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038716359999999999, 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:00:42.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516983+0000", 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0300000000000001e-06 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516991+0000", 2024-04-23T19:00:42.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1329999999999999e-06 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517005+0000", 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3720000000000001e-05 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517019+0000", 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4773000000000001e-05 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517142+0000", 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012258200000000001 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517196+0000", 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3582999999999998e-05 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520763+0000", 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035673900000000001 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520853+0000", 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0425000000000002e-05 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:466 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.601232036000001, 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037160069999999999, 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519869+0000", 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.347e-06 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519880+0000", 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0406e-05 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519908+0000", 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7872999999999999e-05 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519921+0000", 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2962999999999999e-05 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520041+0000", 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120579 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520093+0000", 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2231000000000002e-05 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523472+0000", 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00337858 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523584+0000", 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011202800000000001 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.599030172999999, 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041565439999999999, 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.184 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522071+0000", 2024-04-23T19:00:42.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4640000000000001e-06 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522082+0000", 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0566e-05 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522106+0000", 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4502999999999999e-05 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522124+0000", 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522233+0000", 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108633 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522268+0000", 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5200000000000002e-05 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526155+0000", 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038872030000000001 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526227+0000", 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1248999999999995e-05 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:472 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'7, mlcod=32'5)", 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:00:42.188 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.595224459000001, 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029499230000000001, 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:00:42.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525877+0000", 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.793e-06 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525893+0000", 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5302999999999999e-05 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525922+0000", 2024-04-23T19:00:42.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8736999999999999e-05 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525940+0000", 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8683000000000001e-05 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526091+0000", 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015075200000000001 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526144+0000", 2024-04-23T19:00:42.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3359999999999997e-05 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528717+0000", 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025726820000000002 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528826+0000", 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108613 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.192 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:477 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.528931+0000", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.5921687, 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024840349999999999, 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528931+0000", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528931+0000", 2024-04-23T19:00:42.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528933+0000", 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.277e-06 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528944+0000", 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1436e-05 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528970+0000", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6120000000000001e-05 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528983+0000", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2867000000000001e-05 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.529123+0000", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013965900000000001 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.529165+0000", 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1940000000000002e-05 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.531333+0000", 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021684400000000002 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.531415+0000", 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2295999999999999e-05 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:544 6.15 e32/26 6:ae95b544:::obj_delete_at_hint.0000000020:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.568228+0000", 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.5528721, 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002248126, 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568228+0000", 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568228+0000", 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568230+0000", 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.714e-06 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568243+0000", 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.313e-05 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568279+0000", 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5760000000000003e-05 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568297+0000", 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8612999999999999e-05 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568428+0000", 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013111000000000001 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.568480+0000", 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1450999999999999e-05 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.570395+0000", 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001915606 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.570476+0000", 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0741999999999994e-05 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.200 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:619 6.1f e32/26 6:fd8d39b6:::obj_delete_at_hint.0000000030:head v 32'4, mlcod=32'2)", 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.623183+0000", 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.497917327, 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001878361, 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623183+0000", 2024-04-23T19:00:42.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623183+0000", 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623185+0000", 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2129999999999998e-06 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623203+0000", 2024-04-23T19:00:42.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7516999999999998e-05 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623237+0000", 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4329999999999998e-05 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623257+0000", 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9683000000000001e-05 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623376+0000", 2024-04-23T19:00:42.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119189 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.623427+0000", 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1073999999999999e-05 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.624956+0000", 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015293049999999999 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.625061+0000", 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010505000000000001 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:831 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'13, mlcod=32'11)", 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.135604917, 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033014849999999998, 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985497+0000", 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.587e-06 2024-04-23T19:00:42.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985510+0000", 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2813000000000001e-05 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985545+0000", 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5073000000000001e-05 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985569+0000", 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3816999999999999e-05 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985696+0000", 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127355 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985732+0000", 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5923999999999997e-05 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.988714+0000", 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029824529999999999 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.988797+0000", 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2463e-05 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.209 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:42.211 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:00:42.211 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:42.209+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:42.312 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:42.310+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:42.337 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:42.337 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:42.338 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:00:42.338 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:42.352 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:00:42.438 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:42.438+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:42.513 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:42.514+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:42.516 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:42.517 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:42.517 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:00:42.517 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:00:42.517 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:42.531 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:00:42.617 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:42.618+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:42.702 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 39.530911258000003, 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.703 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:42.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:00:42.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:00:42.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 39.011725572000003, 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015286536999999999, 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 36 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.710 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690290+0000", 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8000000000000005e-07 2024-04-23T19:00:42.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690297+0000", 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8340000000000001e-06 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690307+0000", 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9729999999999992e-06 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690315+0000", 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8900000000000007e-06 2024-04-23T19:00:42.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697421+0000", 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071065379999999999 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697541+0000", 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119973 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697734+0000", 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019309899999999999 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699272+0000", 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015377310000000001 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705412+0000", 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061400559999999996 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705507+0000", 2024-04-23T19:00:42.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4596e-05 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705576+0000", 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9066999999999994e-05 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 39.011688618000001, 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015476504, 2024-04-23T19:00:42.715 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 37 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690327+0000", 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6000000000000003e-07 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690333+0000", 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2299999999999996e-06 2024-04-23T19:00:42.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690343+0000", 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4760000000000004e-06 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690350+0000", 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7640000000000005e-06 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698339+0000", 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079881740000000007 2024-04-23T19:00:42.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698459+0000", 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120216 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698656+0000", 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019722899999999999 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699980+0000", 2024-04-23T19:00:42.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001324389 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705665+0000", 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00568412 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705744+0000", 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9759999999999995e-05 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705803+0000", 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8486000000000002e-05 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.79982725, 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541634, 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.721 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 107 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:42.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902189+0000", 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7999999999999993e-07 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902194+0000", 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8429999999999998e-06 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902205+0000", 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0703999999999999e-05 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902213+0000", 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6229999999999997e-06 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907404+0000", 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051909859999999999 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907531+0000", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127136 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907762+0000", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023144800000000001 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913252+0000", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054900720000000004 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913434+0000", 2024-04-23T19:00:42.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018157500000000001 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913603+0000", 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016911500000000001 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913729+0000", 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012615200000000001 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.799007043000003, 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011579644, 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 109 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903009+0000", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2500000000000001e-06 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903085+0000", 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6149000000000006e-05 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903116+0000", 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.082e-05 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903175+0000", 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8975999999999999e-05 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909768+0000", 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065926159999999999 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909990+0000", 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022251199999999999 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.910357+0000", 2024-04-23T19:00:42.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036634699999999999 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914187+0000", 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038306870000000002 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914316+0000", 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012860899999999999 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914469+0000", 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015297600000000001 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914587+0000", 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118702 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798785447999997, 2024-04-23T19:00:42.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01161092, 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 110 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903231+0000", 2024-04-23T19:00:42.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.333e-06 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903238+0000", 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5839999999999997e-06 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903259+0000", 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0656e-05 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903269+0000", 2024-04-23T19:00:42.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5999999999999996e-06 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912042+0000", 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087729060000000005 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912257+0000", 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021572099999999999 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912623+0000", 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036538100000000002 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914697+0000", 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002074144 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914721+0000", 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4283000000000001e-05 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914788+0000", 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6956000000000001e-05 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914840+0000", 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2355999999999998e-05 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.738 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798727845000002, 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016792776999999998, 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 111 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903288+0000", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0869999999999999e-06 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903298+0000", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4460000000000007e-06 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903325+0000", 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7903e-05 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903340+0000", 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4416999999999999e-05 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914941+0000", 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011601034 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915176+0000", 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234818 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915534+0000", 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035823000000000002 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919638+0000", 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041041519999999998 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919811+0000", 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173062 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919950+0000", 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138832 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920080+0000", 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129796 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.743 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798624856000004, 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.744 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:00:42.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:00:42.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:00:42.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798454876999998, 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:00:42.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798404310999999, 2024-04-23T19:00:42.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:42.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:00:42.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.758 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798261971999999, 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.761 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:00:42.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798058671, 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:00:42.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:00:42.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:42.772 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.798019486999998, 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:42.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.528420775999997, 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011508065, 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.778 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 137 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:42.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173595+0000", 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6400000000000002e-07 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173716+0000", 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012079900000000001 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173730+0000", 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4623999999999999e-05 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173739+0000", 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4470000000000006e-06 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178126+0000", 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004386849 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178205+0000", 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9653000000000005e-05 2024-04-23T19:00:42.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178326+0000", 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120433 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180954+0000", 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026283019999999999 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185035+0000", 2024-04-23T19:00:42.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040809979999999997 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185069+0000", 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4208000000000002e-05 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185102+0000", 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3087999999999999e-05 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.528255293000001, 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01142832, 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 138 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0400000000000005e-07 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173767+0000", 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1160000000000004e-06 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173788+0000", 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1577999999999999e-05 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173801+0000", 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2418999999999999e-05 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178735+0000", 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049345930000000001 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178784+0000", 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9221000000000002e-05 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178865+0000", 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1019000000000005e-05 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180957+0000", 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002092062 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185134+0000", 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041769440000000001 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185168+0000", 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3223999999999999e-05 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185188+0000", 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0339999999999998e-05 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.528198965000001, 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011476916, 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.789 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 139 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:42.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173817+0000", 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.54e-07 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173824+0000", 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2860000000000002e-06 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173834+0000", 2024-04-23T19:00:42.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8179999999999999e-06 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173841+0000", 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9700000000000002e-06 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179190+0000", 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053495629999999999 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179237+0000", 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6490999999999999e-05 2024-04-23T19:00:42.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179314+0000", 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7484000000000006e-05 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180960+0000", 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016456039999999999 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185224+0000", 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042640380000000004 2024-04-23T19:00:42.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185260+0000", 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5839e-05 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185293+0000", 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3068999999999998e-05 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.794 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.528161681, 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011673032999999999, 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 140 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173854+0000", 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173958+0000", 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104038 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173975+0000", 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7472000000000001e-05 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173984+0000", 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3270000000000001e-06 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179865+0000", 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058815259999999998 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179915+0000", 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0185000000000001e-05 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179995+0000", 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0007999999999997e-05 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.182979+0000", 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029830109999999998 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185377+0000", 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023988239999999999 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185464+0000", 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6388e-05 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185526+0000", 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2533999999999995e-05 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.528015760999999, 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011606877999999999, 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.800 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 141 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174000+0000", 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.37e-07 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174006+0000", 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.156e-06 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174016+0000", 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9660000000000008e-06 2024-04-23T19:00:42.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174024+0000", 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8050000000000007e-06 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180466+0000", 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006442138 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180517+0000", 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0701999999999997e-05 2024-04-23T19:00:42.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180600+0000", 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3046000000000004e-05 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.183367+0000", 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027671900000000001 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185558+0000", 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021912889999999999 2024-04-23T19:00:42.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185585+0000", 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7203e-05 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185606+0000", 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0645999999999999e-05 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.805 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.189148629999998, 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011863655000000001, 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 158 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512867+0000", 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8500000000000002e-07 2024-04-23T19:00:42.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512932+0000", 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5547000000000001e-05 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512945+0000", 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2383e-05 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512951+0000", 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3849999999999999e-06 2024-04-23T19:00:42.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518504+0000", 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055528000000000001 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518641+0000", 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013751200000000001 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518866+0000", 2024-04-23T19:00:42.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022416100000000001 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524269+0000", 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054038189999999998 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524549+0000", 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027922800000000002 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524638+0000", 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9546e-05 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524730+0000", 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1788999999999998e-05 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.189054132000003, 2024-04-23T19:00:42.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011949143000000001, 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 159 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3000000000000001e-07 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512965+0000", 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3950000000000001e-06 2024-04-23T19:00:42.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512972+0000", 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3089999999999998e-06 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512976+0000", 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0230000000000003e-06 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:42.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520114+0000", 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071381359999999998 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520251+0000", 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013729599999999999 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520474+0000", 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000222704 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524417+0000", 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039427969999999996 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524752+0000", 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033490400000000002 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524848+0000", 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5768999999999997e-05 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:42.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524910+0000", 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2279999999999993e-05 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:42.817 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:42.819 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:42.818+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:42.819 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:00:42.920 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:42.921+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:42.947 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:42.947 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:42.947 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:42.948 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:42.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:00:43.020 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:43.018+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:43.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:00:43.121 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:43.121+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:43.129 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:43.129 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:43.130 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:43.130 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:43.130 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:43.144 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:00:43.222 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:43.222+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:36 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'18)", 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.603870219000001, 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071214929999999996, 2024-04-23T19:00:43.301 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8999999999999995e-07 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699611+0000", 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5403000000000001e-05 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699630+0000", 2024-04-23T19:00:43.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8963000000000001e-05 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699644+0000", 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4194e-05 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699751+0000", 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010655200000000001 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699784+0000", 2024-04-23T19:00:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706619+0000", 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068350549999999996 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706706+0000", 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6916000000000006e-05 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:37 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'18)", 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.602966426000002, 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062621999999999999, 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700490+0000", 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.164e-06 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700499+0000", 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4229999999999994e-06 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700517+0000", 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700531+0000", 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4466e-05 2024-04-23T19:00:43.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700640+0000", 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108659 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700675+0000", 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5376999999999997e-05 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706710+0000", 2024-04-23T19:00:43.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060344509999999997 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706751+0000", 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0873e-05 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:39 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'25, mlcod=15'22)", 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.593513453, 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036678790000000002, 2024-04-23T19:00:43.310 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709943+0000", 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2130000000000001e-06 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710100+0000", 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157899 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710120+0000", 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9953e-05 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710136+0000", 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846e-05 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710326+0000", 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018969200000000001 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710373+0000", 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7429999999999998e-05 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713518+0000", 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003145096 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713609+0000", 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0749999999999997e-05 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.561005416999997, 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003697348, 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742452+0000", 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2560000000000001e-06 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742582+0000", 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013084300000000001 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742612+0000", 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9280000000000001e-05 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742625+0000", 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742795+0000", 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017040499999999999 2024-04-23T19:00:43.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742832+0000", 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.718e-05 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746060+0000", 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003227592 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746147+0000", 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6649000000000003e-05 2024-04-23T19:00:43.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'87)", 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.124049814999999, 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005142977, 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179406+0000", 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999995e-07 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179411+0000", 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4229999999999996e-06 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179422+0000", 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0387000000000001e-05 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179427+0000", 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5040000000000002e-06 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179496+0000", 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8825000000000006e-05 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179532+0000", 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5926999999999997e-05 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184514+0000", 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049821220000000003 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184548+0000", 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4060999999999998e-05 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'88)", 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.123359649999998, 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064279039999999999, 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.323 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180096+0000", 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7299999999999996e-07 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180160+0000", 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4571000000000002e-05 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180173+0000", 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180178+0000", 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7699999999999998e-06 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180252+0000", 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3413999999999999e-05 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180267+0000", 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5481999999999998e-05 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186445+0000", 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061775190000000002 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186523+0000", 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8189000000000006e-05 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'88)", 2024-04-23T19:00:43.327 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.122842095999999, 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059950400000000001, 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:43.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2600000000000002e-07 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180618+0000", 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9200000000000003e-06 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180627+0000", 2024-04-23T19:00:43.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2089999999999994e-06 2024-04-23T19:00:43.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180632+0000", 2024-04-23T19:00:43.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.994e-06 2024-04-23T19:00:43.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184601+0000", 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039688450000000004 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184630+0000", 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8291999999999999e-05 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186527+0000", 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001897304 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186608+0000", 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.085e-05 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'88)", 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.122401756999999, 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056351600000000002, 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.333 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181054+0000", 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181058+0000", 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8539999999999996e-06 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181067+0000", 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2269999999999993e-06 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181071+0000", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999999e-06 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184933+0000", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038617629999999998 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184954+0000", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1566999999999999e-05 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186611+0000", 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016566020000000001 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186688+0000", 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7422999999999994e-05 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:43.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.121673276000003, 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050014279999999996, 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.06e-07 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181841+0000", 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9286999999999997e-05 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181850+0000", 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0019999999999995e-06 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181855+0000", 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6809999999999997e-06 2024-04-23T19:00:43.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185296+0000", 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034414509999999999 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185328+0000", 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331000000000002e-05 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186694+0000", 2024-04-23T19:00:43.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013659010000000001 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186783+0000", 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9269000000000002e-05 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.121112750000002, 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045398979999999997, 2024-04-23T19:00:43.343 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182343+0000", 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182347+0000", 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6530000000000002e-06 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182356+0000", 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.473e-06 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182362+0000", 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.545e-06 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186093+0000", 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003730953 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186109+0000", 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6013999999999999e-05 2024-04-23T19:00:43.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186789+0000", 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000679405 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186882+0000", 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3278999999999999e-05 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.347 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.784824196000002, 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035514740000000002, 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518632+0000", 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5000000000000001e-07 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518638+0000", 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4570000000000002e-06 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518653+0000", 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5016e-05 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518660+0000", 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5969999999999997e-06 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518732+0000", 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2323000000000005e-05 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518755+0000", 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2572999999999999e-05 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522106+0000", 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033516650000000002 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522182+0000", 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5893e-05 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'107)", 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.783823859999998, 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00546606, 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519632+0000", 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3600000000000003e-07 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519637+0000", 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-06 2024-04-23T19:00:43.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519649+0000", 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046999999999999e-05 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519654+0000", 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.48e-06 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519705+0000", 2024-04-23T19:00:43.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1199999999999998e-05 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519720+0000", 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-05 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525015+0000", 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052950699999999998 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525097+0000", 2024-04-23T19:00:43.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1546999999999997e-05 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'107)", 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.782642510000002, 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047363459999999998, 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520813+0000", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.093e-06 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520855+0000", 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1835000000000002e-05 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520872+0000", 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6472000000000001e-05 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520879+0000", 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3950000000000003e-06 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520944+0000", 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5226000000000002e-05 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520965+0000", 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0845000000000001e-05 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525458+0000", 2024-04-23T19:00:43.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044924739999999998 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525549+0000", 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1006000000000002e-05 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:40 5.5 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.950899064000001, 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042657119999999996, 2024-04-23T19:00:43.360 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352557+0000", 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.344e-06 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352565+0000", 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6830000000000008e-06 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352582+0000", 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6816999999999998e-05 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352589+0000", 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4479999999999997e-06 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352642+0000", 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3353999999999998e-05 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352739+0000", 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7002000000000004e-05 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352864+0000", 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012422400000000001 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.354003+0000", 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001139698 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356727+0000", 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027232459999999999 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356768+0000", 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1346e-05 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356821+0000", 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3550000000000001e-05 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.365 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.986280614000002, 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091622649999999993, 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 206 2024-04-23T19:00:43.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317178+0000", 2024-04-23T19:00:43.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9099999999999998e-06 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317197+0000", 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9052999999999999e-05 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317250+0000", 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2939999999999998e-05 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317269+0000", 2024-04-23T19:00:43.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8522999999999999e-05 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317435+0000", 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166322 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317452+0000", 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7102999999999999e-05 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322654+0000", 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052020549999999997 2024-04-23T19:00:43.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322964+0000", 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030991699999999999 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.323626+0000", 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066229199999999998 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.325293+0000", 2024-04-23T19:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001666774 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326186+0000", 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000892627 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326269+0000", 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3195999999999994e-05 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326336+0000", 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7552999999999995e-05 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.964134514000001, 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041039689999999998, 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 210 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339323+0000", 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339333+0000", 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339363+0000", 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0170000000000001e-05 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339378+0000", 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5003e-05 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339488+0000", 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109116 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339695+0000", 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020707500000000001 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.340176+0000", 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000481607 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.341758+0000", 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001581678 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343222+0000", 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001464382 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343314+0000", 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1359000000000004e-05 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343424+0000", 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110559 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:379 6.11 e32/26 6:8eb99c53:gc::gc.22:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:43.377 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.831599676, 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034325369999999998, 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471856+0000", 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471862+0000", 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7409999999999998e-06 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471874+0000", 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2649e-05 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471880+0000", 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6729999999999997e-06 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471928+0000", 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7562999999999998e-05 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471940+0000", 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2754e-05 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475244+0000", 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003303374 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475288+0000", 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3962999999999999e-05 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:572 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.713383208, 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036716320000000002, 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 572 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.382 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590073+0000", 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1090000000000001e-06 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590079+0000", 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0129999999999999e-06 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590103+0000", 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4426e-05 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590111+0000", 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2024-04-23T19:00:43.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590178+0000", 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7082000000000006e-05 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590288+0000", 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109795 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590426+0000", 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013844399999999999 2024-04-23T19:00:43.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.591036+0000", 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060966299999999998 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593680+0000", 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026447229999999999 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593714+0000", 2024-04-23T19:00:43.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569000000000003e-05 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593743+0000", 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9187e-05 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:631 6.18 6:1aba6385:::obj_delete_at_hint.0000000031:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.670032988999999, 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040515170000000001, 2024-04-23T19:00:43.387 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 631 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633424+0000", 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633435+0000", 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046000000000001e-05 2024-04-23T19:00:43.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633467+0000", 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2369999999999997e-05 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633506+0000", 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8748999999999998e-05 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633581+0000", 2024-04-23T19:00:43.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4420999999999998e-05 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633641+0000", 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0012000000000001e-05 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633751+0000", 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011013100000000001 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637365+0000", 2024-04-23T19:00:43.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036144179999999999 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637405+0000", 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9804e-05 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637444+0000", 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9419000000000003e-05 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637473+0000", 2024-04-23T19:00:43.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8923000000000001e-05 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:636 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.668214104, 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054414340000000002, 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.393 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 636 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635246+0000", 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3760000000000001e-06 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635257+0000", 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0835e-05 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635263+0000", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8020000000000003e-06 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635305+0000", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1823999999999998e-05 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635351+0000", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5884000000000003e-05 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635448+0000", 2024-04-23T19:00:43.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6501000000000003e-05 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637362+0000", 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019142790000000001 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640512+0000", 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031498979999999999 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640610+0000", 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7909000000000001e-05 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640682+0000", 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2325999999999998e-05 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.399 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:43.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:00:43.400 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:43.401+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:43.501 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:43.501+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:43.568 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:43.568 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:43.569 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:43.569 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:43.582 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:00:43.627 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:43.629+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:43.702 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:43.702+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:43.753 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:43.753 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:43.753 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:43.753 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:43.754 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:43.766 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:00:43.815 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:43.817+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:43.882 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:43.882 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:43.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:43.882 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.592978795000001, 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:00:43.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:43.887 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.529761577999999, 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:00:43.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:00:43.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.891 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.547655265, 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:00:43.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:00:43.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.539151765, 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.896 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:00:43.900 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.534547496999998, 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:00:43.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:00:43.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.904 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.431053900999999, 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.551612971000001, 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.910 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:43.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:00:43.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.915 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.526850640999999, 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:00:43.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:00:43.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:00:43.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:00:43.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.500777209999999, 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.921 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.926 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.482786135000001, 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.927 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:00:43.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:00:43.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:00:43.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.450921804, 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:00:43.932 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:00:43.937 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.416850854, 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.938 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:43.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.410497158999998, 2024-04-23T19:00:43.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:43.947 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.366090901, 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:43.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:00:43.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:00:43.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:00:43.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:00:43.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.364319078000001, 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.953 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:00:43.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:00:43.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:00:43.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.958 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.292264021000001, 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:00:43.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:00:43.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.248887385, 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.966 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.23786776, 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.967 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:00:43.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:00:43.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:00:43.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:00:43.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.972 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.977731788, 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:43.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.698294752999999, 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:43.978 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:00:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:00:43.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.983 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:43.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:43.984 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:43.984 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:00:43.985 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:43.986+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:43.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:00:44.045 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:00:44.086 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:44.086+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:44.166 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:44.166 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:44.166 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:44.167 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:44.176 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:00:44.183 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:44.183 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:44.186 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:44.185+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:44.201 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:44.202 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:44.220 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:44.220 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:44.239 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:44.239 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:44.260 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:44.260 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:44.280 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:44.281 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:44.287 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:44.289+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:44.301 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:44.301 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:44.322 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:44.322 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:44.332 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:44.332 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:44.351 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:00:44.388 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:44.386+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:44.490 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:44.490+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:44.513 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:44.513 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:44.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:00:44.590 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:44.590+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:44.646 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:44.646 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:44.659 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:00:44.691 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:44.690+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:44.773 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:44.773 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:44.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:00:44.791 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:44.790+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:44.892 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:44.893+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:44.906 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:44.906 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:44.919 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:00:44.993 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:44.994+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:45.051 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.051 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:45.065 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:00:45.094 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:45.093+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:45.195 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:45.197+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:45.233 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.233 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:45.248 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:00:45.296 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:45.297+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:45.366 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.366 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:45.380 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:00:45.397 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:45.397+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:45.496 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.496 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:45.498 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:45.498+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:45.510 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:00:45.599 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:45.598+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:45.675 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.675 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:45.689 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:00:45.733 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:45.734+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:45.802 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:45.801+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:45.858 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.858 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:45.872 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:00:45.918 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:45.918+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:45.996 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:45.996 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:46.004 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:46.005+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:46.011 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:00:46.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:00:46.105 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:46.106+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:46.176 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:46.177 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:46.191 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:00:46.234 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:46.234+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:46.306 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:46.305+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:46.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:00:46.350 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:46.350 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:46.364 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:00:46.410 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:46.410+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:46.481 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:46.481 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:46.488 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:46.488 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:46.494 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:00:46.505 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:46.505 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:46.522 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:46.522 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:46.537 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:46.538+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:46.539 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:46.539 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:46.557 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:46.557 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:46.576 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:46.576 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:46.595 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:46.595 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:46.609 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:46.606+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:46.614 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:46.615 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:46.660 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:46.660 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:46.660 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:00:46.660 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:00:46.660 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:46.674 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:00:46.718 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:46.718+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:46.811 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:46.809+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:46.840 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:46.840 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:00:46.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:00:46.840 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.668282787999999, 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:00:46.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:00:46.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.849 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.149097101999999, 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015286536999999999, 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 36 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690290+0000", 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8000000000000005e-07 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690297+0000", 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8340000000000001e-06 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690307+0000", 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9729999999999992e-06 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690315+0000", 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8900000000000007e-06 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697421+0000", 2024-04-23T19:00:46.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071065379999999999 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697541+0000", 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119973 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697734+0000", 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019309899999999999 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699272+0000", 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015377310000000001 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705412+0000", 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061400559999999996 2024-04-23T19:00:46.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705507+0000", 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4596e-05 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705576+0000", 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9066999999999994e-05 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.856 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.149060147999997, 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015476504, 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 37 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690327+0000", 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6000000000000003e-07 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690333+0000", 2024-04-23T19:00:46.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2299999999999996e-06 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690343+0000", 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4760000000000004e-06 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690350+0000", 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7640000000000005e-06 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698339+0000", 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079881740000000007 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698459+0000", 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120216 2024-04-23T19:00:46.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698656+0000", 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019722899999999999 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699980+0000", 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001324389 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705665+0000", 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00568412 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705744+0000", 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9759999999999995e-05 2024-04-23T19:00:46.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705803+0000", 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8486000000000002e-05 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:46.864 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.937198780000003, 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541634, 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 107 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902189+0000", 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7999999999999993e-07 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902194+0000", 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8429999999999998e-06 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902205+0000", 2024-04-23T19:00:46.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0703999999999999e-05 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902213+0000", 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6229999999999997e-06 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907404+0000", 2024-04-23T19:00:46.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051909859999999999 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907531+0000", 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127136 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907762+0000", 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023144800000000001 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913252+0000", 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054900720000000004 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913434+0000", 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018157500000000001 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913603+0000", 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016911500000000001 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913729+0000", 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012615200000000001 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.871 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.936378572999999, 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011579644, 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.872 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 109 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903009+0000", 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2500000000000001e-06 2024-04-23T19:00:46.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903085+0000", 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6149000000000006e-05 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903116+0000", 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.082e-05 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903175+0000", 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8975999999999999e-05 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909768+0000", 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065926159999999999 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909990+0000", 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022251199999999999 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.910357+0000", 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036634699999999999 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914187+0000", 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038306870000000002 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914316+0000", 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012860899999999999 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914469+0000", 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015297600000000001 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914587+0000", 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118702 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.936156978, 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01161092, 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 110 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903231+0000", 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.333e-06 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903238+0000", 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5839999999999997e-06 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903259+0000", 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0656e-05 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903269+0000", 2024-04-23T19:00:46.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5999999999999996e-06 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912042+0000", 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087729060000000005 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912257+0000", 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021572099999999999 2024-04-23T19:00:46.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912623+0000", 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036538100000000002 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914697+0000", 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002074144 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914721+0000", 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4283000000000001e-05 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914788+0000", 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6956000000000001e-05 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914840+0000", 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2355999999999998e-05 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.936099374999998, 2024-04-23T19:00:46.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016792776999999998, 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 111 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903288+0000", 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0869999999999999e-06 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903298+0000", 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4460000000000007e-06 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903325+0000", 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7903e-05 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903340+0000", 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4416999999999999e-05 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914941+0000", 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011601034 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915176+0000", 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234818 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915534+0000", 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035823000000000002 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919638+0000", 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041041519999999998 2024-04-23T19:00:46.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919811+0000", 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173062 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919950+0000", 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138832 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920080+0000", 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129796 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935996385999999, 2024-04-23T19:00:46.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:46.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:00:46.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:00:46.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935826407, 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.901 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:00:46.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:00:46.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935775841000002, 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.908 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:46.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:00:46.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:00:46.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:46.915 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935633502000002, 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:00:46.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:00:46.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:46.922 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935430201000003, 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:00:46.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:00:46.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935391017000001, 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:00:46.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:00:46.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.665792306, 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011508065, 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 137 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173595+0000", 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6400000000000002e-07 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173716+0000", 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012079900000000001 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173730+0000", 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4623999999999999e-05 2024-04-23T19:00:46.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173739+0000", 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4470000000000006e-06 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178126+0000", 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004386849 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178205+0000", 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9653000000000005e-05 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178326+0000", 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120433 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180954+0000", 2024-04-23T19:00:46.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026283019999999999 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185035+0000", 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040809979999999997 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185069+0000", 2024-04-23T19:00:46.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4208000000000002e-05 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185102+0000", 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3087999999999999e-05 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.943 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.665626822999997, 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01142832, 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 138 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173760+0000", 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0400000000000005e-07 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173767+0000", 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1160000000000004e-06 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173788+0000", 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1577999999999999e-05 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173801+0000", 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2418999999999999e-05 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178735+0000", 2024-04-23T19:00:46.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049345930000000001 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178784+0000", 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9221000000000002e-05 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178865+0000", 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1019000000000005e-05 2024-04-23T19:00:46.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180957+0000", 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002092062 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185134+0000", 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041769440000000001 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185168+0000", 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3223999999999999e-05 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185188+0000", 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0339999999999998e-05 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.665570494999997, 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011476916, 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.951 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 139 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173817+0000", 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.54e-07 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173824+0000", 2024-04-23T19:00:46.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2860000000000002e-06 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173834+0000", 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8179999999999999e-06 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173841+0000", 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9700000000000002e-06 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179190+0000", 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053495629999999999 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179237+0000", 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6490999999999999e-05 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179314+0000", 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7484000000000006e-05 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180960+0000", 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016456039999999999 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185224+0000", 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042640380000000004 2024-04-23T19:00:46.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185260+0000", 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5839e-05 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185293+0000", 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3068999999999998e-05 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.957 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.665533211000003, 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011673032999999999, 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 140 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173854+0000", 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173958+0000", 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104038 2024-04-23T19:00:46.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173975+0000", 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7472000000000001e-05 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173984+0000", 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3270000000000001e-06 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179865+0000", 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058815259999999998 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179915+0000", 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0185000000000001e-05 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179995+0000", 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0007999999999997e-05 2024-04-23T19:00:46.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.182979+0000", 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029830109999999998 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185377+0000", 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023988239999999999 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185464+0000", 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6388e-05 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185526+0000", 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2533999999999995e-05 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.665387291000002, 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011606877999999999, 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.965 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 141 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:00:46.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174000+0000", 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.37e-07 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174006+0000", 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.156e-06 2024-04-23T19:00:46.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174016+0000", 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9660000000000008e-06 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174024+0000", 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8050000000000007e-06 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180466+0000", 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006442138 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180517+0000", 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0701999999999997e-05 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180600+0000", 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3046000000000004e-05 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.183367+0000", 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027671900000000001 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185558+0000", 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021912889999999999 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185585+0000", 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7203e-05 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185606+0000", 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0645999999999999e-05 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.971 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.326520160000001, 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011863655000000001, 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.972 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 158 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:00:46.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512867+0000", 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8500000000000002e-07 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512932+0000", 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5547000000000001e-05 2024-04-23T19:00:46.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512945+0000", 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2383e-05 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512951+0000", 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3849999999999999e-06 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518504+0000", 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055528000000000001 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518641+0000", 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013751200000000001 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518866+0000", 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022416100000000001 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524269+0000", 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054038189999999998 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524549+0000", 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027922800000000002 2024-04-23T19:00:46.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524638+0000", 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9546e-05 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524730+0000", 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1788999999999998e-05 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.978 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.326425661999998, 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011949143000000001, 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:46.979 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 159 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3000000000000001e-07 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:00:46.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512965+0000", 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3950000000000001e-06 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512972+0000", 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3089999999999998e-06 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512976+0000", 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0230000000000003e-06 2024-04-23T19:00:46.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520114+0000", 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071381359999999998 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520251+0000", 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013729599999999999 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520474+0000", 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000222704 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524417+0000", 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039427969999999996 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524752+0000", 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033490400000000002 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524848+0000", 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5768999999999997e-05 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:00:46.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524910+0000", 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2279999999999993e-05 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:00:46.986 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:46.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:00:46.989 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:46.989+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:47.040 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:00:47.089 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:47.089+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:47.124 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:47.124 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:47.124 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:47.124 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:47.139 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:00:47.190 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:47.190+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:47.290 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:47.289+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:47.334 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:47.334 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:47.334 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:47.334 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:47.334 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:47.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:00:47.391 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:47.390+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:47.491 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:47.494+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:36 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'18)", 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.843370895, 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071214929999999996, 2024-04-23T19:00:47.540 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8999999999999995e-07 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699611+0000", 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5403000000000001e-05 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699630+0000", 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8963000000000001e-05 2024-04-23T19:00:47.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699644+0000", 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4194e-05 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699751+0000", 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010655200000000001 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699784+0000", 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:47.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706619+0000", 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068350549999999996 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706706+0000", 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6916000000000006e-05 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.544 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:37 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'18)", 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.842467102000001, 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062621999999999999, 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700490+0000", 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.164e-06 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700499+0000", 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4229999999999994e-06 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700517+0000", 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700531+0000", 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4466e-05 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700640+0000", 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108659 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700675+0000", 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5376999999999997e-05 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706710+0000", 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060344509999999997 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706751+0000", 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0873e-05 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:39 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'25, mlcod=15'22)", 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.833014128999999, 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036678790000000002, 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709943+0000", 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2130000000000001e-06 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710100+0000", 2024-04-23T19:00:47.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157899 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710120+0000", 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9953e-05 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710136+0000", 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846e-05 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710326+0000", 2024-04-23T19:00:47.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018969200000000001 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710373+0000", 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7429999999999998e-05 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713518+0000", 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003145096 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713609+0000", 2024-04-23T19:00:47.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0749999999999997e-05 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.800506093000003, 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003697348, 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742452+0000", 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2560000000000001e-06 2024-04-23T19:00:47.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742582+0000", 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013084300000000001 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742612+0000", 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9280000000000001e-05 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742625+0000", 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-23T19:00:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742795+0000", 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017040499999999999 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742832+0000", 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.718e-05 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746060+0000", 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003227592 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746147+0000", 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6649000000000003e-05 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'87)", 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.363550490999998, 2024-04-23T19:00:47.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005142977, 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179406+0000", 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999995e-07 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179411+0000", 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4229999999999996e-06 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179422+0000", 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0387000000000001e-05 2024-04-23T19:00:47.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179427+0000", 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5040000000000002e-06 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179496+0000", 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8825000000000006e-05 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179532+0000", 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5926999999999997e-05 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184514+0000", 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049821220000000003 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184548+0000", 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4060999999999998e-05 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'88)", 2024-04-23T19:00:47.561 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.362860326000003, 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064279039999999999, 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:47.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180096+0000", 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7299999999999996e-07 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180160+0000", 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4571000000000002e-05 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180173+0000", 2024-04-23T19:00:47.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180178+0000", 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7699999999999998e-06 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180252+0000", 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3413999999999999e-05 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180267+0000", 2024-04-23T19:00:47.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5481999999999998e-05 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186445+0000", 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061775190000000002 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186523+0000", 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8189000000000006e-05 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.565 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'88)", 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.362342771999998, 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059950400000000001, 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2600000000000002e-07 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180618+0000", 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9200000000000003e-06 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180627+0000", 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2089999999999994e-06 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180632+0000", 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.994e-06 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184601+0000", 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039688450000000004 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184630+0000", 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8291999999999999e-05 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186527+0000", 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001897304 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186608+0000", 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.085e-05 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.569 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'88)", 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.361902432999997, 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056351600000000002, 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181054+0000", 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181058+0000", 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8539999999999996e-06 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181067+0000", 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2269999999999993e-06 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181071+0000", 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999999e-06 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184933+0000", 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038617629999999998 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184954+0000", 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1566999999999999e-05 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186611+0000", 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016566020000000001 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186688+0000", 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7422999999999994e-05 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.361173952000001, 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050014279999999996, 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.06e-07 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181841+0000", 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9286999999999997e-05 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181850+0000", 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0019999999999995e-06 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181855+0000", 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6809999999999997e-06 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185296+0000", 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034414509999999999 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185328+0000", 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331000000000002e-05 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186694+0000", 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013659010000000001 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186783+0000", 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9269000000000002e-05 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.360613426, 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045398979999999997, 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.578 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182343+0000", 2024-04-23T19:00:47.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182347+0000", 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6530000000000002e-06 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182356+0000", 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.473e-06 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182362+0000", 2024-04-23T19:00:47.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.545e-06 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186093+0000", 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003730953 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186109+0000", 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6013999999999999e-05 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186789+0000", 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000679405 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186882+0000", 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3278999999999999e-05 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.024324872000001, 2024-04-23T19:00:47.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035514740000000002, 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:47.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518632+0000", 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5000000000000001e-07 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518638+0000", 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4570000000000002e-06 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518653+0000", 2024-04-23T19:00:47.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5016e-05 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518660+0000", 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5969999999999997e-06 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518732+0000", 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2323000000000005e-05 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518755+0000", 2024-04-23T19:00:47.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2572999999999999e-05 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522106+0000", 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033516650000000002 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522182+0000", 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5893e-05 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'107)", 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.023324535999997, 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00546606, 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519632+0000", 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3600000000000003e-07 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519637+0000", 2024-04-23T19:00:47.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-06 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519649+0000", 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046999999999999e-05 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519654+0000", 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.48e-06 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519705+0000", 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1199999999999998e-05 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519720+0000", 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-05 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525015+0000", 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052950699999999998 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525097+0000", 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1546999999999997e-05 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'107)", 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.022143186000001, 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047363459999999998, 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.591 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520813+0000", 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.093e-06 2024-04-23T19:00:47.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520855+0000", 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1835000000000002e-05 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520872+0000", 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6472000000000001e-05 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520879+0000", 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3950000000000003e-06 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520944+0000", 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5226000000000002e-05 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520965+0000", 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0845000000000001e-05 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525458+0000", 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044924739999999998 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525549+0000", 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1006000000000002e-05 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:40 5.5 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:47.595 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.19039974, 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042657119999999996, 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:47.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352557+0000", 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.344e-06 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352565+0000", 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6830000000000008e-06 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352582+0000", 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6816999999999998e-05 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352589+0000", 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4479999999999997e-06 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352642+0000", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3353999999999998e-05 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352739+0000", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7002000000000004e-05 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352864+0000", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012422400000000001 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:47.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.354003+0000", 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001139698 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356727+0000", 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027232459999999999 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356768+0000", 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1346e-05 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356821+0000", 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3550000000000001e-05 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.22578129, 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091622649999999993, 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:47.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 206 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317178+0000", 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9099999999999998e-06 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317197+0000", 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9052999999999999e-05 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317250+0000", 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2939999999999998e-05 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317269+0000", 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8522999999999999e-05 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317435+0000", 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166322 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317452+0000", 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7102999999999999e-05 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322654+0000", 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052020549999999997 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322964+0000", 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030991699999999999 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.323626+0000", 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066229199999999998 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.325293+0000", 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001666774 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326186+0000", 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000892627 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326269+0000", 2024-04-23T19:00:47.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3195999999999994e-05 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326336+0000", 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7552999999999995e-05 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.20363519, 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041039689999999998, 2024-04-23T19:00:47.607 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 210 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339323+0000", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339333+0000", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339363+0000", 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0170000000000001e-05 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339378+0000", 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5003e-05 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339488+0000", 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109116 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339695+0000", 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020707500000000001 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.340176+0000", 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000481607 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.341758+0000", 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001581678 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343222+0000", 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001464382 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343314+0000", 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1359000000000004e-05 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343424+0000", 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110559 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:379 6.11 e32/26 6:8eb99c53:gc::gc.22:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.071100351999998, 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034325369999999998, 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471856+0000", 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471862+0000", 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7409999999999998e-06 2024-04-23T19:00:47.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471874+0000", 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2649e-05 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471880+0000", 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6729999999999997e-06 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471928+0000", 2024-04-23T19:00:47.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7562999999999998e-05 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471940+0000", 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2754e-05 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475244+0000", 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003303374 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475288+0000", 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3962999999999999e-05 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:572 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.952883883999998, 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036716320000000002, 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:47.617 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 572 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590073+0000", 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1090000000000001e-06 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590079+0000", 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0129999999999999e-06 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590103+0000", 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4426e-05 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590111+0000", 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590178+0000", 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7082000000000006e-05 2024-04-23T19:00:47.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590288+0000", 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109795 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590426+0000", 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013844399999999999 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.591036+0000", 2024-04-23T19:00:47.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060966299999999998 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593680+0000", 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026447229999999999 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593714+0000", 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569000000000003e-05 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593743+0000", 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9187e-05 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:631 6.18 6:1aba6385:::obj_delete_at_hint.0000000031:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.909533665000001, 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040515170000000001, 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.623 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 631 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633424+0000", 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633435+0000", 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046000000000001e-05 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633467+0000", 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2369999999999997e-05 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633506+0000", 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8748999999999998e-05 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633581+0000", 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4420999999999998e-05 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633641+0000", 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0012000000000001e-05 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633751+0000", 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011013100000000001 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637365+0000", 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036144179999999999 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637405+0000", 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9804e-05 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637444+0000", 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9419000000000003e-05 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637473+0000", 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8923000000000001e-05 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.628 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:636 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.907714779999999, 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054414340000000002, 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 636 2024-04-23T19:00:47.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:47.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635246+0000", 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3760000000000001e-06 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635257+0000", 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0835e-05 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635263+0000", 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8020000000000003e-06 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635305+0000", 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1823999999999998e-05 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635351+0000", 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5884000000000003e-05 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635448+0000", 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6501000000000003e-05 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637362+0000", 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019142790000000001 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640512+0000", 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031498979999999999 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640610+0000", 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7909000000000001e-05 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640682+0000", 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2325999999999998e-05 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:47.634 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:47.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:00:47.636 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:47.637+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:47.736 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:47.737+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:47.823 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:47.823 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:47.823 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:47.823 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:47.838 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:00:47.838 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:47.837+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:47.938 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:47.937+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:47.995 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:47.995 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:47.996 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:48.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:00:48.052 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:48.053+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:48.140 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:48.141+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:48.169 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.881361035000001, 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.170 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.818143817999999, 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.176 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:00:48.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.836037505, 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:00:48.181 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:00:48.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.827534005, 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:00:48.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:00:48.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.822929736999999, 2024-04-23T19:00:48.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:00:48.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:00:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.719436140999999, 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.203 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.839995211000002, 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:00:48.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:00:48.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.209 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.815232881, 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:00:48.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:00:48.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:00:48.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.78915945, 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:48.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:00:48.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.222 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.771168374999998, 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:00:48.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.739304044000001, 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:00:48.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:00:48.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.705233094, 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:00:48.235 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:00:48.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:00:48.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.698879398999999, 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:00:48.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:00:48.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:00:48.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.246 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.654473141, 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:00:48.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:00:48.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.252 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.652701317999998, 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.253 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:00:48.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:00:48.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:00:48.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:00:48.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.580646260999998, 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.262 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:00:48.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.537269625, 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:00:48.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:00:48.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.526250000000001, 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:00:48.271 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:00:48.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:00:48.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.266114028000001, 2024-04-23T19:00:48.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.986676993, 2024-04-23T19:00:48.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:00:48.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:00:48.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:48.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:48.289 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:48.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:00:48.291 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:48.290+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:48.391 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:48.393+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:48.457 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:48.457 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:48.457 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:48.457 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:48.471 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:00:48.492 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:48.490+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:48.593 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:48.594+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:48.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:00:48.671 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:48.672 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:48.672 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:48.672 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:48.672 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:48.689 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:00:48.694 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:48.694+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:48.785 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:48.785 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:48.795 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:48.794+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:48.814 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:48.814 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:48.831 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:48.831 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:48.856 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:48.856 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:48.864 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:48.865 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:48.870 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:00:48.888 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:48.889 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:48.896 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:48.897+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:48.912 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:48.912 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:48.935 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:48.935 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:48.957 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:48.957 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:49.011 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.011 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:49.011 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:49.013+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:49.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:00:49.068 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:00:49.098 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:49.098+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:49.199 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:49.197+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:49.204 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.204 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:49.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:00:49.300 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:49.298+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:49.389 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.389 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:49.401 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:49.401+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:49.403 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:00:49.502 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:49.501+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:49.535 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.535 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:49.549 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:00:49.603 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:49.602+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:49.671 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.672 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:49.685 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:00:49.704 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:49.705+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:49.805 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:49.805+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:49.852 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.852 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:49.867 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:00:49.914 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:49.914+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:49.985 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:49.986 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.001 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:00:50.007 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:50.009+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:50.058 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:00:50.131 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:50.133+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:50.175 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:50.175 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.190 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:00:50.209 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:50.209+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:50.308 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:50.308 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.310 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:50.309+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:50.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:00:50.411 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:50.409+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:50.440 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:50.441 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.455 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:00:50.512 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:50.513+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:50.582 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:50.582 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.596 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:00:50.613 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:50.613+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:50.708 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:50.708 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.714 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:50.714+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:50.722 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:00:50.815 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:50.817+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:50.881 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:50.881 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:50.893 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:00:50.918 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:50.917+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:50.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:00:51.014 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:51.014 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:51.023 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:51.025+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:51.028 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:00:51.120 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:51.121+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:51.136 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:51.137 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:51.146 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:51.146 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:51.156 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:51.156 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:51.158 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:00:51.174 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:51.174 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:51.192 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:51.192 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:51.211 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:51.212 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:51.221 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:51.218+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:51.231 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:51.231 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:51.250 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:51.251 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:51.270 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:51.271 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:51.288 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:51.288 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:51.288 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:51.302 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:00:51.322 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:51.322+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:51.423 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:51.421+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:51.466 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:51.466 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:51.466 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:51.466 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:51.466 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:51.479 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:00:51.524 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:51.525+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:51.625 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:51.625+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:51.647 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:51.647 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:51.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:51.647 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:36 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'18)", 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.947938710999999, 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071214929999999996, 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8999999999999995e-07 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699611+0000", 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5403000000000001e-05 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699630+0000", 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8963000000000001e-05 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699644+0000", 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4194e-05 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699751+0000", 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010655200000000001 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699784+0000", 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706619+0000", 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068350549999999996 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706706+0000", 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6916000000000006e-05 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:37 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'18)", 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.947034918, 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062621999999999999, 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.652 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700490+0000", 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.164e-06 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700499+0000", 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4229999999999994e-06 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700517+0000", 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:51.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700531+0000", 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4466e-05 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700640+0000", 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108659 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700675+0000", 2024-04-23T19:00:51.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5376999999999997e-05 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706710+0000", 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060344509999999997 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706751+0000", 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0873e-05 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:39 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'25, mlcod=15'22)", 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.937581944999998, 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036678790000000002, 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709943+0000", 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2130000000000001e-06 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710100+0000", 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157899 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710120+0000", 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9953e-05 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710136+0000", 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846e-05 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710326+0000", 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018969200000000001 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710373+0000", 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7429999999999998e-05 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713518+0000", 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003145096 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713609+0000", 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0749999999999997e-05 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.905073909000002, 2024-04-23T19:00:51.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003697348, 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742452+0000", 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2560000000000001e-06 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742582+0000", 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013084300000000001 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742612+0000", 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9280000000000001e-05 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742625+0000", 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742795+0000", 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017040499999999999 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742832+0000", 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.718e-05 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746060+0000", 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003227592 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746147+0000", 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6649000000000003e-05 2024-04-23T19:00:51.665 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'87)", 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.468118306999997, 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005142977, 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179406+0000", 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999995e-07 2024-04-23T19:00:51.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179411+0000", 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4229999999999996e-06 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179422+0000", 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0387000000000001e-05 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179427+0000", 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5040000000000002e-06 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179496+0000", 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8825000000000006e-05 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179532+0000", 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5926999999999997e-05 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184514+0000", 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049821220000000003 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184548+0000", 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4060999999999998e-05 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'88)", 2024-04-23T19:00:51.670 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.467428142000003, 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064279039999999999, 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180096+0000", 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7299999999999996e-07 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180160+0000", 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4571000000000002e-05 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180173+0000", 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180178+0000", 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7699999999999998e-06 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180252+0000", 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3413999999999999e-05 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180267+0000", 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5481999999999998e-05 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186445+0000", 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061775190000000002 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186523+0000", 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8189000000000006e-05 2024-04-23T19:00:51.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'88)", 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.466910587999998, 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059950400000000001, 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.675 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:51.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2600000000000002e-07 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180618+0000", 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9200000000000003e-06 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180627+0000", 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2089999999999994e-06 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180632+0000", 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.994e-06 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184601+0000", 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039688450000000004 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184630+0000", 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8291999999999999e-05 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186527+0000", 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001897304 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186608+0000", 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.085e-05 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.679 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'88)", 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.466470248999997, 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056351600000000002, 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181054+0000", 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181058+0000", 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8539999999999996e-06 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181067+0000", 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2269999999999993e-06 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181071+0000", 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999999e-06 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184933+0000", 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038617629999999998 2024-04-23T19:00:51.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184954+0000", 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1566999999999999e-05 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186611+0000", 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016566020000000001 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186688+0000", 2024-04-23T19:00:51.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7422999999999994e-05 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.465741768000001, 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050014279999999996, 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.06e-07 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181841+0000", 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9286999999999997e-05 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181850+0000", 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0019999999999995e-06 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181855+0000", 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6809999999999997e-06 2024-04-23T19:00:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185296+0000", 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034414509999999999 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185328+0000", 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331000000000002e-05 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186694+0000", 2024-04-23T19:00:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013659010000000001 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186783+0000", 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9269000000000002e-05 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-23T19:00:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.465181242, 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045398979999999997, 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182343+0000", 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182347+0000", 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6530000000000002e-06 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182356+0000", 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.473e-06 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182362+0000", 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.545e-06 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186093+0000", 2024-04-23T19:00:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003730953 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186109+0000", 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6013999999999999e-05 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186789+0000", 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000679405 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186882+0000", 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3278999999999999e-05 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.128892688000001, 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035514740000000002, 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518632+0000", 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5000000000000001e-07 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518638+0000", 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4570000000000002e-06 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518653+0000", 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5016e-05 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518660+0000", 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5969999999999997e-06 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518732+0000", 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2323000000000005e-05 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518755+0000", 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2572999999999999e-05 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522106+0000", 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033516650000000002 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522182+0000", 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5893e-05 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.697 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'107)", 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.127892352000003, 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00546606, 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519632+0000", 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3600000000000003e-07 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519637+0000", 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-06 2024-04-23T19:00:51.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519649+0000", 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046999999999999e-05 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519654+0000", 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.48e-06 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519705+0000", 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1199999999999998e-05 2024-04-23T19:00:51.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519720+0000", 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-05 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525015+0000", 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052950699999999998 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525097+0000", 2024-04-23T19:00:51.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1546999999999997e-05 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'107)", 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.126711002, 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047363459999999998, 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.702 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520813+0000", 2024-04-23T19:00:51.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.093e-06 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520855+0000", 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1835000000000002e-05 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520872+0000", 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6472000000000001e-05 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520879+0000", 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3950000000000003e-06 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520944+0000", 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5226000000000002e-05 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520965+0000", 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0845000000000001e-05 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525458+0000", 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044924739999999998 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525549+0000", 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1006000000000002e-05 2024-04-23T19:00:51.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:40 5.5 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.294967556000003, 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042657119999999996, 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:51.707 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:51.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352557+0000", 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.344e-06 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352565+0000", 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6830000000000008e-06 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352582+0000", 2024-04-23T19:00:51.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6816999999999998e-05 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352589+0000", 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4479999999999997e-06 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352642+0000", 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3353999999999998e-05 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352739+0000", 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7002000000000004e-05 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352864+0000", 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012422400000000001 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.354003+0000", 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001139698 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356727+0000", 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027232459999999999 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356768+0000", 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1346e-05 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356821+0000", 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3550000000000001e-05 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.712 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.330349106, 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091622649999999993, 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.713 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 206 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317178+0000", 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9099999999999998e-06 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317197+0000", 2024-04-23T19:00:51.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9052999999999999e-05 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317250+0000", 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2939999999999998e-05 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317269+0000", 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8522999999999999e-05 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317435+0000", 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166322 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317452+0000", 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7102999999999999e-05 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322654+0000", 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052020549999999997 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322964+0000", 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030991699999999999 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.323626+0000", 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066229199999999998 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.325293+0000", 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001666774 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326186+0000", 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000892627 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326269+0000", 2024-04-23T19:00:51.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3195999999999994e-05 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326336+0000", 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7552999999999995e-05 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.308203005999999, 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041039689999999998, 2024-04-23T19:00:51.720 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 210 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339323+0000", 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339333+0000", 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339363+0000", 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0170000000000001e-05 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339378+0000", 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5003e-05 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339488+0000", 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109116 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339695+0000", 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020707500000000001 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.340176+0000", 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000481607 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:51.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.341758+0000", 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001581678 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343222+0000", 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001464382 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343314+0000", 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1359000000000004e-05 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343424+0000", 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110559 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:379 6.11 e32/26 6:8eb99c53:gc::gc.22:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.175668168000001, 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034325369999999998, 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471856+0000", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471862+0000", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7409999999999998e-06 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471874+0000", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2649e-05 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471880+0000", 2024-04-23T19:00:51.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6729999999999997e-06 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471928+0000", 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7562999999999998e-05 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471940+0000", 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2754e-05 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475244+0000", 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003303374 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475288+0000", 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3962999999999999e-05 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.730 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:572 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.057451700000001, 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036716320000000002, 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 572 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590073+0000", 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1090000000000001e-06 2024-04-23T19:00:51.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590079+0000", 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0129999999999999e-06 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590103+0000", 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4426e-05 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590111+0000", 2024-04-23T19:00:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590178+0000", 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7082000000000006e-05 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590288+0000", 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109795 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590426+0000", 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013844399999999999 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.591036+0000", 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060966299999999998 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593680+0000", 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026447229999999999 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593714+0000", 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569000000000003e-05 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593743+0000", 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9187e-05 2024-04-23T19:00:51.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:631 6.18 6:1aba6385:::obj_delete_at_hint.0000000031:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.014101481000001, 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040515170000000001, 2024-04-23T19:00:51.737 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 631 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633424+0000", 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633435+0000", 2024-04-23T19:00:51.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046000000000001e-05 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633467+0000", 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2369999999999997e-05 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633506+0000", 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8748999999999998e-05 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633581+0000", 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4420999999999998e-05 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633641+0000", 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0012000000000001e-05 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633751+0000", 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011013100000000001 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637365+0000", 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036144179999999999 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637405+0000", 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9804e-05 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637444+0000", 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9419000000000003e-05 2024-04-23T19:00:51.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637473+0000", 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8923000000000001e-05 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:636 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.012282595999999, 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054414340000000002, 2024-04-23T19:00:51.743 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 636 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635246+0000", 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3760000000000001e-06 2024-04-23T19:00:51.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635257+0000", 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0835e-05 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635263+0000", 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8020000000000003e-06 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635305+0000", 2024-04-23T19:00:51.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1823999999999998e-05 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635351+0000", 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5884000000000003e-05 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635448+0000", 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6501000000000003e-05 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637362+0000", 2024-04-23T19:00:51.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019142790000000001 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640512+0000", 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031498979999999999 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640610+0000", 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7909000000000001e-05 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:51.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640682+0000", 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2325999999999998e-05 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:51.749 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:51.750 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:00:51.751 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:51.750+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:51.852 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:51.854+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:51.930 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:51.931 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:51.945 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:00:51.992 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:51.993+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:52.053 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:52.054+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:52.075 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:52.075 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:52.075 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:52.075 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:52.076 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:52.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:00:52.093 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:00:52.154 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:52.154+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:52.255 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:52.253+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:52.277 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.990906119999998, 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:00:52.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:00:52.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.927688903000004, 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:00:52.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:00:52.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.945582590000001, 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:52.291 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.937079090000001, 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:52.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.932474822, 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:52.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:00:52.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.828981226, 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:00:52.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:00:52.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.949540295999999, 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:00:52.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:00:52.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:00:52.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.924777966000001, 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.312 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:00:52.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:00:52.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:00:52.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:00:52.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.317 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.898704535, 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:00:52.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:00:52.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:00:52.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:00:52.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.880713459999999, 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:00:52.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:00:52.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.848849129000001, 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:00:52.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:00:52.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:00:52.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:00:52.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.814778179000001, 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.336 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:00:52.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:00:52.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.808424484, 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:00:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.764018226000001, 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.346 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:00:52.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:00:52.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:00:52.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.762246402999999, 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:00:52.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:00:52.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:00:52.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:00:52.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.357 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.690191345999999, 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:00:52.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.646814710000001, 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:00:52.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:00:52.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.635795085000002, 2024-04-23T19:00:52.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:00:52.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:00:52.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:00:52.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.375659113000001, 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:00:52.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:00:52.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:00:52.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.096222078, 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.378 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:00:52.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:00:52.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:00:52.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:00:52.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.383 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:52.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:00:52.385 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:52.385+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:52.485 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:52.485+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:52.556 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:52.556 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:52.557 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:52.557 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:52.571 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:00:52.612 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:52.613+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:52.687 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:52.685+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:52.739 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:52.739 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:52.740 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:52.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:00:52.788 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:52.786+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:52.889 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:52.889+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:52.918 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:52.918 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:52.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:52.918 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:52.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.918 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.570874151000002, 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003841957, 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 52 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:00:52.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347429+0000", 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6850000000000001e-06 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347439+0000", 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0611999999999999e-05 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347466+0000", 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6465000000000002e-05 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347487+0000", 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1032000000000001e-05 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347670+0000", 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183432 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347946+0000", 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000276073 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348170+0000", 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022377900000000001 2024-04-23T19:00:52.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.350534+0000", 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023637329999999998 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351082+0000", 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000548256 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351167+0000", 2024-04-23T19:00:52.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4788000000000002e-05 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351268+0000", 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101102 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:57 7.3 e29/28 7:c609908c:::notify.5:head v 29'2, mlcod=0'0)", 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.561199130999999, 2024-04-23T19:00:52.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037361299999999998, 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357103+0000", 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.592e-06 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357116+0000", 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3799e-05 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357148+0000", 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357165+0000", 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6375000000000002e-05 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357290+0000", 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012489700000000001 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357330+0000", 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0151000000000002e-05 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360721+0000", 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033914349999999999 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360837+0000", 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011590399999999999 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.928 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.560877089999998, 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037999269999999998, 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357424+0000", 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.145e-06 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357432+0000", 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0320000000000003e-06 2024-04-23T19:00:52.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357448+0000", 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5942000000000001e-05 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357458+0000", 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7000000000000003e-06 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357576+0000", 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117897 2024-04-23T19:00:52.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357632+0000", 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6650999999999997e-05 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361148+0000", 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035151399999999999 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361223+0000", 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.476316494999999, 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033897950000000001, 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441987+0000", 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442002+0000", 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4806e-05 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442033+0000", 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999997e-05 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442050+0000", 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442173+0000", 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012248599999999999 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442393+0000", 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000220292 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442840+0000", 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044673299999999999 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.444723+0000", 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018828530000000001 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445094+0000", 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037100000000000002 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445257+0000", 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016315200000000001 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445373+0000", 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011658300000000001 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.938 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:282 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.464072297000001, 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052288359999999997, 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.939 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 282 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454229+0000", 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2929999999999999e-06 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454237+0000", 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5170000000000002e-06 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454252+0000", 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5824e-05 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454262+0000", 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3770000000000002e-06 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454323+0000", 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0764999999999998e-05 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454416+0000", 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.31e-05 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454561+0000", 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014562200000000001 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.455159+0000", 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059739799999999996 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459387+0000", 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042283750000000004 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459425+0000", 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8061e-05 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459457+0000", 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1504000000000002e-05 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.944 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.458389014000002, 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029594589999999998, 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 316 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459912+0000", 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.362e-06 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459919+0000", 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5710000000000003e-06 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459932+0000", 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3326000000000001e-05 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459939+0000", 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6630000000000004e-06 2024-04-23T19:00:52.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459997+0000", 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7692000000000003e-05 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460050+0000", 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3705000000000002e-05 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460173+0000", 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245299999999999 2024-04-23T19:00:52.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460773+0000", 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060017200000000005 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462748+0000", 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001975339 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462827+0000", 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8765999999999998e-05 2024-04-23T19:00:52.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462871+0000", 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.134721917, 2024-04-23T19:00:52.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032149629999999999, 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 742 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783581+0000", 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.943e-06 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783594+0000", 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3287e-05 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783627+0000", 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2310000000000001e-05 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783648+0000", 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1440000000000001e-05 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783789+0000", 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014105899999999999 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784022+0000", 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000232425 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784356+0000", 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033424699999999997 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.785611+0000", 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012548870000000001 2024-04-23T19:00:52.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786506+0000", 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089535000000000005 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786672+0000", 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165799 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786793+0000", 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121216 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.955 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.094616418000001, 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026811600000000001, 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.956 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 760 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823686+0000", 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823698+0000", 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1413000000000001e-05 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823729+0000", 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1149999999999998e-05 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823748+0000", 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9117e-05 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823877+0000", 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128799 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824105+0000", 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022891799999999999 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824424+0000", 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031810399999999999 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.825795+0000", 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001371597 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826212+0000", 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041680599999999998 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826296+0000", 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4259999999999996e-05 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826365+0000", 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8585999999999997e-05 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.961 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.965135983, 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029079140000000002, 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 817 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953167+0000", 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1999999999999999e-06 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953180+0000", 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3013000000000001e-05 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953214+0000", 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953237+0000", 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2702999999999999e-05 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953382+0000", 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014576899999999999 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953607+0000", 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000224968 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953933+0000", 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000325228 2024-04-23T19:00:52.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955092+0000", 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001159265 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955913+0000", 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00082167299999999998 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955999+0000", 2024-04-23T19:00:52.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5625999999999996e-05 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956072+0000", 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2948999999999996e-05 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.961334902000001, 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025253509999999999, 2024-04-23T19:00:52.967 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 819 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956967+0000", 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-06 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956974+0000", 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3930000000000002e-06 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956995+0000", 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1086000000000001e-05 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957014+0000", 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8817e-05 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957131+0000", 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011739900000000001 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957261+0000", 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012972600000000001 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957545+0000", 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028383400000000001 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.958589+0000", 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001044192 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959357+0000", 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00076825500000000002 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959435+0000", 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7175999999999994e-05 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959491+0000", 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5955999999999998e-05 2024-04-23T19:00:52.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.907116849000001, 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030501270000000001, 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 841 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011186+0000", 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011198+0000", 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2622999999999999e-05 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011228+0000", 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9533e-05 2024-04-23T19:00:52.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011243+0000", 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011352+0000", 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108832 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011570+0000", 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021795500000000001 2024-04-23T19:00:52.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011909+0000", 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033983499999999997 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.013108+0000", 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001198897 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014087+0000", 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097877300000000006 2024-04-23T19:00:52.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014170+0000", 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2599e-05 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014233+0000", 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3702999999999996e-05 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.903153256, 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027818489999999999, 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 843 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015148+0000", 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015156+0000", 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-06 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015177+0000", 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0843e-05 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015195+0000", 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.804e-05 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015298+0000", 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103136 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015423+0000", 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125439 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015692+0000", 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026838099999999999 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.016742+0000", 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010509060000000001 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017779+0000", 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010364490000000001 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017866+0000", 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6853000000000003e-05 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017929+0000", 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2982000000000001e-05 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.893961998000002, 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027191060000000002, 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.984 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 847 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:00:52.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024340+0000", 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024352+0000", 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1447000000000001e-05 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024383+0000", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0855999999999997e-05 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024404+0000", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1100000000000001e-05 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024545+0000", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141089 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024760+0000", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000215331 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.025077+0000", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031710100000000003 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026118+0000", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001040256 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026899+0000", 2024-04-23T19:00:52.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078178399999999999 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026992+0000", 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2383e-05 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027057+0000", 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5471999999999999e-05 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.890347948999999, 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025768179999999998, 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 849 2024-04-23T19:00:52.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027954+0000", 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5600000000000001e-06 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027962+0000", 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1769999999999998e-06 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027983+0000", 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0743000000000001e-05 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028000+0000", 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.768e-05 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028097+0000", 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6498999999999999e-05 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028224+0000", 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012678599999999999 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028520+0000", 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029674500000000001 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.029539+0000", 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010187250000000001 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030393+0000", 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085408399999999996 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030470+0000", 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6959000000000006e-05 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030529+0000", 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8860000000000002e-05 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:00:52.995 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.846032021999999, 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030724720000000001, 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 868 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072271+0000", 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.464e-06 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072283+0000", 2024-04-23T19:00:52.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2952999999999999e-05 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072314+0000", 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0300000000000001e-05 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072335+0000", 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:52.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072458+0000", 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012275900000000001 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072697+0000", 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023888100000000001 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.073021+0000", 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032375500000000001 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:52.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.074180+0000", 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011592110000000001 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075182+0000", 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010019300000000001 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075271+0000", 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8784999999999998e-05 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075341+0000", 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0013999999999997e-05 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.754071841999998, 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029175080000000001, 2024-04-23T19:00:53.001 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 907 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164231+0000", 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164243+0000", 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2334000000000001e-05 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164275+0000", 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2089999999999999e-05 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164296+0000", 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0795999999999999e-05 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164424+0000", 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012803599999999999 2024-04-23T19:00:53.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164670+0000", 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024600499999999999 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.165018+0000", 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034744700000000002 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166184+0000", 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001165824 2024-04-23T19:00:53.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166984+0000", 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000800507 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167073+0000", 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8620000000000002e-05 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:53.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167146+0000", 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3069000000000001e-05 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.750219103999999, 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002745632, 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:53.007 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 909 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168083+0000", 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9130000000000001e-06 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168093+0000", 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0207000000000001e-05 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168124+0000", 2024-04-23T19:00:53.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1003000000000001e-05 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168143+0000", 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8456000000000001e-05 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168240+0000", 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7510000000000007e-05 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168368+0000", 2024-04-23T19:00:53.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012759199999999999 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168679+0000", 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031130399999999999 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.169823+0000", 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001144122 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170629+0000", 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080621399999999998 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170715+0000", 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5859000000000006e-05 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170827+0000", 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111452 2024-04-23T19:00:53.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.655007736000002, 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031288459999999998, 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:53.013 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 949 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263295+0000", 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263308+0000", 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2747e-05 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:53.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263341+0000", 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2889000000000003e-05 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263357+0000", 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6107e-05 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263512+0000", 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015534500000000001 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:53.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263881+0000", 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036884400000000001 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.264453+0000", 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057192899999999999 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.265829+0000", 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00137644 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:53.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266271+0000", 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044168300000000001 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266355+0000", 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4142999999999997e-05 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266421+0000", 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5901999999999993e-05 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.018 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.640893712, 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026342539999999999, 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 955 2024-04-23T19:00:53.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277409+0000", 2024-04-23T19:00:53.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277420+0000", 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277451+0000", 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1180000000000003e-05 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277466+0000", 2024-04-23T19:00:53.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4613000000000001e-05 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277577+0000", 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111036 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277789+0000", 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000212275 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.278119+0000", 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032997400000000002 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279229+0000", 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011100610000000001 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279898+0000", 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066872899999999996 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279976+0000", 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8382999999999998e-05 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280041+0000", 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.637429261000001, 2024-04-23T19:00:53.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002659743, 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 957 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280872+0000", 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-06 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:53.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280880+0000", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999998e-06 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280900+0000", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.016e-05 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280911+0000", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0723000000000001e-05 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281026+0000", 2024-04-23T19:00:53.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115859 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281159+0000", 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013248900000000001 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281427+0000", 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000268585 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.282476+0000", 2024-04-23T19:00:53.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001048282 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283367+0000", 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089120300000000003 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283463+0000", 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6052999999999997e-05 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:53.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283531+0000", 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7589000000000006e-05 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:53.030 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:53.031 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:00:53.032 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:53.030+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:53.076 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:00:53.156 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:53.157+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:53.233 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:53.234+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:53.257 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:53.257 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:53.257 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:53.278 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:00:53.287 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:00:53.364 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:53.365+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:53.435 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:53.433+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:53.492 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:53.492 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:53.492 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:53.513 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:00:53.520 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:53.520 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:53.551 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:53.551 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:53.552 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:53.549+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:53.581 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:53.581 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:53.611 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:53.612 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:53.638 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:53.637+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:53.644 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:53.645 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:53.677 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:53.678 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:53.692 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:53.692 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:53.710 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:53.710 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:53.711 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:00:53.742 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:53.742 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:53.743 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:53.741+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:53.839 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:53.841+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:53.843 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:53.843 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:53.858 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:00:53.941 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:53.938+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:53.991 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:53.991 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.006 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:00:54.050 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:54.050+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:54.142 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:54.141+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:54.177 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:54.177 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.191 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:00:54.243 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:54.245+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:54.315 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:54.315 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.330 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:00:54.344 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:54.345+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:54.445 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:54.442+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:54.451 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:54.452 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.466 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:00:54.553 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:54.554+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.646 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:00:54.646 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:54.645+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:54.747 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:54.745+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:54.808 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:54.808 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.822 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:00:54.848 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:54.849+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:54.942 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:54.942 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:54.948 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:54.949+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:54.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:00:55.049 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:55.049+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:55.078 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:55.079 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:55.098 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:00:55.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:00:55.150 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:55.150+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:55.220 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:55.220 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:55.236 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:00:55.277 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:55.278+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:55.351 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:55.349+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:55.399 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:55.399 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:55.414 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:00:55.461 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:55.462+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:55.535 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:55.535 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:55.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:00:55.594 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:55.594+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:55.654 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:55.654+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:55.684 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:55.685 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:55.701 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:00:55.754 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:55.754+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:55.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:00:55.814 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:55.814 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:55.830 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:00:55.876 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:55.877+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:55.898 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:55.899 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:55.916 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:55.917 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:55.933 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:55.933 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:55.950 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:55.950 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:55.955 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:55.957+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:55.972 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:55.972 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:55.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:36 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'18)", 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.274954508, 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071214929999999996, 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:55.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8999999999999995e-07 2024-04-23T19:00:55.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699611+0000", 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5403000000000001e-05 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699630+0000", 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8963000000000001e-05 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699644+0000", 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4194e-05 2024-04-23T19:00:55.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699751+0000", 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010655200000000001 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699784+0000", 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706619+0000", 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068350549999999996 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706706+0000", 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6916000000000006e-05 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:37 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'18)", 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.274050715000001, 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062621999999999999, 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:55.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700490+0000", 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.164e-06 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700499+0000", 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4229999999999994e-06 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700517+0000", 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:55.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700531+0000", 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4466e-05 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700640+0000", 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108659 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700675+0000", 2024-04-23T19:00:55.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5376999999999997e-05 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706710+0000", 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060344509999999997 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706751+0000", 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0873e-05 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.982 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:39 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'25, mlcod=15'22)", 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.264597741999999, 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036678790000000002, 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:55.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:55.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709943+0000", 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2130000000000001e-06 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710100+0000", 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157899 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710120+0000", 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9953e-05 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710136+0000", 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846e-05 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710326+0000", 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018969200000000001 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:55.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710373+0000", 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7429999999999998e-05 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713518+0000", 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003145096 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713609+0000", 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0749999999999997e-05 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:55.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.232089705999996, 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003697348, 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:55.988 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742452+0000", 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2560000000000001e-06 2024-04-23T19:00:55.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742582+0000", 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013084300000000001 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742612+0000", 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9280000000000001e-05 2024-04-23T19:00:55.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742625+0000", 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742795+0000", 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017040499999999999 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:55.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742832+0000", 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.718e-05 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746060+0000", 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003227592 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746147+0000", 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6649000000000003e-05 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'87)", 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.795134103999999, 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005142977, 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179406+0000", 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999995e-07 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179411+0000", 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4229999999999996e-06 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179422+0000", 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0387000000000001e-05 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179427+0000", 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5040000000000002e-06 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179496+0000", 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8825000000000006e-05 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179532+0000", 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5926999999999997e-05 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184514+0000", 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049821220000000003 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184548+0000", 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4060999999999998e-05 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:55.997 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'88)", 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.794443938999997, 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064279039999999999, 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180096+0000", 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7299999999999996e-07 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:55.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180160+0000", 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4571000000000002e-05 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180173+0000", 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180178+0000", 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7699999999999998e-06 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180252+0000", 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3413999999999999e-05 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180267+0000", 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5481999999999998e-05 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186445+0000", 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061775190000000002 2024-04-23T19:00:56.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186523+0000", 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8189000000000006e-05 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'88)", 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.793926384999999, 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059950400000000001, 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:56.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2600000000000002e-07 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180618+0000", 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9200000000000003e-06 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180627+0000", 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2089999999999994e-06 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180632+0000", 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.994e-06 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184601+0000", 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039688450000000004 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184630+0000", 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8291999999999999e-05 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186527+0000", 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001897304 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186608+0000", 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.085e-05 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'88)", 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:56.007 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.793486045999998, 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056351600000000002, 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181054+0000", 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181058+0000", 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8539999999999996e-06 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181067+0000", 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2269999999999993e-06 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181071+0000", 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999999e-06 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184933+0000", 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038617629999999998 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184954+0000", 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1566999999999999e-05 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186611+0000", 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016566020000000001 2024-04-23T19:00:56.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186688+0000", 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7422999999999994e-05 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.792757565000002, 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050014279999999996, 2024-04-23T19:00:56.012 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.06e-07 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181841+0000", 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9286999999999997e-05 2024-04-23T19:00:56.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181850+0000", 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0019999999999995e-06 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181855+0000", 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6809999999999997e-06 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185296+0000", 2024-04-23T19:00:56.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034414509999999999 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185328+0000", 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331000000000002e-05 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186694+0000", 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013659010000000001 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186783+0000", 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9269000000000002e-05 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.792197039000001, 2024-04-23T19:00:56.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045398979999999997, 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:00:56.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182343+0000", 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182347+0000", 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6530000000000002e-06 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182356+0000", 2024-04-23T19:00:56.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.473e-06 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182362+0000", 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.545e-06 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186093+0000", 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003730953 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186109+0000", 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6013999999999999e-05 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186789+0000", 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000679405 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186882+0000", 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3278999999999999e-05 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.455908485000002, 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035514740000000002, 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518632+0000", 2024-04-23T19:00:56.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5000000000000001e-07 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518638+0000", 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4570000000000002e-06 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518653+0000", 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5016e-05 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518660+0000", 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5969999999999997e-06 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518732+0000", 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2323000000000005e-05 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518755+0000", 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2572999999999999e-05 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522106+0000", 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033516650000000002 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522182+0000", 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5893e-05 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'107)", 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.454908148999998, 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00546606, 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:56.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519632+0000", 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3600000000000003e-07 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519637+0000", 2024-04-23T19:00:56.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-06 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519649+0000", 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046999999999999e-05 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519654+0000", 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.48e-06 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519705+0000", 2024-04-23T19:00:56.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1199999999999998e-05 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519720+0000", 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-05 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525015+0000", 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052950699999999998 2024-04-23T19:00:56.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525097+0000", 2024-04-23T19:00:56.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1546999999999997e-05 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'107)", 2024-04-23T19:00:56.032 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.453726799000002, 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047363459999999998, 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:56.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520813+0000", 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.093e-06 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520855+0000", 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1835000000000002e-05 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520872+0000", 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6472000000000001e-05 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520879+0000", 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3950000000000003e-06 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520944+0000", 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5226000000000002e-05 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520965+0000", 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0845000000000001e-05 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525458+0000", 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044924739999999998 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525549+0000", 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1006000000000002e-05 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:40 5.5 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.621983352999997, 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042657119999999996, 2024-04-23T19:00:56.037 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:56.038 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40 2024-04-23T19:00:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:00:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352557+0000", 2024-04-23T19:00:56.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.344e-06 2024-04-23T19:00:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352565+0000", 2024-04-23T19:00:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6830000000000008e-06 2024-04-23T19:00:56.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352582+0000", 2024-04-23T19:00:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6816999999999998e-05 2024-04-23T19:00:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352589+0000", 2024-04-23T19:00:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4479999999999997e-06 2024-04-23T19:00:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352642+0000", 2024-04-23T19:00:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3353999999999998e-05 2024-04-23T19:00:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352739+0000", 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7002000000000004e-05 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352864+0000", 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012422400000000001 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.354003+0000", 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001139698 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356727+0000", 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027232459999999999 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356768+0000", 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1346e-05 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356821+0000", 2024-04-23T19:00:56.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3550000000000001e-05 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.657364903000001, 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091622649999999993, 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.048 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 206 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:00:56.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317178+0000", 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9099999999999998e-06 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317197+0000", 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9052999999999999e-05 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317250+0000", 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2939999999999998e-05 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317269+0000", 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8522999999999999e-05 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317435+0000", 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166322 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317452+0000", 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7102999999999999e-05 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322654+0000", 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052020549999999997 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322964+0000", 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030991699999999999 2024-04-23T19:00:56.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.323626+0000", 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066229199999999998 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.325293+0000", 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001666774 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326186+0000", 2024-04-23T19:00:56.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000892627 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326269+0000", 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3195999999999994e-05 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326336+0000", 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7552999999999995e-05 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.635218803000001, 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041039689999999998, 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 210 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:00:56.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339323+0000", 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339333+0000", 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339363+0000", 2024-04-23T19:00:56.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0170000000000001e-05 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339378+0000", 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5003e-05 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339488+0000", 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109116 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339695+0000", 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020707500000000001 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.340176+0000", 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000481607 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.341758+0000", 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001581678 2024-04-23T19:00:56.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343222+0000", 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001464382 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343314+0000", 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1359000000000004e-05 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343424+0000", 2024-04-23T19:00:56.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110559 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:379 6.11 e32/26 6:8eb99c53:gc::gc.22:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.502683964999999, 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034325369999999998, 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471855+0000", 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471856+0000", 2024-04-23T19:00:56.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471862+0000", 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7409999999999998e-06 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471874+0000", 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2649e-05 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471880+0000", 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6729999999999997e-06 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471928+0000", 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7562999999999998e-05 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471940+0000", 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2754e-05 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475244+0000", 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003303374 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475288+0000", 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3962999999999999e-05 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:572 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.384467496999999, 2024-04-23T19:00:56.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036716320000000002, 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 572 2024-04-23T19:00:56.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590073+0000", 2024-04-23T19:00:56.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1090000000000001e-06 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590079+0000", 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0129999999999999e-06 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590103+0000", 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4426e-05 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590111+0000", 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590178+0000", 2024-04-23T19:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7082000000000006e-05 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590288+0000", 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109795 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590426+0000", 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013844399999999999 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.591036+0000", 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060966299999999998 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593680+0000", 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026447229999999999 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593714+0000", 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569000000000003e-05 2024-04-23T19:00:56.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593743+0000", 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9187e-05 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:631 6.18 6:1aba6385:::obj_delete_at_hint.0000000031:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.341117277999999, 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040515170000000001, 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.073 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 631 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633424+0000", 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633435+0000", 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046000000000001e-05 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633467+0000", 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2369999999999997e-05 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633506+0000", 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8748999999999998e-05 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633581+0000", 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4420999999999998e-05 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633641+0000", 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0012000000000001e-05 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633751+0000", 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011013100000000001 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637365+0000", 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036144179999999999 2024-04-23T19:00:56.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637405+0000", 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9804e-05 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637444+0000", 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9419000000000003e-05 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637473+0000", 2024-04-23T19:00:56.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8923000000000001e-05 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:636 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.339298393, 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054414340000000002, 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 636 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635246+0000", 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3760000000000001e-06 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635257+0000", 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0835e-05 2024-04-23T19:00:56.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635263+0000", 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8020000000000003e-06 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635305+0000", 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1823999999999998e-05 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635351+0000", 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5884000000000003e-05 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635448+0000", 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6501000000000003e-05 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637362+0000", 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019142790000000001 2024-04-23T19:00:56.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640512+0000", 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031498979999999999 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640610+0000", 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7909000000000001e-05 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640682+0000", 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2325999999999998e-05 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.085 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:56.086 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:56.086 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:56.087 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:00:56.088 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:56.088 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:56.088 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:56.089 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:56.089 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:56.090 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:56.090 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:56.086+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:56.107 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:00:56.187 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:56.185+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:56.276 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:56.277 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:56.277 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:56.277 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:56.288 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:56.289+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:56.295 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:00:56.389 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:56.390+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:56.490 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:56.490+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:56.502 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:56.502 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:56.503 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:56.503 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:56.503 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:56.521 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:00:56.591 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:56.589+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:56.692 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.403913623999998, 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:00:56.697 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.340696407000003, 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:56.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.358590094, 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.702 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:00:56.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.350086593999997, 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.707 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:00:56.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.711 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.345482326000003, 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:56.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:00:56.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.716 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.241988730000003, 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:00:56.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:00:56.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:56.722 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.362547800000002, 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:00:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:00:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:00:56.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.728 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.33778547, 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:00:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:00:56.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.311712039, 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:00:56.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:00:56.740 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.293720963999998, 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.741 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.261856633000001, 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:00:56.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:00:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:56.752 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.227785683, 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:00:56.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.221431987999999, 2024-04-23T19:00:56.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:00:56.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.17702573, 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.763 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:00:56.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:00:56.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.175253906999998, 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.769 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.103198849999998, 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:00:56.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.059822214, 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.779 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.783 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.048802589000001, 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.784 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:00:56.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.788666617000001, 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.791 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:00:56.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:00:56.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.509229582, 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:56.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:56.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:00:56.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:56.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:56.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:56.803 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:56.803 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:56.803 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:56.690+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:56.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:00:56.805 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:56.802+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:56.904 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:56.906+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:57.005 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:57.006+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:57.017 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:57.017 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:57.017 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:57.017 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:57.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:00:57.105 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:57.106+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:57.204 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:57.204 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:57.204 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:57.204 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:57.204 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:57.207 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:57.206+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:57.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:00:57.308 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:57.308+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.049852713999996, 2024-04-23T19:00:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003841957, 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 52 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:00:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347429+0000", 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6850000000000001e-06 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347439+0000", 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0611999999999999e-05 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347466+0000", 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6465000000000002e-05 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347487+0000", 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1032000000000001e-05 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347670+0000", 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183432 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347946+0000", 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000276073 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348170+0000", 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022377900000000001 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.350534+0000", 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023637329999999998 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351082+0000", 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000548256 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351167+0000", 2024-04-23T19:00:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4788000000000002e-05 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351268+0000", 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101102 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:57 7.3 e29/28 7:c609908c:::notify.5:head v 29'2, mlcod=0'0)", 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.040177694, 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037361299999999998, 2024-04-23T19:00:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357103+0000", 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.592e-06 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357116+0000", 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3799e-05 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357148+0000", 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357165+0000", 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6375000000000002e-05 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357290+0000", 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012489700000000001 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357330+0000", 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0151000000000002e-05 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360721+0000", 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033914349999999999 2024-04-23T19:00:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360837+0000", 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011590399999999999 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.039855652999996, 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037999269999999998, 2024-04-23T19:00:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:00:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357424+0000", 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.145e-06 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357432+0000", 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0320000000000003e-06 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357448+0000", 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5942000000000001e-05 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357458+0000", 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7000000000000003e-06 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357576+0000", 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117897 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357632+0000", 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6650999999999997e-05 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361148+0000", 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035151399999999999 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361223+0000", 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.955295058000001, 2024-04-23T19:00:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033897950000000001, 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:00:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441987+0000", 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442002+0000", 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4806e-05 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442033+0000", 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999997e-05 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442050+0000", 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:00:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442173+0000", 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012248599999999999 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442393+0000", 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000220292 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442840+0000", 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044673299999999999 2024-04-23T19:00:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.444723+0000", 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018828530000000001 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445094+0000", 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037100000000000002 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445257+0000", 2024-04-23T19:00:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016315200000000001 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445373+0000", 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011658300000000001 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:282 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:00:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.94305086, 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052288359999999997, 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 282 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454229+0000", 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2929999999999999e-06 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454237+0000", 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5170000000000002e-06 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454252+0000", 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5824e-05 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454262+0000", 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3770000000000002e-06 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454323+0000", 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0764999999999998e-05 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454416+0000", 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.31e-05 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454561+0000", 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014562200000000001 2024-04-23T19:00:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.455159+0000", 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059739799999999996 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459387+0000", 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042283750000000004 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459425+0000", 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8061e-05 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459457+0000", 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1504000000000002e-05 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.937367577, 2024-04-23T19:00:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029594589999999998, 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 316 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459912+0000", 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.362e-06 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459919+0000", 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5710000000000003e-06 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459932+0000", 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3326000000000001e-05 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459939+0000", 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6630000000000004e-06 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459997+0000", 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7692000000000003e-05 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460050+0000", 2024-04-23T19:00:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3705000000000002e-05 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460173+0000", 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245299999999999 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460773+0000", 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060017200000000005 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462748+0000", 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001975339 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462827+0000", 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8765999999999998e-05 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462871+0000", 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:00:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.613700479999999, 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032149629999999999, 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 742 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783581+0000", 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.943e-06 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783594+0000", 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3287e-05 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783627+0000", 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2310000000000001e-05 2024-04-23T19:00:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783648+0000", 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1440000000000001e-05 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783789+0000", 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014105899999999999 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784022+0000", 2024-04-23T19:00:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000232425 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784356+0000", 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033424699999999997 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.785611+0000", 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012548870000000001 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786506+0000", 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089535000000000005 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786672+0000", 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165799 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786793+0000", 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121216 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.573594980999999, 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026811600000000001, 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 760 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823686+0000", 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823698+0000", 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1413000000000001e-05 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823729+0000", 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1149999999999998e-05 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823748+0000", 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9117e-05 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823877+0000", 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128799 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824105+0000", 2024-04-23T19:00:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022891799999999999 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824424+0000", 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031810399999999999 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.825795+0000", 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001371597 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826212+0000", 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041680599999999998 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826296+0000", 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4259999999999996e-05 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826365+0000", 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8585999999999997e-05 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.444114546000002, 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029079140000000002, 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 817 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953167+0000", 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1999999999999999e-06 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953180+0000", 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3013000000000001e-05 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953214+0000", 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953237+0000", 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2702999999999999e-05 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953382+0000", 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014576899999999999 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953607+0000", 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000224968 2024-04-23T19:00:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953933+0000", 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000325228 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955092+0000", 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001159265 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955913+0000", 2024-04-23T19:00:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00082167299999999998 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955999+0000", 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5625999999999996e-05 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956072+0000", 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2948999999999996e-05 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.440313464999999, 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025253509999999999, 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 819 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956967+0000", 2024-04-23T19:00:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-06 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956974+0000", 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3930000000000002e-06 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956995+0000", 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1086000000000001e-05 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957014+0000", 2024-04-23T19:00:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8817e-05 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957131+0000", 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011739900000000001 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957261+0000", 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012972600000000001 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957545+0000", 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028383400000000001 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.958589+0000", 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001044192 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959357+0000", 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00076825500000000002 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959435+0000", 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7175999999999994e-05 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959491+0000", 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5955999999999998e-05 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.386095412, 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030501270000000001, 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 841 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011186+0000", 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:00:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011198+0000", 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2622999999999999e-05 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011228+0000", 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9533e-05 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011243+0000", 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011352+0000", 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108832 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011570+0000", 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021795500000000001 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011909+0000", 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033983499999999997 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.013108+0000", 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001198897 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014087+0000", 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097877300000000006 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014170+0000", 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2599e-05 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014233+0000", 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3702999999999996e-05 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.382131819000001, 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027818489999999999, 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 843 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015148+0000", 2024-04-23T19:00:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015156+0000", 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-06 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015177+0000", 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0843e-05 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015195+0000", 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.804e-05 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015298+0000", 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103136 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015423+0000", 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125439 2024-04-23T19:00:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015692+0000", 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026838099999999999 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.016742+0000", 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010509060000000001 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017779+0000", 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010364490000000001 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017866+0000", 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6853000000000003e-05 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017929+0000", 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2982000000000001e-05 2024-04-23T19:00:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.372940561, 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027191060000000002, 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 847 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:00:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024340+0000", 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024352+0000", 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1447000000000001e-05 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024383+0000", 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0855999999999997e-05 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024404+0000", 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1100000000000001e-05 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024545+0000", 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141089 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024760+0000", 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000215331 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.025077+0000", 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031710100000000003 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026118+0000", 2024-04-23T19:00:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001040256 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026899+0000", 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078178399999999999 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026992+0000", 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2383e-05 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027057+0000", 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5471999999999999e-05 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.369326512000001, 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025768179999999998, 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.473 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 849 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027954+0000", 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5600000000000001e-06 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027962+0000", 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1769999999999998e-06 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027983+0000", 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0743000000000001e-05 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028000+0000", 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.768e-05 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028097+0000", 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6498999999999999e-05 2024-04-23T19:00:57.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028224+0000", 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012678599999999999 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028520+0000", 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029674500000000001 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.029539+0000", 2024-04-23T19:00:57.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010187250000000001 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030393+0000", 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085408399999999996 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030470+0000", 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6959000000000006e-05 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030529+0000", 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8860000000000002e-05 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.325010585000001, 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030724720000000001, 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.479 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 868 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072271+0000", 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.464e-06 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072283+0000", 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2952999999999999e-05 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072314+0000", 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0300000000000001e-05 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072335+0000", 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072458+0000", 2024-04-23T19:00:57.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012275900000000001 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072697+0000", 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023888100000000001 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.073021+0000", 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032375500000000001 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.074180+0000", 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011592110000000001 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075182+0000", 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010019300000000001 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075271+0000", 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8784999999999998e-05 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075341+0000", 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0013999999999997e-05 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.233050405, 2024-04-23T19:00:57.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029175080000000001, 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 907 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:00:57.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164231+0000", 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164243+0000", 2024-04-23T19:00:57.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2334000000000001e-05 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164275+0000", 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2089999999999999e-05 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164296+0000", 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0795999999999999e-05 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164424+0000", 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012803599999999999 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164670+0000", 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024600499999999999 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.165018+0000", 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034744700000000002 2024-04-23T19:00:57.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166184+0000", 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001165824 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166984+0000", 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000800507 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167073+0000", 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8620000000000002e-05 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167146+0000", 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3069000000000001e-05 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:00:57.491 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.229197667000001, 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002745632, 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 909 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168083+0000", 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9130000000000001e-06 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168093+0000", 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0207000000000001e-05 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168124+0000", 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1003000000000001e-05 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168143+0000", 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8456000000000001e-05 2024-04-23T19:00:57.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168240+0000", 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7510000000000007e-05 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168368+0000", 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012759199999999999 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:57.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168679+0000", 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031130399999999999 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.169823+0000", 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001144122 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170629+0000", 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080621399999999998 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170715+0000", 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5859000000000006e-05 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170827+0000", 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111452 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.497 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.133986299, 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031288459999999998, 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 949 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.498 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263295+0000", 2024-04-23T19:00:57.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263308+0000", 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2747e-05 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263341+0000", 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2889000000000003e-05 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263357+0000", 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6107e-05 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263512+0000", 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015534500000000001 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263881+0000", 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036884400000000001 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.264453+0000", 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057192899999999999 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.265829+0000", 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00137644 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266271+0000", 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044168300000000001 2024-04-23T19:00:57.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266355+0000", 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4142999999999997e-05 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266421+0000", 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5901999999999993e-05 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.503 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.119872274999999, 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026342539999999999, 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 955 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277409+0000", 2024-04-23T19:00:57.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277420+0000", 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277451+0000", 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1180000000000003e-05 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277466+0000", 2024-04-23T19:00:57.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4613000000000001e-05 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277577+0000", 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111036 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277789+0000", 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000212275 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.278119+0000", 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032997400000000002 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279229+0000", 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011100610000000001 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279898+0000", 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066872899999999996 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279976+0000", 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8382999999999998e-05 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280041+0000", 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.116407823999999, 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002659743, 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 957 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280872+0000", 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-06 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280880+0000", 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999998e-06 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280900+0000", 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.016e-05 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280911+0000", 2024-04-23T19:00:57.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0723000000000001e-05 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281026+0000", 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115859 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281159+0000", 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013248900000000001 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281427+0000", 2024-04-23T19:00:57.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000268585 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.282476+0000", 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001048282 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283367+0000", 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089120300000000003 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283463+0000", 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6052999999999997e-05 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283531+0000", 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7589000000000006e-05 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:57.515 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:57.517 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:00:57.518 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:00:57.516+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:00:57.618 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:57.618+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:57.719 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:57.718+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:57.727 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:57.727 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:57.727 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:00:57.728 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:57.746 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:00:57.819 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:57.818+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:57.911 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:57.911 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:00:57.911 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:00:57.912 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:00:57.912 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:57.920 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:57.920+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:57.928 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:00:58.021 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:58.018+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:58.091 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:00:58.121 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:58.122+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:58.131 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:00:58.146 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:00:58.146 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:00:58.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:00:58.146 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:00:58.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.146 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.790831152999999, 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:00:58.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:00:58.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:00:58.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.790611435000002, 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:00:58.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:00:58.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:00:58.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.820653571000001, 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:00:58.159 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:00:58.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:00:58.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:58.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.165 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.775796822, 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003522248, 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 216 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371448+0000", 2024-04-23T19:00:58.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999999e-06 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371466+0000", 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7462999999999999e-05 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371503+0000", 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7435999999999999e-05 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371526+0000", 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3193e-05 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371779+0000", 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025239499999999998 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372022+0000", 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024375800000000001 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372438+0000", 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041598699999999999 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.373881+0000", 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014422930000000001 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374755+0000", 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087446599999999996 2024-04-23T19:00:58.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374843+0000", 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8109999999999995e-05 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374967+0000", 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124003 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.735656995999999, 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032104590000000001, 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 227 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.172 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411587+0000", 2024-04-23T19:00:58.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6529999999999998e-06 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411599+0000", 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1742999999999999e-05 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411630+0000", 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1189999999999998e-05 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411648+0000", 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7183000000000001e-05 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411772+0000", 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012416599999999999 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411988+0000", 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021672099999999999 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.412408+0000", 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041941400000000001 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.413758+0000", 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00135059 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414648+0000", 2024-04-23T19:00:58.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088919699999999999 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414733+0000", 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4906000000000003e-05 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414795+0000", 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2695999999999997e-05 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.728965806000001, 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033551169999999999, 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 229 2024-04-23T19:00:58.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:00:58.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418278+0000", 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3970000000000001e-06 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418290+0000", 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1513e-05 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418320+0000", 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0266000000000001e-05 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418336+0000", 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5466000000000001e-05 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418454+0000", 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118056 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418670+0000", 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021618200000000001 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.419080+0000", 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041013699999999998 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.420493+0000", 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001412686 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421481+0000", 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098860599999999995 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421562+0000", 2024-04-23T19:00:58.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1108999999999999e-05 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421631+0000", 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8699000000000001e-05 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.722090628, 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00312875, 2024-04-23T19:00:58.184 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 231 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:00:58.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425154+0000", 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425165+0000", 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0793e-05 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425196+0000", 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0766999999999999e-05 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425210+0000", 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4836e-05 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425316+0000", 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105376 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425523+0000", 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020704499999999999 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425943+0000", 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00042057999999999999 2024-04-23T19:00:58.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.427399+0000", 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001456026 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428123+0000", 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072358800000000005 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428212+0000", 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9159000000000005e-05 2024-04-23T19:00:58.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428280+0000", 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7799999999999995e-05 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:379 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.675701991, 2024-04-23T19:00:58.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039986900000000001, 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 379 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471541+0000", 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0270000000000001e-06 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471546+0000", 2024-04-23T19:00:58.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3959999999999997e-06 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471556+0000", 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0217999999999999e-05 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471563+0000", 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7399999999999998e-06 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471612+0000", 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8761000000000003e-05 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471662+0000", 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9888000000000001e-05 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471777+0000", 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011471700000000001 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475133+0000", 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033560740000000001 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475472+0000", 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000339296 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475511+0000", 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9291e-05 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475539+0000", 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7282000000000001e-05 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:531 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:00:58.196 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.588477917999999, 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031909009999999999, 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 531 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:00:58.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558765+0000", 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558769+0000", 2024-04-23T19:00:58.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0289999999999999e-06 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558780+0000", 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1280999999999999e-05 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558787+0000", 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6830000000000002e-06 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558845+0000", 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8724999999999998e-05 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558892+0000", 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6323999999999999e-05 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559001+0000", 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109549 2024-04-23T19:00:58.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559491+0000", 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049004400000000003 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561897+0000", 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024060119999999999 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561930+0000", 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3101e-05 2024-04-23T19:00:58.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561955+0000", 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4433000000000001e-05 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:610 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.531577800000001, 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029666979999999998, 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.202 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 610 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615666+0000", 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9800000000000001e-06 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615673+0000", 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0899999999999999e-06 2024-04-23T19:00:58.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615690+0000", 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6512999999999999e-05 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615701+0000", 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1600000000000001e-05 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615767+0000", 2024-04-23T19:00:58.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6006999999999993e-05 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615859+0000", 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2101000000000005e-05 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615995+0000", 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013539199999999999 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617510+0000", 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015155699999999999 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618530+0000", 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010198760000000001 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618591+0000", 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0832000000000003e-05 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618631+0000", 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9737000000000003e-05 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.530008658, 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:00:58.208 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:00:58.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.214 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.528126272000002, 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:58.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:00:58.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:619 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.522762172, 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003212482, 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.221 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 619 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624481+0000", 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.283e-06 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624490+0000", 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1200000000000008e-06 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624508+0000", 2024-04-23T19:00:58.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7744000000000002e-05 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624519+0000", 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1676e-05 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624580+0000", 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0081000000000003e-05 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624676+0000", 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6143000000000004e-05 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624810+0000", 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013415500000000001 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627085+0000", 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022750740000000002 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627633+0000", 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054769900000000002 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627667+0000", 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4493999999999999e-05 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627692+0000", 2024-04-23T19:00:58.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5012999999999999e-05 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:670 6.11 6:88f5d812:::obj_delete_at_hint.0000000036:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.482030168000001, 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002994863, 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.227 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 670 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:00:58.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1699999999999997e-07 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665218+0000", 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2719999999999997e-06 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665229+0000", 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1206000000000001e-05 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665238+0000", 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0319999999999992e-06 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665288+0000", 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665336+0000", 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8717999999999997e-05 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665463+0000", 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126661 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.666192+0000", 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072877100000000002 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668127+0000", 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019353669999999999 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668168+0000", 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0731e-05 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668207+0000", 2024-04-23T19:00:58.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8634000000000003e-05 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.423547967000001, 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031970200000000001, 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 715 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723697+0000", 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3340000000000002e-06 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723710+0000", 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2326e-05 2024-04-23T19:00:58.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723741+0000", 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1619999999999999e-05 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723756+0000", 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5037e-05 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723982+0000", 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022630099999999999 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724208+0000", 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000225718 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724557+0000", 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034893499999999998 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.725862+0000", 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013045330000000001 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726736+0000", 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087459699999999996 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726825+0000", 2024-04-23T19:00:58.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8756000000000002e-05 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726891+0000", 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5863000000000003e-05 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.239 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.227645077999998, 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033211249999999999, 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 802 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919599+0000", 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6070000000000002e-06 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919611+0000", 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1787000000000001e-05 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919641+0000", 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919656+0000", 2024-04-23T19:00:58.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5293000000000001e-05 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919816+0000", 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015938500000000001 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920174+0000", 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035894399999999998 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920773+0000", 2024-04-23T19:00:58.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059836899999999996 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922133+0000", 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001360567 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922709+0000", 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057605500000000001 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922807+0000", 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942999999999994e-05 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922918+0000", 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110479 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.116502025999999, 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030767070000000001, 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 850 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030742+0000", 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:00:58.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030754+0000", 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1790000000000001e-05 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030784+0000", 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9836e-05 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030799+0000", 2024-04-23T19:00:58.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030912+0000", 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011252900000000001 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031130+0000", 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000218278 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031461+0000", 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033099799999999999 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.032550+0000", 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001088912 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033656+0000", 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001105918 2024-04-23T19:00:58.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033744+0000", 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7746999999999999e-05 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033817+0000", 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2972000000000005e-05 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.031292503, 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030923309999999998, 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 886 2024-04-23T19:00:58.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115952+0000", 2024-04-23T19:00:58.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.317e-06 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115964+0000", 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1863e-05 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115993+0000", 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9779999999999999e-05 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116009+0000", 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5344000000000001e-05 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116117+0000", 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107932 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116333+0000", 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021693099999999999 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116674+0000", 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034013199999999999 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.117997+0000", 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001323133 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118755+0000", 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075835799999999999 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118922+0000", 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166668 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.119042+0000", 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119873 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.257 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.004391397999999, 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029548479999999999, 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 898 2024-04-23T19:00:58.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142853+0000", 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2299999999999998e-06 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142863+0000", 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0662999999999999e-05 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142893+0000", 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9980000000000001e-05 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142912+0000", 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8960000000000001e-05 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143042+0000", 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013009600000000001 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143248+0000", 2024-04-23T19:00:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000205718 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143554+0000", 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030609499999999999 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.144613+0000", 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010588220000000001 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145528+0000", 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091486599999999996 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145689+0000", 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016123900000000001 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145805+0000", 2024-04-23T19:00:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116179 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.000389111, 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032876289999999998, 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:00:58.264 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 900 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:00:58.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146855+0000", 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.903e-06 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146864+0000", 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:00:58.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146886+0000", 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2192999999999999e-05 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146898+0000", 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1497e-05 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147077+0000", 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179412 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:00:58.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147294+0000", 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021702200000000001 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147780+0000", 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048607000000000001 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.148981+0000", 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012006670000000001 2024-04-23T19:00:58.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.149988+0000", 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001007099 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150074+0000", 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5673000000000005e-05 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150140+0000", 2024-04-23T19:00:58.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6833000000000002e-05 2024-04-23T19:00:58.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:00:58.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:00:58.270 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:00:58.271 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:00:58.272 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:58.270+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:58.293 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:00:58.294 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:00:58.324 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:00:58.324 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:00:58.354 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:00:58.354 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:00:58.372 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:00:58.372+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:00:58.384 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:00:58.385 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:00:58.403 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:00:58.404 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:00:58.404 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:00:58.404 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:00:58.417 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:00:58.417 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:00:58.418 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:00:58.447 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:00:58.448 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:00:58.472 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:58.472+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:58.477 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:00:58.477 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:00:58.509 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:00:58.509 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:00:58.541 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:58.541 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:58.555 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:00:58.602 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:58.602+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:58.671 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:58.671 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:58.674 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:58.674+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:58.685 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:00:58.776 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:58.774+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:58.854 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:58.855 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:58.868 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:00:58.910 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:58.910+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:58.977 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:58.976+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:59.032 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.032 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.047 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:00:59.078 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:59.076+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:59.110 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:00:59.167 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.167 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.180 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:59.180+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:59.181 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:00:59.280 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:59.278+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:59.305 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.306 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.319 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:00:59.406 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:00:59.406+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:00:59.481 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:59.482+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:59.482 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.482 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.497 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:00:59.582 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:00:59.580+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:00:59.660 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.660 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.674 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:00:59.683 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:00:59.680+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:00:59.784 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:00:59.782+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:00:59.797 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.797 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.812 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:00:59.898 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:00:59.898+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:00:59.976 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:00:59.976 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:00:59.985 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:00:59.986+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:00:59.990 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:00.086 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:00.084+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:00.156 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:00.157 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:00.172 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:00.216 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:00.216+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:00.288 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:00.288+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:00.339 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:00.339 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:00.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:00.400 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:00.400+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:00.489 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:00.490+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:00.525 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:00.567 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:00.567 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:00.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:00.628 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:00.628+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:00.690 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:00.688+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:00.715 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:00.715 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:00.732 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:00.733 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:00.749 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:00.749 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:00.770 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:00.770 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:00.790 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:00.790 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:00.791 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:00.790+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:00.801 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:36 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'18)", 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.104019663000003, 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071214929999999996, 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699585+0000", 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8999999999999995e-07 2024-04-23T19:01:00.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699611+0000", 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5403000000000001e-05 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699630+0000", 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8963000000000001e-05 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699644+0000", 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4194e-05 2024-04-23T19:01:00.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699751+0000", 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010655200000000001 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.699784+0000", 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706619+0000", 2024-04-23T19:01:00.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068350549999999996 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706706+0000", 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6916000000000006e-05 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:37 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'18)", 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.103115870000003, 2024-04-23T19:01:00.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062621999999999999, 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700488+0000", 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700490+0000", 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.164e-06 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700499+0000", 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4229999999999994e-06 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700517+0000", 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700531+0000", 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4466e-05 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700640+0000", 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108659 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.700675+0000", 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5376999999999997e-05 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706710+0000", 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060344509999999997 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.706751+0000", 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0873e-05 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:39 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'25, mlcod=15'22)", 2024-04-23T19:01:00.810 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.093662897000002, 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036678790000000002, 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709941+0000", 2024-04-23T19:01:00.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.709943+0000", 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2130000000000001e-06 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710100+0000", 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157899 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710120+0000", 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9953e-05 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710136+0000", 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5846e-05 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710326+0000", 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018969200000000001 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.710373+0000", 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7429999999999998e-05 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713518+0000", 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003145096 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.713609+0000", 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0749999999999997e-05 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.814 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 57.061154860999999, 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003697348, 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:01:00.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742449+0000", 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742452+0000", 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2560000000000001e-06 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742582+0000", 2024-04-23T19:01:00.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013084300000000001 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742612+0000", 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9280000000000001e-05 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742625+0000", 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3142999999999999e-05 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742795+0000", 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017040499999999999 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.742832+0000", 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.718e-05 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746060+0000", 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003227592 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:03.746147+0000", 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6649000000000003e-05 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'87)", 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.624199259000001, 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005142977, 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.819 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179405+0000", 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179406+0000", 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999995e-07 2024-04-23T19:01:00.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179411+0000", 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4229999999999996e-06 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179422+0000", 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0387000000000001e-05 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179427+0000", 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5040000000000002e-06 2024-04-23T19:01:00.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179496+0000", 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8825000000000006e-05 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.179532+0000", 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5926999999999997e-05 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184514+0000", 2024-04-23T19:01:00.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049821220000000003 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184548+0000", 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4060999999999998e-05 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'88)", 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.623509093999999, 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064279039999999999, 2024-04-23T19:01:00.823 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180095+0000", 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180096+0000", 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7299999999999996e-07 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180160+0000", 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4571000000000002e-05 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180173+0000", 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2386e-05 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180178+0000", 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7699999999999998e-06 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180252+0000", 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3413999999999999e-05 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180267+0000", 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5481999999999998e-05 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186445+0000", 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061775190000000002 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186523+0000", 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8189000000000006e-05 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'88)", 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:01:00.827 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.622991540000001, 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059950400000000001, 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:01:00.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180613+0000", 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2600000000000002e-07 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180618+0000", 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9200000000000003e-06 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180627+0000", 2024-04-23T19:01:00.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2089999999999994e-06 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.180632+0000", 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.994e-06 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184601+0000", 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039688450000000004 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184630+0000", 2024-04-23T19:01:00.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8291999999999999e-05 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186527+0000", 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001897304 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186608+0000", 2024-04-23T19:01:00.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.085e-05 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'88)", 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.622551201, 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056351600000000002, 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181053+0000", 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181054+0000", 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8599999999999998e-07 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181058+0000", 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8539999999999996e-06 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181067+0000", 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2269999999999993e-06 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181071+0000", 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999999e-06 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184933+0000", 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038617629999999998 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.184954+0000", 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1566999999999999e-05 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186611+0000", 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016566020000000001 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186688+0000", 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7422999999999994e-05 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.621822719999997, 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050014279999999996, 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.836 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181782+0000", 2024-04-23T19:01:00.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.06e-07 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181841+0000", 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9286999999999997e-05 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181850+0000", 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0019999999999995e-06 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.181855+0000", 2024-04-23T19:01:00.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6809999999999997e-06 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185296+0000", 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034414509999999999 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.185328+0000", 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1331000000000002e-05 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186694+0000", 2024-04-23T19:01:00.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013659010000000001 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186783+0000", 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9269000000000002e-05 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.621262194000003, 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045398979999999997, 2024-04-23T19:01:00.840 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182342+0000", 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182343+0000", 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182347+0000", 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6530000000000002e-06 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182356+0000", 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.473e-06 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.182362+0000", 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.545e-06 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186093+0000", 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003730953 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186109+0000", 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6013999999999999e-05 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186789+0000", 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000679405 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.186882+0000", 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3278999999999999e-05 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-23T19:01:00.844 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.284973639999997, 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035514740000000002, 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518631+0000", 2024-04-23T19:01:00.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518632+0000", 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5000000000000001e-07 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518638+0000", 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4570000000000002e-06 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518653+0000", 2024-04-23T19:01:00.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5016e-05 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518660+0000", 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5969999999999997e-06 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518732+0000", 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2323000000000005e-05 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.518755+0000", 2024-04-23T19:01:00.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2572999999999999e-05 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522106+0000", 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033516650000000002 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.522182+0000", 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5893e-05 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'107)", 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.283973304, 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00546606, 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519631+0000", 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519632+0000", 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3600000000000003e-07 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519637+0000", 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8100000000000003e-06 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519649+0000", 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046999999999999e-05 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519654+0000", 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.48e-06 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519705+0000", 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1199999999999998e-05 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.519720+0000", 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-05 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525015+0000", 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052950699999999998 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525097+0000", 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1546999999999997e-05 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4195.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'107)", 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.282791953999997, 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047363459999999998, 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520812+0000", 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520813+0000", 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.093e-06 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520855+0000", 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1835000000000002e-05 2024-04-23T19:01:00.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520872+0000", 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6472000000000001e-05 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520879+0000", 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3950000000000003e-06 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520944+0000", 2024-04-23T19:01:00.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5226000000000002e-05 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.520965+0000", 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0845000000000001e-05 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525458+0000", 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044924739999999998 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:04.525549+0000", 2024-04-23T19:01:00.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1006000000000002e-05 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:40 5.5 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.451048508, 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042657119999999996, 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:00.857 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 40 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352556+0000", 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352557+0000", 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.344e-06 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352565+0000", 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6830000000000008e-06 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352582+0000", 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6816999999999998e-05 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352589+0000", 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4479999999999997e-06 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352642+0000", 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3353999999999998e-05 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352739+0000", 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7002000000000004e-05 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.352864+0000", 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012422400000000001 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.354003+0000", 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001139698 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356727+0000", 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027232459999999999 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356768+0000", 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1346e-05 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356821+0000", 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3550000000000001e-05 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:00.862 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.486430058000003, 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091622649999999993, 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 206 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:01:00.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317174+0000", 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317178+0000", 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9099999999999998e-06 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317197+0000", 2024-04-23T19:01:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9052999999999999e-05 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317250+0000", 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2939999999999998e-05 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317269+0000", 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8522999999999999e-05 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317435+0000", 2024-04-23T19:01:00.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166322 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.317452+0000", 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7102999999999999e-05 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322654+0000", 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052020549999999997 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.322964+0000", 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030991699999999999 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.323626+0000", 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066229199999999998 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.325293+0000", 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001666774 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326186+0000", 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000892627 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326269+0000", 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3195999999999994e-05 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326336+0000", 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7552999999999995e-05 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.464283958000003, 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041039689999999998, 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 210 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339320+0000", 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339323+0000", 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339333+0000", 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339363+0000", 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0170000000000001e-05 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339378+0000", 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5003e-05 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339488+0000", 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109116 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.339695+0000", 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020707500000000001 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.340176+0000", 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000481607 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.341758+0000", 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001581678 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343222+0000", 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001464382 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343314+0000", 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1359000000000004e-05 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.343424+0000", 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110559 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:572 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.213532651999998, 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036716320000000002, 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.874 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 572 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590072+0000", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590073+0000", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1090000000000001e-06 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590079+0000", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0129999999999999e-06 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590103+0000", 2024-04-23T19:01:00.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4426e-05 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590111+0000", 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6210000000000004e-06 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590178+0000", 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7082000000000006e-05 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590288+0000", 2024-04-23T19:01:00.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109795 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590426+0000", 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013844399999999999 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.591036+0000", 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060966299999999998 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593680+0000", 2024-04-23T19:01:00.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026447229999999999 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593714+0000", 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569000000000003e-05 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593743+0000", 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9187e-05 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:631 6.18 6:1aba6385:::obj_delete_at_hint.0000000031:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.170182433000001, 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040515170000000001, 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 631 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633422+0000", 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633424+0000", 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633435+0000", 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1046000000000001e-05 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633467+0000", 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2369999999999997e-05 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633506+0000", 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8748999999999998e-05 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633581+0000", 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4420999999999998e-05 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633641+0000", 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0012000000000001e-05 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633751+0000", 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011013100000000001 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637365+0000", 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036144179999999999 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637405+0000", 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9804e-05 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637444+0000", 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9419000000000003e-05 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637473+0000", 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8923000000000001e-05 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:636 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.168363548000002, 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054414340000000002, 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.885 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 636 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:01:00.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635241+0000", 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9999999999999996e-07 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635246+0000", 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3760000000000001e-06 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635257+0000", 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0835e-05 2024-04-23T19:01:00.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635263+0000", 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8020000000000003e-06 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635305+0000", 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1823999999999998e-05 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635351+0000", 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5884000000000003e-05 2024-04-23T19:01:00.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.635448+0000", 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6501000000000003e-05 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637362+0000", 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019142790000000001 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640512+0000", 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031498979999999999 2024-04-23T19:01:00.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640610+0000", 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7909000000000001e-05 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.640682+0000", 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2325999999999998e-05 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.890 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:56.464826+0000", 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3387783210000004, 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035004630000000001, 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1020 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.464826+0000", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.464826+0000", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.464828+0000", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5189999999999999e-06 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.464841+0000", 2024-04-23T19:01:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2728000000000001e-05 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.464862+0000", 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1044e-05 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.464875+0000", 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2996999999999999e-05 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.465222+0000", 2024-04-23T19:01:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034693199999999999 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.465381+0000", 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015882400000000001 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.465615+0000", 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023369499999999999 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.466327+0000", 2024-04-23T19:01:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00071271300000000002 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.468224+0000", 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001896673 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.468280+0000", 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5653999999999999e-05 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:56.468326+0000", 2024-04-23T19:01:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6684000000000002e-05 2024-04-23T19:01:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:00.896 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:00.897 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:00.897 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:00.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:00.898 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:00.899 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:00.899 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:00.900 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:00.900 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:00.898+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:00.998 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:00.996+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:01.049 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:01.049 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:01.049 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:01.049 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:01.062 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:01.100 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:01.098+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:01.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:01:01.201 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:01.200+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:01.216 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:01.217 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:01.217 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:01.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:01.324 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:01.324+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.106384034999998, 2024-04-23T19:01:01.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:01.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.043166818000003, 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:01:01.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:01.406 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.061060505, 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.052557004999997, 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:01:01.411 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:01:01.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:01:01.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.047952737000003, 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.944459141000003, 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.422 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:01:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:01:01.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:01.428 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.065018211000002, 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:01.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:01:01.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:01:01.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.434 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.040255881, 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.01418245, 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.441 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:01:01.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.996191375000002, 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.448 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:01.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:01:01.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:01:01.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.964327044000001, 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:01.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:01:01.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:01:01.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.930256094000001, 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.462 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:01:01.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:01:01.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.923902398999999, 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:01:01.468 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:01.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:01:01.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:01:01.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:01.473 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.879496140999997, 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:01:01.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:01:01.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:01:01.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.480 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.877724317999999, 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.481 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.805669260999998, 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.487 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.762292625000001, 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:01.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:01:01.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:01:01.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.751272999999998, 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:01.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:01:01.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:01:01.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:01:01.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.504 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.491137027999997, 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.505 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:01:01.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:01:01.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.211699993000003, 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:01.511 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:01.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:01:01.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:01.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:01.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:01.517 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:01.519 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:01.519 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:01.516+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:01.619 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:01.616+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:01.721 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:01.722+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:01.732 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:01.732 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:01.732 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:01.733 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:01.750 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:01.840 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:01.840+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:01.923 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:01.922+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:01.962 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:01.963 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:01.963 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:01.963 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:01.963 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:01.981 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:02.024 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:02.024+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:02.121 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:01:02.124 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:02.122+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:02.197 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.851477005, 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003841957, 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 52 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347429+0000", 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6850000000000001e-06 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347439+0000", 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0611999999999999e-05 2024-04-23T19:01:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347466+0000", 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6465000000000002e-05 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347487+0000", 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1032000000000001e-05 2024-04-23T19:01:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347670+0000", 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183432 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347946+0000", 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000276073 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348170+0000", 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022377900000000001 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.350534+0000", 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023637329999999998 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351082+0000", 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000548256 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351167+0000", 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4788000000000002e-05 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351268+0000", 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101102 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:57 7.3 e29/28 7:c609908c:::notify.5:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.841801985000004, 2024-04-23T19:01:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037361299999999998, 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357103+0000", 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.592e-06 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357116+0000", 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3799e-05 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357148+0000", 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357165+0000", 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6375000000000002e-05 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357290+0000", 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012489700000000001 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357330+0000", 2024-04-23T19:01:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0151000000000002e-05 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360721+0000", 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033914349999999999 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360837+0000", 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011590399999999999 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.841479944, 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037999269999999998, 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357424+0000", 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.145e-06 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357432+0000", 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0320000000000003e-06 2024-04-23T19:01:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357448+0000", 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5942000000000001e-05 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357458+0000", 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7000000000000003e-06 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357576+0000", 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117897 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357632+0000", 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6650999999999997e-05 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361148+0000", 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035151399999999999 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361223+0000", 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.756919349, 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033897950000000001, 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441987+0000", 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442002+0000", 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4806e-05 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442033+0000", 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999997e-05 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442050+0000", 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442173+0000", 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012248599999999999 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442393+0000", 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000220292 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442840+0000", 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044673299999999999 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.444723+0000", 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018828530000000001 2024-04-23T19:01:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445094+0000", 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037100000000000002 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445257+0000", 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016315200000000001 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445373+0000", 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011658300000000001 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:282 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.744675151000003, 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052288359999999997, 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 282 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454229+0000", 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2929999999999999e-06 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454237+0000", 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5170000000000002e-06 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454252+0000", 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5824e-05 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454262+0000", 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3770000000000002e-06 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454323+0000", 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0764999999999998e-05 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454416+0000", 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.31e-05 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454561+0000", 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014562200000000001 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.455159+0000", 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059739799999999996 2024-04-23T19:01:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459387+0000", 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042283750000000004 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459425+0000", 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8061e-05 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459457+0000", 2024-04-23T19:01:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1504000000000002e-05 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.738991867999999, 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029594589999999998, 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 316 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459912+0000", 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.362e-06 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459919+0000", 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5710000000000003e-06 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459932+0000", 2024-04-23T19:01:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3326000000000001e-05 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459939+0000", 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6630000000000004e-06 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459997+0000", 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7692000000000003e-05 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460050+0000", 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3705000000000002e-05 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460173+0000", 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245299999999999 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460773+0000", 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060017200000000005 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462748+0000", 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001975339 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462827+0000", 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8765999999999998e-05 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462871+0000", 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.415324771000002, 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032149629999999999, 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 742 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783581+0000", 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.943e-06 2024-04-23T19:01:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783594+0000", 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3287e-05 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783627+0000", 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2310000000000001e-05 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783648+0000", 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1440000000000001e-05 2024-04-23T19:01:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783789+0000", 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014105899999999999 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784022+0000", 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000232425 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784356+0000", 2024-04-23T19:01:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033424699999999997 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.785611+0000", 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012548870000000001 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786506+0000", 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089535000000000005 2024-04-23T19:01:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786672+0000", 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165799 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786793+0000", 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121216 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.375219272000002, 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026811600000000001, 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 760 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823686+0000", 2024-04-23T19:01:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823698+0000", 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1413000000000001e-05 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823729+0000", 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1149999999999998e-05 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823748+0000", 2024-04-23T19:01:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9117e-05 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823877+0000", 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128799 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824105+0000", 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022891799999999999 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824424+0000", 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031810399999999999 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.825795+0000", 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001371597 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826212+0000", 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041680599999999998 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826296+0000", 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4259999999999996e-05 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826365+0000", 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8585999999999997e-05 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.245738836999998, 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029079140000000002, 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 817 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953167+0000", 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1999999999999999e-06 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953180+0000", 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3013000000000001e-05 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953214+0000", 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953237+0000", 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2702999999999999e-05 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953382+0000", 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014576899999999999 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953607+0000", 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000224968 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953933+0000", 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000325228 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955092+0000", 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001159265 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955913+0000", 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00082167299999999998 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955999+0000", 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5625999999999996e-05 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956072+0000", 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2948999999999996e-05 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.241937755999999, 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025253509999999999, 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 819 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956967+0000", 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-06 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956974+0000", 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3930000000000002e-06 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956995+0000", 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1086000000000001e-05 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957014+0000", 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8817e-05 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957131+0000", 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011739900000000001 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957261+0000", 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012972600000000001 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957545+0000", 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028383400000000001 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.958589+0000", 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001044192 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959357+0000", 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00076825500000000002 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959435+0000", 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7175999999999994e-05 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959491+0000", 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5955999999999998e-05 2024-04-23T19:01:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.187719702999999, 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030501270000000001, 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 841 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011186+0000", 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011198+0000", 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2622999999999999e-05 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011228+0000", 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9533e-05 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011243+0000", 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011352+0000", 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108832 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011570+0000", 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021795500000000001 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011909+0000", 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033983499999999997 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.013108+0000", 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001198897 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014087+0000", 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097877300000000006 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014170+0000", 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2599e-05 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014233+0000", 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3702999999999996e-05 2024-04-23T19:01:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.183756109999997, 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027818489999999999, 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.260 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 843 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015148+0000", 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015156+0000", 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-06 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015177+0000", 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0843e-05 2024-04-23T19:01:02.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015195+0000", 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.804e-05 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015298+0000", 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103136 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015423+0000", 2024-04-23T19:01:02.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125439 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015692+0000", 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026838099999999999 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.016742+0000", 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010509060000000001 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017779+0000", 2024-04-23T19:01:02.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010364490000000001 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017866+0000", 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6853000000000003e-05 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017929+0000", 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2982000000000001e-05 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.174564852000003, 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027191060000000002, 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.266 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 847 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024340+0000", 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024352+0000", 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1447000000000001e-05 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024383+0000", 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0855999999999997e-05 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024404+0000", 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1100000000000001e-05 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024545+0000", 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141089 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024760+0000", 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000215331 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.025077+0000", 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031710100000000003 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026118+0000", 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001040256 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026899+0000", 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078178399999999999 2024-04-23T19:01:02.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026992+0000", 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2383e-05 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027057+0000", 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5471999999999999e-05 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.170950802999997, 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025768179999999998, 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 849 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027954+0000", 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5600000000000001e-06 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027962+0000", 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1769999999999998e-06 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027983+0000", 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0743000000000001e-05 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028000+0000", 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.768e-05 2024-04-23T19:01:02.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028097+0000", 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6498999999999999e-05 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028224+0000", 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012678599999999999 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028520+0000", 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029674500000000001 2024-04-23T19:01:02.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.029539+0000", 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010187250000000001 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030393+0000", 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085408399999999996 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030470+0000", 2024-04-23T19:01:02.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6959000000000006e-05 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030529+0000", 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8860000000000002e-05 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.126634875999997, 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030724720000000001, 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.277 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 868 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072271+0000", 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.464e-06 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072283+0000", 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2952999999999999e-05 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072314+0000", 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0300000000000001e-05 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072335+0000", 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072458+0000", 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012275900000000001 2024-04-23T19:01:02.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072697+0000", 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023888100000000001 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.073021+0000", 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032375500000000001 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.074180+0000", 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011592110000000001 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075182+0000", 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010019300000000001 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075271+0000", 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8784999999999998e-05 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075341+0000", 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0013999999999997e-05 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.034674696000003, 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029175080000000001, 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 907 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164231+0000", 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164243+0000", 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2334000000000001e-05 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164275+0000", 2024-04-23T19:01:02.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2089999999999999e-05 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164296+0000", 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0795999999999999e-05 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164424+0000", 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012803599999999999 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164670+0000", 2024-04-23T19:01:02.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024600499999999999 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.165018+0000", 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034744700000000002 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166184+0000", 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001165824 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166984+0000", 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000800507 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167073+0000", 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8620000000000002e-05 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167146+0000", 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3069000000000001e-05 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.030821957999997, 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002745632, 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.289 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 909 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168083+0000", 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9130000000000001e-06 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168093+0000", 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0207000000000001e-05 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168124+0000", 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1003000000000001e-05 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168143+0000", 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8456000000000001e-05 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168240+0000", 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7510000000000007e-05 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168368+0000", 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012759199999999999 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168679+0000", 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031130399999999999 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.169823+0000", 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001144122 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170629+0000", 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080621399999999998 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170715+0000", 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5859000000000006e-05 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170827+0000", 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111452 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.935610590000003, 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031288459999999998, 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 949 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:02.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263295+0000", 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263308+0000", 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2747e-05 2024-04-23T19:01:02.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263341+0000", 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2889000000000003e-05 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263357+0000", 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6107e-05 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263512+0000", 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015534500000000001 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263881+0000", 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036884400000000001 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.264453+0000", 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057192899999999999 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.265829+0000", 2024-04-23T19:01:02.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00137644 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266271+0000", 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044168300000000001 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266355+0000", 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4142999999999997e-05 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266421+0000", 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5901999999999993e-05 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.921496566000002, 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026342539999999999, 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 955 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277409+0000", 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277420+0000", 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277451+0000", 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1180000000000003e-05 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277466+0000", 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4613000000000001e-05 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277577+0000", 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111036 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277789+0000", 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000212275 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.278119+0000", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032997400000000002 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279229+0000", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011100610000000001 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279898+0000", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066872899999999996 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279976+0000", 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8382999999999998e-05 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280041+0000", 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.918032115000003, 2024-04-23T19:01:02.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002659743, 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 957 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280872+0000", 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-06 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280880+0000", 2024-04-23T19:01:02.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999998e-06 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280900+0000", 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.016e-05 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280911+0000", 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0723000000000001e-05 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281026+0000", 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115859 2024-04-23T19:01:02.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281159+0000", 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013248900000000001 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281427+0000", 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000268585 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.282476+0000", 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001048282 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283367+0000", 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089120300000000003 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283463+0000", 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6052999999999997e-05 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283531+0000", 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7589000000000006e-05 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.310 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.311 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:02.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:02.313 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:02.310+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:02.413 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:02.412+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:02.481 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:02.481 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:02.481 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:02.481 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:02.498 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:02.514 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:02.514+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:02.615 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:02.612+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:02.709 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:02.709 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:02.709 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:02.710 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:02.710 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:02.715 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:02.712+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:02.728 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:02.816 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:02.816+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:02.885 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.529702082, 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.886 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:01:02.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:01:02.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.891 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.529482364000003, 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.892 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:01:02.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.559524500000002, 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.898 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:01:02.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:01:02.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:01:02.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.514667750999998, 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003522248, 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 216 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.905 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371448+0000", 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999999e-06 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371466+0000", 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7462999999999999e-05 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371503+0000", 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7435999999999999e-05 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371526+0000", 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3193e-05 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371779+0000", 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025239499999999998 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372022+0000", 2024-04-23T19:01:02.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024375800000000001 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372438+0000", 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041598699999999999 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.373881+0000", 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014422930000000001 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374755+0000", 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087446599999999996 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374843+0000", 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8109999999999995e-05 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374967+0000", 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124003 2024-04-23T19:01:02.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.474527924999997, 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032104590000000001, 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.911 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 227 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411587+0000", 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6529999999999998e-06 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411599+0000", 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1742999999999999e-05 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411630+0000", 2024-04-23T19:01:02.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1189999999999998e-05 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411648+0000", 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7183000000000001e-05 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411772+0000", 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012416599999999999 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411988+0000", 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021672099999999999 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.412408+0000", 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041941400000000001 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.413758+0000", 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00135059 2024-04-23T19:01:02.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414648+0000", 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088919699999999999 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414733+0000", 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4906000000000003e-05 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414795+0000", 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2695999999999997e-05 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.467836734999999, 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033551169999999999, 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.917 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 229 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418278+0000", 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3970000000000001e-06 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418290+0000", 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1513e-05 2024-04-23T19:01:02.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418320+0000", 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0266000000000001e-05 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418336+0000", 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5466000000000001e-05 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418454+0000", 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118056 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418670+0000", 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021618200000000001 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.419080+0000", 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041013699999999998 2024-04-23T19:01:02.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.420493+0000", 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001412686 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421481+0000", 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098860599999999995 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421562+0000", 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1108999999999999e-05 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421631+0000", 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8699000000000001e-05 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.923 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.460961556999997, 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00312875, 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 231 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425154+0000", 2024-04-23T19:01:02.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425165+0000", 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0793e-05 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425196+0000", 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0766999999999999e-05 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425210+0000", 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4836e-05 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425316+0000", 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105376 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425523+0000", 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020704499999999999 2024-04-23T19:01:02.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425943+0000", 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00042057999999999999 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.427399+0000", 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001456026 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428123+0000", 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072358800000000005 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428212+0000", 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9159000000000005e-05 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428280+0000", 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7799999999999995e-05 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:379 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.414572919999998, 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039986900000000001, 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 379 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.930 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471541+0000", 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0270000000000001e-06 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471546+0000", 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3959999999999997e-06 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471556+0000", 2024-04-23T19:01:02.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0217999999999999e-05 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471563+0000", 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7399999999999998e-06 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471612+0000", 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8761000000000003e-05 2024-04-23T19:01:02.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471662+0000", 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9888000000000001e-05 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471777+0000", 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011471700000000001 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475133+0000", 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033560740000000001 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475472+0000", 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000339296 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475511+0000", 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9291e-05 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475539+0000", 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7282000000000001e-05 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:531 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.327348847000003, 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031909009999999999, 2024-04-23T19:01:02.936 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 531 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558765+0000", 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558769+0000", 2024-04-23T19:01:02.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0289999999999999e-06 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558780+0000", 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1280999999999999e-05 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558787+0000", 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6830000000000002e-06 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558845+0000", 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8724999999999998e-05 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558892+0000", 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6323999999999999e-05 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559001+0000", 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109549 2024-04-23T19:01:02.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559491+0000", 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049004400000000003 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561897+0000", 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024060119999999999 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561930+0000", 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3101e-05 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561955+0000", 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4433000000000001e-05 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:610 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.270448729000002, 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029666979999999998, 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 610 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615666+0000", 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9800000000000001e-06 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615673+0000", 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0899999999999999e-06 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615690+0000", 2024-04-23T19:01:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6512999999999999e-05 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615701+0000", 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1600000000000001e-05 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615767+0000", 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6006999999999993e-05 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615859+0000", 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2101000000000005e-05 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615995+0000", 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013539199999999999 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617510+0000", 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015155699999999999 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618530+0000", 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010198760000000001 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618591+0000", 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0832000000000003e-05 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618631+0000", 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9737000000000003e-05 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.268879587000001, 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.949 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:01:02.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:01:02.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.266997201000002, 2024-04-23T19:01:02.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:01:02.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:01:02.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:619 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.261633101000001, 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003212482, 2024-04-23T19:01:02.961 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 619 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624481+0000", 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.283e-06 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624490+0000", 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1200000000000008e-06 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624508+0000", 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7744000000000002e-05 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624519+0000", 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1676e-05 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624580+0000", 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0081000000000003e-05 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624676+0000", 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6143000000000004e-05 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624810+0000", 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013415500000000001 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627085+0000", 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022750740000000002 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627633+0000", 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054769900000000002 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627667+0000", 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4493999999999999e-05 2024-04-23T19:01:02.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627692+0000", 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5012999999999999e-05 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:670 6.11 6:88f5d812:::obj_delete_at_hint.0000000036:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.220901097000002, 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002994863, 2024-04-23T19:01:02.967 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 670 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1699999999999997e-07 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665218+0000", 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2719999999999997e-06 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665229+0000", 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1206000000000001e-05 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665238+0000", 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0319999999999992e-06 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665288+0000", 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665336+0000", 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8717999999999997e-05 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665463+0000", 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126661 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.666192+0000", 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072877100000000002 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668127+0000", 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019353669999999999 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668168+0000", 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0731e-05 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668207+0000", 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8634000000000003e-05 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.972 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.162418895999998, 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031970200000000001, 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.973 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 715 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723697+0000", 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3340000000000002e-06 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723710+0000", 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2326e-05 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723741+0000", 2024-04-23T19:01:02.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1619999999999999e-05 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723756+0000", 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5037e-05 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723982+0000", 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022630099999999999 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724208+0000", 2024-04-23T19:01:02.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000225718 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724557+0000", 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034893499999999998 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.725862+0000", 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013045330000000001 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726736+0000", 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087459699999999996 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726825+0000", 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8756000000000002e-05 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726891+0000", 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5863000000000003e-05 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.966516007000003, 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033211249999999999, 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 802 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919599+0000", 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6070000000000002e-06 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919611+0000", 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1787000000000001e-05 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919641+0000", 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919656+0000", 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5293000000000001e-05 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919816+0000", 2024-04-23T19:01:02.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015938500000000001 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920174+0000", 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035894399999999998 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920773+0000", 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059836899999999996 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922133+0000", 2024-04-23T19:01:02.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001360567 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922709+0000", 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057605500000000001 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922807+0000", 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942999999999994e-05 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922918+0000", 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110479 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.855372955, 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030767070000000001, 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.987 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 850 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030742+0000", 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030754+0000", 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1790000000000001e-05 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030784+0000", 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9836e-05 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030799+0000", 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030912+0000", 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011252900000000001 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031130+0000", 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000218278 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031461+0000", 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033099799999999999 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.032550+0000", 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001088912 2024-04-23T19:01:02.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033656+0000", 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001105918 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033744+0000", 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7746999999999999e-05 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033817+0000", 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2972000000000005e-05 2024-04-23T19:01:02.992 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.770163431999997, 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030923309999999998, 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.993 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 886 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115952+0000", 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.317e-06 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115964+0000", 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1863e-05 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115993+0000", 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9779999999999999e-05 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116009+0000", 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5344000000000001e-05 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116117+0000", 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107932 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116333+0000", 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021693099999999999 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116674+0000", 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034013199999999999 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.117997+0000", 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001323133 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118755+0000", 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075835799999999999 2024-04-23T19:01:02.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118922+0000", 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166668 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.119042+0000", 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119873 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.743262326999997, 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029548479999999999, 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 898 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:02.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142853+0000", 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2299999999999998e-06 2024-04-23T19:01:03.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142863+0000", 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0662999999999999e-05 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142893+0000", 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9980000000000001e-05 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142912+0000", 2024-04-23T19:01:03.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8960000000000001e-05 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143042+0000", 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013009600000000001 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143248+0000", 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000205718 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143554+0000", 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030609499999999999 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.144613+0000", 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010588220000000001 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145528+0000", 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091486599999999996 2024-04-23T19:01:03.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145689+0000", 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016123900000000001 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145805+0000", 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116179 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.739260039999998, 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032876289999999998, 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 900 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146855+0000", 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.903e-06 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146864+0000", 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146886+0000", 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2192999999999999e-05 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146898+0000", 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1497e-05 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147077+0000", 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179412 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147294+0000", 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021702200000000001 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147780+0000", 2024-04-23T19:01:03.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048607000000000001 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.148981+0000", 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012006670000000001 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.149988+0000", 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001007099 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150074+0000", 2024-04-23T19:01:03.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5673000000000005e-05 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150140+0000", 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6833000000000002e-05 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:03.011 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:03.013 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:03.013 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:03.012+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:03.113 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:03.112+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:03.144 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:03.144 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:03.144 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:03.144 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:03.159 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:03.214 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:03.214+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:03.254 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:03.254 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:03.278 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:03.279 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:03.279 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:03.279 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:03.279 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:03.285 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:03.285 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:03.293 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:03.315 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:03.315 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:03.338 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:03.338+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:03.343 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:03.343 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:03.373 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:03.374 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:03.390 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:03.391 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:03.407 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:03.408 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:03.416 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:03.414+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:03.426 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:03.426 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:03.465 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:03.465 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:03.481 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:03.516 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:03.516+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:03.617 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:03.618+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:03.644 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:03.644 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:03.658 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:03.718 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:03.716+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:03.819 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:03.816+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:03.823 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:03.823 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:03.837 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:03.920 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:03.918+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:03.958 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:03.958 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:03.973 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:04.062 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:04.062+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:04.122 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:04.120+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:04.139 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:04.139 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:04.148 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:01:04.153 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:04.246 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:04.246+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:04.320 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:04.321 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:04.324 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:04.322+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:04.335 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:04.425 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:04.424+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:04.499 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:04.500 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:04.515 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:04.562 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:04.562+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:04.627 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:04.626+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:04.638 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:04.638 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:04.652 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:04.727 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:04.724+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:04.812 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:04.812 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:04.827 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:04.829 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:04.828+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:04.930 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:04.930+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:04.944 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:04.944 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:04.959 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:05.031 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:05.030+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:05.126 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:05.126 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:05.133 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:05.134+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:05.138 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:01:05.147 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:05.235 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:05.234+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:05.272 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:05.272 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:05.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:05.335 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:05.334+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:05.436 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:05.436+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:05.442 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:05.446 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:05.446 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:05.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:05.552 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:05.552+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:05.611 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:05.611 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:05.637 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:05.637 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:05.638 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:05.636+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:05.641 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:05.642 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:05.652 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:05.670 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:05.671 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:05.700 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:05.700 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:05.734 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:05.735 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:05.739 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:05.738+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:05.769 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:05.769 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:05.802 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:05.802 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:05.809 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:05.809 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:05.809 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:05.809 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:05.809 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:05.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:05.833 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:05.833 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:05.840 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:05.838+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:05.941 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:05.940+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:06.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.715513102000003, 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:06.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:06.009 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.652295885000001, 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:06.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.670189571999998, 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.661686072000002, 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:01:06.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:01:06.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.657081804000001, 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:01:06.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:01:06.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:06.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.553588208000001, 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:01:06.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:01:06.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.033 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.674147278, 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:01:06.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:01:06.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:01:06.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.649384947999998, 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:01:06.039 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:01:06.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:01:06.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:01:06.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.623311516999998, 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.054 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.605320442, 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.573456110999999, 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.060 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:01:06.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:01:06.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:01:06.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.539385160999998, 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.066 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:01:06.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:01:06.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:01:06.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.071 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.533031465999997, 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.075 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.488625208000002, 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:01:06.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:01:06.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:01:06.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.486853385000003, 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:01:06.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:01:06.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:01:06.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:01:06.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.414798328000003, 2024-04-23T19:01:06.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:01:06.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.091 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.371421691999998, 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.095 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.360402067000003, 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:01:06.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:01:06.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:01:06.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:01:06.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.100266095000002, 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:01:06.101 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:01:06.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.820829060000001, 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.107 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:01:06.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.113 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.113 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.113 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.113 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:06.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:06.115 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:06.112+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:06.214 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:06.212+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:06.318 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:06.318 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:06.318 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:06.318 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:06.319 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:06.319 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:06.318+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:06.419 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:06.418+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:06.469 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:06.469 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:06.469 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:06.469 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:06.469 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:06.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:06.520 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:06.518+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:06.593 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:06.593 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:06.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:06.593 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:06.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.247056854999997, 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003841957, 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 52 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.594 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347429+0000", 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6850000000000001e-06 2024-04-23T19:01:06.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347439+0000", 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0611999999999999e-05 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347466+0000", 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6465000000000002e-05 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347487+0000", 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1032000000000001e-05 2024-04-23T19:01:06.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347670+0000", 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183432 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347946+0000", 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000276073 2024-04-23T19:01:06.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348170+0000", 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022377900000000001 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.350534+0000", 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023637329999999998 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351082+0000", 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000548256 2024-04-23T19:01:06.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351167+0000", 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4788000000000002e-05 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351268+0000", 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101102 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:57 7.3 e29/28 7:c609908c:::notify.5:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:06.599 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.237381835000001, 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037361299999999998, 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:06.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357103+0000", 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.592e-06 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357116+0000", 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3799e-05 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357148+0000", 2024-04-23T19:01:06.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357165+0000", 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6375000000000002e-05 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357290+0000", 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012489700000000001 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357330+0000", 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0151000000000002e-05 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360721+0000", 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033914349999999999 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360837+0000", 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011590399999999999 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.237059793999997, 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037999269999999998, 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357424+0000", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.145e-06 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357432+0000", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0320000000000003e-06 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357448+0000", 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5942000000000001e-05 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357458+0000", 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7000000000000003e-06 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357576+0000", 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117897 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357632+0000", 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6650999999999997e-05 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361148+0000", 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035151399999999999 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361223+0000", 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2024-04-23T19:01:06.607 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.152499198999998, 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033897950000000001, 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441987+0000", 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442002+0000", 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4806e-05 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442033+0000", 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999997e-05 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442050+0000", 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442173+0000", 2024-04-23T19:01:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012248599999999999 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442393+0000", 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000220292 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442840+0000", 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044673299999999999 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.444723+0000", 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018828530000000001 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445094+0000", 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037100000000000002 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445257+0000", 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016315200000000001 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445373+0000", 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011658300000000001 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:282 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.140255001, 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052288359999999997, 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 282 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454229+0000", 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2929999999999999e-06 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454237+0000", 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5170000000000002e-06 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454252+0000", 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5824e-05 2024-04-23T19:01:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454262+0000", 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3770000000000002e-06 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454323+0000", 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0764999999999998e-05 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454416+0000", 2024-04-23T19:01:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.31e-05 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454561+0000", 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014562200000000001 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.455159+0000", 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059739799999999996 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459387+0000", 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042283750000000004 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459425+0000", 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8061e-05 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459457+0000", 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1504000000000002e-05 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.134571717999997, 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029594589999999998, 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 316 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459912+0000", 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.362e-06 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459919+0000", 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5710000000000003e-06 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459932+0000", 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3326000000000001e-05 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459939+0000", 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6630000000000004e-06 2024-04-23T19:01:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459997+0000", 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7692000000000003e-05 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460050+0000", 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3705000000000002e-05 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460173+0000", 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245299999999999 2024-04-23T19:01:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460773+0000", 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060017200000000005 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462748+0000", 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001975339 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462827+0000", 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8765999999999998e-05 2024-04-23T19:01:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462871+0000", 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.810904620999999, 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032149629999999999, 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 742 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783581+0000", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.943e-06 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783594+0000", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3287e-05 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783627+0000", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2310000000000001e-05 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783648+0000", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1440000000000001e-05 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783789+0000", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014105899999999999 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784022+0000", 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000232425 2024-04-23T19:01:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784356+0000", 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033424699999999997 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.785611+0000", 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012548870000000001 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786506+0000", 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089535000000000005 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786672+0000", 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165799 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786793+0000", 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121216 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.770799122, 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026811600000000001, 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 760 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823686+0000", 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823698+0000", 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1413000000000001e-05 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823729+0000", 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1149999999999998e-05 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823748+0000", 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9117e-05 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823877+0000", 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128799 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824105+0000", 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022891799999999999 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824424+0000", 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031810399999999999 2024-04-23T19:01:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.825795+0000", 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001371597 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826212+0000", 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041680599999999998 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826296+0000", 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4259999999999996e-05 2024-04-23T19:01:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826365+0000", 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8585999999999997e-05 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.641318687000002, 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029079140000000002, 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 817 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953167+0000", 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1999999999999999e-06 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953180+0000", 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3013000000000001e-05 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953214+0000", 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953237+0000", 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2702999999999999e-05 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953382+0000", 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014576899999999999 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953607+0000", 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000224968 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953933+0000", 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000325228 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955092+0000", 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001159265 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955913+0000", 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00082167299999999998 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955999+0000", 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5625999999999996e-05 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956072+0000", 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2948999999999996e-05 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.637517606000003, 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025253509999999999, 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 819 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956967+0000", 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-06 2024-04-23T19:01:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956974+0000", 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3930000000000002e-06 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956995+0000", 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1086000000000001e-05 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957014+0000", 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8817e-05 2024-04-23T19:01:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957131+0000", 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011739900000000001 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957261+0000", 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012972600000000001 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957545+0000", 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028383400000000001 2024-04-23T19:01:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.958589+0000", 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001044192 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959357+0000", 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00076825500000000002 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959435+0000", 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7175999999999994e-05 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959491+0000", 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5955999999999998e-05 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.583299553000003, 2024-04-23T19:01:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030501270000000001, 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 841 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011186+0000", 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011198+0000", 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2622999999999999e-05 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011228+0000", 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9533e-05 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011243+0000", 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011352+0000", 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108832 2024-04-23T19:01:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011570+0000", 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021795500000000001 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011909+0000", 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033983499999999997 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.013108+0000", 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001198897 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014087+0000", 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097877300000000006 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014170+0000", 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2599e-05 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014233+0000", 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3702999999999996e-05 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.579335960000002, 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027818489999999999, 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 843 2024-04-23T19:01:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015148+0000", 2024-04-23T19:01:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015156+0000", 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-06 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015177+0000", 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0843e-05 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015195+0000", 2024-04-23T19:01:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.804e-05 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015298+0000", 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103136 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015423+0000", 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125439 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015692+0000", 2024-04-23T19:01:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026838099999999999 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.016742+0000", 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010509060000000001 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017779+0000", 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010364490000000001 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017866+0000", 2024-04-23T19:01:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6853000000000003e-05 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017929+0000", 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2982000000000001e-05 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.570144702, 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027191060000000002, 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 847 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024340+0000", 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024352+0000", 2024-04-23T19:01:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1447000000000001e-05 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024383+0000", 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0855999999999997e-05 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024404+0000", 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1100000000000001e-05 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024545+0000", 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141089 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024760+0000", 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000215331 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.025077+0000", 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031710100000000003 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026118+0000", 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001040256 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026899+0000", 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078178399999999999 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026992+0000", 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2383e-05 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027057+0000", 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5471999999999999e-05 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.566530653000001, 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025768179999999998, 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 849 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027954+0000", 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5600000000000001e-06 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027962+0000", 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1769999999999998e-06 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027983+0000", 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0743000000000001e-05 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028000+0000", 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.768e-05 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028097+0000", 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6498999999999999e-05 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028224+0000", 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012678599999999999 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028520+0000", 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029674500000000001 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.029539+0000", 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010187250000000001 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030393+0000", 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085408399999999996 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030470+0000", 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6959000000000006e-05 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030529+0000", 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8860000000000002e-05 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.522214726000001, 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030724720000000001, 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 868 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072271+0000", 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.464e-06 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072283+0000", 2024-04-23T19:01:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2952999999999999e-05 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072314+0000", 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0300000000000001e-05 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072335+0000", 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072458+0000", 2024-04-23T19:01:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012275900000000001 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072697+0000", 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023888100000000001 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.073021+0000", 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032375500000000001 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.074180+0000", 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011592110000000001 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075182+0000", 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010019300000000001 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075271+0000", 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8784999999999998e-05 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075341+0000", 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0013999999999997e-05 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.430254546, 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029175080000000001, 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 907 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164231+0000", 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164243+0000", 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2334000000000001e-05 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164275+0000", 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2089999999999999e-05 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164296+0000", 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0795999999999999e-05 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164424+0000", 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012803599999999999 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164670+0000", 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024600499999999999 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.165018+0000", 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034744700000000002 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166184+0000", 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001165824 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166984+0000", 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000800507 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167073+0000", 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8620000000000002e-05 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167146+0000", 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3069000000000001e-05 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.426401808000001, 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002745632, 2024-04-23T19:01:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 909 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168083+0000", 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9130000000000001e-06 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168093+0000", 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0207000000000001e-05 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168124+0000", 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1003000000000001e-05 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168143+0000", 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8456000000000001e-05 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168240+0000", 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7510000000000007e-05 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168368+0000", 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012759199999999999 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168679+0000", 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031130399999999999 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.169823+0000", 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001144122 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170629+0000", 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080621399999999998 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170715+0000", 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5859000000000006e-05 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170827+0000", 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111452 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.33119044, 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031288459999999998, 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 949 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263295+0000", 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263308+0000", 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2747e-05 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263341+0000", 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2889000000000003e-05 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263357+0000", 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6107e-05 2024-04-23T19:01:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263512+0000", 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015534500000000001 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263881+0000", 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036884400000000001 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.264453+0000", 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057192899999999999 2024-04-23T19:01:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.265829+0000", 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00137644 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266271+0000", 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044168300000000001 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266355+0000", 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4142999999999997e-05 2024-04-23T19:01:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266421+0000", 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5901999999999993e-05 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.317076415999999, 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026342539999999999, 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 955 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277409+0000", 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277420+0000", 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277451+0000", 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1180000000000003e-05 2024-04-23T19:01:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277466+0000", 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4613000000000001e-05 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277577+0000", 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111036 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277789+0000", 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000212275 2024-04-23T19:01:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.278119+0000", 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032997400000000002 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279229+0000", 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011100610000000001 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279898+0000", 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066872899999999996 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279976+0000", 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8382999999999998e-05 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280041+0000", 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.313611965, 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002659743, 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 957 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280872+0000", 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-06 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280880+0000", 2024-04-23T19:01:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999998e-06 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280900+0000", 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.016e-05 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280911+0000", 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0723000000000001e-05 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281026+0000", 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115859 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281159+0000", 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013248900000000001 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281427+0000", 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000268585 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.282476+0000", 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001048282 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283367+0000", 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089120300000000003 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283463+0000", 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6052999999999997e-05 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283531+0000", 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7589000000000006e-05 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:06.702 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:06.703 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:06.704 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:06.700+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:06.804 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:06.806+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:06.905 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:06.904+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:06.911 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:06.912 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:06.912 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:06.912 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:06.931 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:07.006 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:07.006+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:07.106 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:07.104+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:07.140 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:07.141 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:07.141 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:07.141 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:07.141 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:07.158 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:07.171 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:01:07.208 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:07.206+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:07.309 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:07.308+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.016246242999998, 2024-04-23T19:01:07.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:01:07.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:01:07.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:01:07.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:07.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.016026525000001, 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.379 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:01:07.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.384 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.046068661, 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:07.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:01:07.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:01:07.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:07.390 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.001211912000002, 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003522248, 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 216 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371448+0000", 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999999e-06 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371466+0000", 2024-04-23T19:01:07.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7462999999999999e-05 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371503+0000", 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7435999999999999e-05 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371526+0000", 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3193e-05 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371779+0000", 2024-04-23T19:01:07.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025239499999999998 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372022+0000", 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024375800000000001 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372438+0000", 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041598699999999999 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.373881+0000", 2024-04-23T19:01:07.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014422930000000001 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374755+0000", 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087446599999999996 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374843+0000", 2024-04-23T19:01:07.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8109999999999995e-05 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374967+0000", 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124003 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.961072086000001, 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032104590000000001, 2024-04-23T19:01:07.396 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 227 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411587+0000", 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6529999999999998e-06 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411599+0000", 2024-04-23T19:01:07.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1742999999999999e-05 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411630+0000", 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1189999999999998e-05 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411648+0000", 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7183000000000001e-05 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411772+0000", 2024-04-23T19:01:07.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012416599999999999 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411988+0000", 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021672099999999999 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.412408+0000", 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041941400000000001 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.413758+0000", 2024-04-23T19:01:07.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00135059 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414648+0000", 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088919699999999999 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414733+0000", 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4906000000000003e-05 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414795+0000", 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2695999999999997e-05 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.954380896000004, 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033551169999999999, 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.402 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 229 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418278+0000", 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3970000000000001e-06 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418290+0000", 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1513e-05 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418320+0000", 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0266000000000001e-05 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418336+0000", 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5466000000000001e-05 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418454+0000", 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118056 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418670+0000", 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021618200000000001 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.419080+0000", 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041013699999999998 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.420493+0000", 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001412686 2024-04-23T19:01:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421481+0000", 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098860599999999995 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421562+0000", 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1108999999999999e-05 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421631+0000", 2024-04-23T19:01:07.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8699000000000001e-05 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.947505718000002, 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00312875, 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 231 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:07.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425154+0000", 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425165+0000", 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0793e-05 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425196+0000", 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0766999999999999e-05 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425210+0000", 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4836e-05 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425316+0000", 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105376 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425523+0000", 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020704499999999999 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425943+0000", 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00042057999999999999 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.427399+0000", 2024-04-23T19:01:07.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001456026 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428123+0000", 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072358800000000005 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428212+0000", 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9159000000000005e-05 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428280+0000", 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7799999999999995e-05 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:379 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.901117081000002, 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039986900000000001, 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 379 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471541+0000", 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0270000000000001e-06 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471546+0000", 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3959999999999997e-06 2024-04-23T19:01:07.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471556+0000", 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0217999999999999e-05 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471563+0000", 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7399999999999998e-06 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471612+0000", 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8761000000000003e-05 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471662+0000", 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9888000000000001e-05 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471777+0000", 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011471700000000001 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475133+0000", 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033560740000000001 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475472+0000", 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000339296 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475511+0000", 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9291e-05 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475539+0000", 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7282000000000001e-05 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:531 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.813893008000001, 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031909009999999999, 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.420 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 531 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:07.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558765+0000", 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558769+0000", 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0289999999999999e-06 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558780+0000", 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1280999999999999e-05 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558787+0000", 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6830000000000002e-06 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558845+0000", 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8724999999999998e-05 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558892+0000", 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6323999999999999e-05 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559001+0000", 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109549 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559491+0000", 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049004400000000003 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561897+0000", 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024060119999999999 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561930+0000", 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3101e-05 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561955+0000", 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4433000000000001e-05 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.425 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:610 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.756992889999999, 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029666979999999998, 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.426 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 610 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615666+0000", 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9800000000000001e-06 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615673+0000", 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0899999999999999e-06 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615690+0000", 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6512999999999999e-05 2024-04-23T19:01:07.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615701+0000", 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1600000000000001e-05 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615767+0000", 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6006999999999993e-05 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615859+0000", 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2101000000000005e-05 2024-04-23T19:01:07.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615995+0000", 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013539199999999999 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617510+0000", 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015155699999999999 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618530+0000", 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010198760000000001 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618591+0000", 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0832000000000003e-05 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618631+0000", 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9737000000000003e-05 2024-04-23T19:01:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.755423747999998, 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.432 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:01:07.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.753541362, 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.438 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:01:07.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:01:07.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:619 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.748177261999999, 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003212482, 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.444 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 619 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624481+0000", 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.283e-06 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624490+0000", 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1200000000000008e-06 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624508+0000", 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7744000000000002e-05 2024-04-23T19:01:07.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624519+0000", 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1676e-05 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624580+0000", 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0081000000000003e-05 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624676+0000", 2024-04-23T19:01:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6143000000000004e-05 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624810+0000", 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013415500000000001 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627085+0000", 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022750740000000002 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627633+0000", 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054769900000000002 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627667+0000", 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4493999999999999e-05 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627692+0000", 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5012999999999999e-05 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:670 6.11 6:88f5d812:::obj_delete_at_hint.0000000036:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.707445258, 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002994863, 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 670 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.450 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1699999999999997e-07 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665218+0000", 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2719999999999997e-06 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665229+0000", 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1206000000000001e-05 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665238+0000", 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0319999999999992e-06 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665288+0000", 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665336+0000", 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8717999999999997e-05 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:07.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665463+0000", 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126661 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.666192+0000", 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072877100000000002 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668127+0000", 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019353669999999999 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668168+0000", 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0731e-05 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668207+0000", 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8634000000000003e-05 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.455 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.648963057000003, 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031970200000000001, 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 715 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723697+0000", 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3340000000000002e-06 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723710+0000", 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2326e-05 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723741+0000", 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1619999999999999e-05 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723756+0000", 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5037e-05 2024-04-23T19:01:07.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723982+0000", 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022630099999999999 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724208+0000", 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000225718 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724557+0000", 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034893499999999998 2024-04-23T19:01:07.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.725862+0000", 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013045330000000001 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726736+0000", 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087459699999999996 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726825+0000", 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8756000000000002e-05 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726891+0000", 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5863000000000003e-05 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:07.461 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.453060168, 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033211249999999999, 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 802 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:07.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919599+0000", 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6070000000000002e-06 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919611+0000", 2024-04-23T19:01:07.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1787000000000001e-05 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919641+0000", 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919656+0000", 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5293000000000001e-05 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919816+0000", 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015938500000000001 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920174+0000", 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035894399999999998 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920773+0000", 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059836899999999996 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922133+0000", 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001360567 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922709+0000", 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057605500000000001 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922807+0000", 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942999999999994e-05 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922918+0000", 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110479 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.341917115999998, 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030767070000000001, 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.467 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 850 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:07.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030742+0000", 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030754+0000", 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1790000000000001e-05 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030784+0000", 2024-04-23T19:01:07.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9836e-05 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030799+0000", 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030912+0000", 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011252900000000001 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031130+0000", 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000218278 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031461+0000", 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033099799999999999 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.032550+0000", 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001088912 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033656+0000", 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001105918 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033744+0000", 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7746999999999999e-05 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033817+0000", 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2972000000000005e-05 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.472 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.256707593000002, 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030923309999999998, 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 886 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115952+0000", 2024-04-23T19:01:07.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.317e-06 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115964+0000", 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1863e-05 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115993+0000", 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9779999999999999e-05 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116009+0000", 2024-04-23T19:01:07.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5344000000000001e-05 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116117+0000", 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107932 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116333+0000", 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021693099999999999 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116674+0000", 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034013199999999999 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.117997+0000", 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001323133 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118755+0000", 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075835799999999999 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118922+0000", 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166668 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.119042+0000", 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119873 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.229806488000001, 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029548479999999999, 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 898 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142853+0000", 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2299999999999998e-06 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142863+0000", 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0662999999999999e-05 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142893+0000", 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9980000000000001e-05 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142912+0000", 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8960000000000001e-05 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143042+0000", 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013009600000000001 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143248+0000", 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000205718 2024-04-23T19:01:07.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143554+0000", 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030609499999999999 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.144613+0000", 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010588220000000001 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145528+0000", 2024-04-23T19:01:07.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091486599999999996 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145689+0000", 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016123900000000001 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145805+0000", 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116179 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.225804201000003, 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032876289999999998, 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 900 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.485 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146855+0000", 2024-04-23T19:01:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.903e-06 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146864+0000", 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146886+0000", 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2192999999999999e-05 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146898+0000", 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1497e-05 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147077+0000", 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179412 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147294+0000", 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021702200000000001 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:07.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147780+0000", 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048607000000000001 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.148981+0000", 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012006670000000001 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.149988+0000", 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001007099 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150074+0000", 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5673000000000005e-05 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150140+0000", 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6833000000000002e-05 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:07.490 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:07.492 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:07.492 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:07.490+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:07.593 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:07.590+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:07.623 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:07.624 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:07.637 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:07.679 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T19:01:07.679 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T19:01:07.726 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:07.726+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:07.795 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:07.794+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:07.807 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:07.807 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:07.807 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:07.807 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:07.807 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:07.821 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:07.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:07.904 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:07.904+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.699656005999998, 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013567132000000001, 2024-04-23T19:01:07.988 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "reached pg", 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 43 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287246+0000", 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287264+0000", 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8057e-05 2024-04-23T19:01:07.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287308+0000", 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4305999999999999e-05 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287339+0000", 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0586000000000002e-05 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287542+0000", 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020379600000000001 2024-04-23T19:01:07.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287561+0000", 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8933e-05 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290847+0000", 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032856209999999999 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290866+0000", 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9176000000000001e-05 2024-04-23T19:01:07.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300494+0000", 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096278960000000004 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300809+0000", 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031514800000000001 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 44.662216543, 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00551514, 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:07.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324683+0000", 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9e-06 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324699+0000", 2024-04-23T19:01:07.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324728+0000", 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9119999999999999e-05 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324750+0000", 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2512999999999999e-05 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324873+0000", 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012215500000000001 2024-04-23T19:01:07.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324917+0000", 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4539999999999997e-05 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330069+0000", 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051520569999999998 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330197+0000", 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012738199999999999 2024-04-23T19:01:07.997 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 44.653514770000001, 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003186178, 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333385+0000", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8360000000000001e-06 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:07.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333402+0000", 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6497000000000001e-05 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333432+0000", 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0052999999999998e-05 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333452+0000", 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0407e-05 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333590+0000", 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138338 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333649+0000", 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8282999999999997e-05 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336446+0000", 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027977950000000001 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336569+0000", 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012296900000000001 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.644975983000002, 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011915968000000001, 2024-04-23T19:01:08.002 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 211 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341926+0000", 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1099999999999996e-06 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341945+0000", 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9000000000000001e-05 2024-04-23T19:01:08.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341993+0000", 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7503000000000002e-05 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342018+0000", 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5593e-05 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342181+0000", 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016242599999999999 2024-04-23T19:01:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342191+0000", 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.078e-05 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.349751+0000", 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075600240000000003 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350006+0000", 2024-04-23T19:01:08.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025478499999999999 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350549+0000", 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054278300000000002 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353220+0000", 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026713230000000002 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353616+0000", 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525699999999999 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353719+0000", 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102935 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353838+0000", 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119449 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.560120327999996, 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003042117, 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 232 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.009 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426780+0000", 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7539999999999998e-06 2024-04-23T19:01:08.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426795+0000", 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426828+0000", 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2505999999999997e-05 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426844+0000", 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6350000000000001e-05 2024-04-23T19:01:08.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426976+0000", 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013226899999999999 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427210+0000", 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233995 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427628+0000", 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041769300000000001 2024-04-23T19:01:08.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.428890+0000", 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012622410000000001 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429617+0000", 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00072667999999999995 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429702+0000", 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4932999999999995e-05 2024-04-23T19:01:08.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429820+0000", 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118106 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:282 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'1, mlcod=0'0)", 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.533986478999999, 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044810049999999997, 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.014 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452913+0000", 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.61e-06 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452928+0000", 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4725999999999999e-05 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452961+0000", 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2987000000000001e-05 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452980+0000", 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9130000000000001e-05 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453231+0000", 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025115800000000002 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453282+0000", 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0399999999999999e-05 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457272+0000", 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039908950000000004 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457393+0000", 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120099 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.018 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:381 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.515833999999998, 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031594100000000001, 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.019 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 381 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471067+0000", 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7769999999999998e-06 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471080+0000", 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3723000000000001e-05 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471120+0000", 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9644000000000002e-05 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471159+0000", 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9199000000000002e-05 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471290+0000", 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013020600000000001 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471498+0000", 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020810199999999999 2024-04-23T19:01:08.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471858+0000", 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036045000000000001 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.472782+0000", 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00092351 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474065+0000", 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012835430000000001 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474154+0000", 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8752999999999995e-05 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474223+0000", 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9503000000000002e-05 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.024 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:436 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.487344983, 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044919260000000003, 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.025 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 436 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499555+0000", 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3070000000000001e-06 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499568+0000", 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2493e-05 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499602+0000", 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4146999999999997e-05 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499616+0000", 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4523e-05 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499751+0000", 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013462200000000001 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499929+0000", 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177982 2024-04-23T19:01:08.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.500410+0000", 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00048108299999999999 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.501598+0000", 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011874069999999999 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503787+0000", 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021889470000000001 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503944+0000", 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157276 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.504045+0000", 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101139 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.030 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:448 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.479142639000003, 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030702529999999998, 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 448 2024-04-23T19:01:08.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507757+0000", 2024-04-23T19:01:08.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0099999999999998e-06 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507768+0000", 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0285999999999999e-05 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507805+0000", 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7307e-05 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507842+0000", 2024-04-23T19:01:08.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6915999999999997e-05 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507949+0000", 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107116 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508108+0000", 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000158839 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508535+0000", 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042690000000000002 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.509707+0000", 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011724789999999999 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510553+0000", 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00084599899999999995 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510716+0000", 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016286499999999999 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510826+0000", 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109536 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.036 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.441730438, 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072361279999999997, 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 513 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:08.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545170+0000", 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3120000000000001e-06 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545182+0000", 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2411e-05 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545214+0000", 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2217e-05 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545231+0000", 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6773999999999999e-05 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545374+0000", 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014263700000000001 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545518+0000", 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014400900000000001 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545965+0000", 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044757100000000001 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549086+0000", 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031200540000000001 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552249+0000", 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031637530000000001 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552336+0000", 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6953000000000006e-05 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552404+0000", 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7436999999999998e-05 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.279280868999997, 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003222716, 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.042 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 709 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707620+0000", 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707633+0000", 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.314e-05 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707664+0000", 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1040000000000001e-05 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707678+0000", 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.464e-05 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707831+0000", 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015302600000000001 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708162+0000", 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033048300000000001 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708653+0000", 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049063600000000002 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710243+0000", 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001590082 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710645+0000", 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040251000000000002 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710729+0000", 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4336e-05 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710840+0000", 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110383 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.047 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.238174749000002, 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029940230000000002, 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.048 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 727 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748725+0000", 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.75e-06 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748736+0000", 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1303e-05 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748757+0000", 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0347e-05 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748769+0000", 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2585999999999999e-05 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748873+0000", 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103899 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749110+0000", 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023694800000000001 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749432+0000", 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032160799999999997 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.750634+0000", 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001202231 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751548+0000", 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091438000000000001 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751642+0000", 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3468999999999996e-05 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751717+0000", 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5501999999999996e-05 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.053 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.888023881000002, 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032013279999999998, 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 880 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098877+0000", 2024-04-23T19:01:08.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9830000000000001e-06 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098888+0000", 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1306e-05 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098919+0000", 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0513000000000001e-05 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098934+0000", 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4823e-05 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099074+0000", 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013983600000000001 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099308+0000", 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234062 2024-04-23T19:01:08.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099637+0000", 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032965099999999998 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.100666+0000", 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010285680000000001 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.101917+0000", 2024-04-23T19:01:08.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012506939999999999 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102006+0000", 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9382999999999994e-05 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102075+0000", 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9509000000000001e-05 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.883632818999999, 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029265570000000002, 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.060 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 882 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103267+0000", 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.26e-06 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103279+0000", 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1384e-05 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103309+0000", 2024-04-23T19:01:08.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0652999999999999e-05 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103324+0000", 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4346e-05 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103420+0000", 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103538+0000", 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118609 2024-04-23T19:01:08.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103801+0000", 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026304399999999998 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.104974+0000", 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001172761 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.105999+0000", 2024-04-23T19:01:08.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010254719999999999 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106087+0000", 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7968999999999998e-05 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106192+0000", 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104279 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.880469736999999, 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034247909999999999, 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.066 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 883 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106430+0000", 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7099999999999999e-06 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106440+0000", 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8800000000000003e-06 2024-04-23T19:01:08.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106462+0000", 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2342999999999999e-05 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106474+0000", 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.181e-05 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106622+0000", 2024-04-23T19:01:08.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014796899999999999 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106999+0000", 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037749700000000002 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.107574+0000", 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00057426199999999997 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109014+0000", 2024-04-23T19:01:08.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001439989 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109686+0000", 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00067183200000000003 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109779+0000", 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3156000000000001e-05 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109853+0000", 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4343000000000003e-05 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.876041784000002, 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003034063, 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.074 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 885 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:08.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110858+0000", 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.863e-06 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110870+0000", 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2150000000000001e-05 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110901+0000", 2024-04-23T19:01:08.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1163e-05 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110916+0000", 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4724e-05 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111036+0000", 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120209 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111161+0000", 2024-04-23T19:01:08.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000125012 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111421+0000", 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025950799999999998 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.112475+0000", 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010545120000000001 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113627+0000", 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001151841 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113780+0000", 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153296 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113890+0000", 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010978499999999999 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.811135759000003, 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029383579999999999, 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 913 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175764+0000", 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2340000000000001e-06 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175776+0000", 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1776e-05 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175807+0000", 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999998e-05 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175821+0000", 2024-04-23T19:01:08.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175937+0000", 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115543 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176166+0000", 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022886099999999999 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:08.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176486+0000", 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031968799999999999 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.177674+0000", 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011888770000000001 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178510+0000", 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00083547700000000005 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178599+0000", 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9445999999999997e-05 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178701+0000", 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101266 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.782322024000003, 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003226638, 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 925 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.086 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204578+0000", 2024-04-23T19:01:08.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.187e-06 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204592+0000", 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3645999999999999e-05 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204622+0000", 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0642999999999998e-05 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204637+0000", 2024-04-23T19:01:08.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4780000000000001e-05 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204816+0000", 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000178975 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205038+0000", 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221745 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205375+0000", 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033716799999999999 2024-04-23T19:01:08.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.206493+0000", 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011176980000000001 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207654+0000", 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001161668 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207741+0000", 2024-04-23T19:01:08.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6312999999999998e-05 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207803+0000", 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1815000000000004e-05 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.777954176999998, 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00291888, 2024-04-23T19:01:08.091 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 927 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208946+0000", 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.753e-06 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208955+0000", 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7799999999999995e-06 2024-04-23T19:01:08.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208986+0000", 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0976000000000003e-05 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209001+0000", 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.45e-05 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209200+0000", 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019944900000000001 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209348+0000", 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014803799999999999 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209624+0000", 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027591099999999999 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.210737+0000", 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001112352 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211714+0000", 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00097736900000000007 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211801+0000", 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7002999999999994e-05 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211863+0000", 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1748999999999994e-05 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 40.774671900000001, 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002883722, 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:08.097 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 928 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:08.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212228+0000", 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1500000000000002e-06 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212239+0000", 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0477e-05 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:08.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212269+0000", 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0522999999999999e-05 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212284+0000", 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212462+0000", 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017774800000000001 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212686+0000", 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022414900000000001 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212983+0000", 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029747699999999998 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214294+0000", 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001310507 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214953+0000", 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065902500000000004 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215046+0000", 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3319000000000006e-05 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215110+0000", 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3536999999999998e-05 2024-04-23T19:01:08.102 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.103 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.103 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.103 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:08.103 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:08.103 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:08.104 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:08.105 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:08.106 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:08.106 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:08.106+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:08.113 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:08.143 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:08.143 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:08.167 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:01:08.175 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:08.208 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:08.209 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:08.209 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:08.208+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:08.240 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:08.241 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:08.272 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:08.273 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:08.274 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:08.274 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:08.288 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:08.336 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:08.340+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:08.406 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:08.408+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:08.412 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:08.412 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:08.426 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:08.510 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:08.508+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:08.550 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:08.550 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:08.565 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:08.610 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:08.610+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:08.682 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:08.683 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:08.696 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:08.714 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:08.716+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:08.816 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:08.816+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:08.854 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:08.855 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:08.869 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:08.918 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:08.918+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:08.991 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:08.991 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:09.005 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:09.017 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:09.020+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:09.118 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:09.118+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:09.171 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:09.171 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:09.185 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:09.218 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:09.220+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:09.320 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:09.318+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:09.349 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:09.363 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:09.450 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:09.450+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:09.522 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:09.522+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:09.533 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:09.534 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:09.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:09.622 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:09.622+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:09.656 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:09.657 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:09.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:09.723 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:09.724+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:09.779 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:09.779 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:09.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:09.824 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:09.822+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:09.925 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:09.928+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:10.003 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:10.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:10.064 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:10.068+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:10.126 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:10.126+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:10.193 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:01:10.227 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:10.226+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:10.234 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:10.234 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:10.253 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:10.294 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:10.340 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:10.344+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:10.428 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:10.428+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:10.484 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:10.485 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:10.500 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:10.501 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:10.503 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:10.528 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:10.526+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:10.532 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:10.532 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:10.562 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:10.562 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:10.597 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:10.597 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:10.629 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:10.629 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:10.630 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:10.632+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:10.658 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:10.659 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:10.690 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:10.691 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:10.701 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:10.701 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:10.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.413432131, 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:10.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:10.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:10.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4452.0:40 5.5 e25/24 5:a7fe1f00:::zonegroup_info.ef964d61-f6ef-4637-9678-62377319c8e7:head v 25'1, mlcod=0'0)", 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.350214913999999, 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035544050000000001, 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353010+0000", 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9200000000000002e-07 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353017+0000", 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3160000000000002e-06 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353032+0000", 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4922e-05 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353044+0000", 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2398000000000001e-05 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353153+0000", 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010904999999999999 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.353192+0000", 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8689999999999997e-05 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356476+0000", 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003284192 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.356564+0000", 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8444999999999998e-05 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.368108601000003, 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064262410000000001, 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.711 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335116+0000", 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335118+0000", 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335135+0000", 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6937000000000001e-05 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335168+0000", 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2246000000000003e-05 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335190+0000", 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1917e-05 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335341+0000", 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015124499999999999 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.335389+0000", 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.871e-05 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341423+0000", 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006033325 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.341543+0000", 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119768 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.715 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:50 7.15 e29/28 7:a93a5511:::notify.2:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.359605101, 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030717819999999999, 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343620+0000", 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343621+0000", 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9000000000000005e-07 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343631+0000", 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8199999999999992e-06 2024-04-23T19:01:10.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343662+0000", 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1000000000000001e-05 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343682+0000", 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0628999999999998e-05 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343885+0000", 2024-04-23T19:01:10.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020250499999999999 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.343928+0000", 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3096999999999998e-05 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346578+0000", 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00265029 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.346692+0000", 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113451 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.355000832999998, 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029346749999999999, 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.720 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348224+0000", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348226+0000", 2024-04-23T19:01:10.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0229999999999999e-06 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348242+0000", 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5704000000000001e-05 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348283+0000", 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1662999999999997e-05 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348304+0000", 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.048e-05 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348450+0000", 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014636299999999999 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348503+0000", 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244000000000003e-05 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351052+0000", 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025491060000000002 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351159+0000", 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107092 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.251507236999998, 2024-04-23T19:01:10.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036679070000000002, 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 193 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451718+0000", 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451720+0000", 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2239999999999998e-06 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451732+0000", 2024-04-23T19:01:10.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.166e-05 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451761+0000", 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9592999999999999e-05 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451776+0000", 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.448e-05 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.451915+0000", 2024-04-23T19:01:10.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013945599999999999 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452275+0000", 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036023700000000001 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.452732+0000", 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045678299999999999 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.454577+0000", 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018450960000000001 2024-04-23T19:01:10.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455232+0000", 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00065456499999999996 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455319+0000", 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7039000000000005e-05 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.455386+0000", 2024-04-23T19:01:10.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6773999999999995e-05 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.372066306999997, 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039159470000000004, 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.730 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 208 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331159+0000", 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331162+0000", 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9629999999999998e-06 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331190+0000", 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8479999999999998e-05 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331222+0000", 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331237+0000", 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5238999999999999e-05 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331350+0000", 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112873 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.331573+0000", 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000222745 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.332032+0000", 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045915700000000002 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.333403+0000", 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013707089999999999 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334865+0000", 2024-04-23T19:01:10.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014622560000000001 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.334956+0000", 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1478999999999996e-05 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.335075+0000", 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118186 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.347303977000003, 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00325333, 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 212 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355921+0000", 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355923+0000", 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.34e-06 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355937+0000", 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3273e-05 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355964+0000", 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.783e-05 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.355979+0000", 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4497e-05 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356091+0000", 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112532 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356320+0000", 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000228602 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.356742+0000", 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000422447 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358262+0000", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001519708 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.358929+0000", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066687199999999999 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359059+0000", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012950900000000001 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.359174+0000", 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011572 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.321230546000002, 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003456378, 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 219 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381994+0000", 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.381997+0000", 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3099999999999999e-06 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382009+0000", 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2774e-05 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382041+0000", 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1192999999999998e-05 2024-04-23T19:01:10.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382055+0000", 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4663e-05 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382175+0000", 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120146 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382408+0000", 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023260800000000001 2024-04-23T19:01:10.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.382843+0000", 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043478000000000001 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.384087+0000", 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012438340000000001 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385255+0000", 2024-04-23T19:01:10.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011680779999999999 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385344+0000", 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9625999999999999e-05 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.385451+0000", 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106366 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.303239470999998, 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035022709999999999, 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 224 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399985+0000", 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399988+0000", 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2400000000000002e-06 2024-04-23T19:01:10.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.399999+0000", 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1317e-05 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400029+0000", 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0453000000000001e-05 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400044+0000", 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5e-05 2024-04-23T19:01:10.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400146+0000", 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101826 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400363+0000", 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021627500000000001 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.400815+0000", 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045213700000000002 2024-04-23T19:01:10.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.402300+0000", 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001485325 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403291+0000", 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00099077600000000007 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403380+0000", 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9592999999999994e-05 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.403488+0000", 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107329 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.271375140000004, 2024-04-23T19:01:10.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003044784, 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 233 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431850+0000", 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431852+0000", 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.057e-06 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431862+0000", 2024-04-23T19:01:10.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0597e-05 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431893+0000", 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0882e-05 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.431908+0000", 2024-04-23T19:01:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432021+0000", 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432255+0000", 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023388799999999999 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.432694+0000", 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043895000000000002 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434116+0000", 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001421896 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434693+0000", 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057695800000000003 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434784+0000", 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1357e-05 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.434895+0000", 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110309 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.758 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:353 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.237304190000003, 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031354719999999998, 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 353 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:10.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465921+0000", 2024-04-23T19:01:10.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465922+0000", 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.04e-06 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465927+0000", 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8659999999999997e-06 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465936+0000", 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3819999999999993e-06 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.465945+0000", 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6810000000000004e-06 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466004+0000", 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9774000000000001e-05 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466058+0000", 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3931999999999998e-05 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:10.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466236+0000", 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017763699999999999 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.466841+0000", 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000604624 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.468946+0000", 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021058100000000001 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469005+0000", 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8899e-05 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.469056+0000", 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0827e-05 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:378 6.19 e32/26 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head v 32'3, mlcod=32'1)", 2024-04-23T19:01:10.766 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.230950495000002, 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031187609999999998, 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472274+0000", 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472275+0000", 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.049e-06 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472282+0000", 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5740000000000001e-06 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472295+0000", 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.305e-05 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472304+0000", 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1260000000000004e-06 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472357+0000", 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3096999999999997e-05 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.472375+0000", 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.785e-05 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475341+0000", 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002965821 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475393+0000", 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2194000000000002e-05 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:461 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.186544237, 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044727689999999997, 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 461 2024-04-23T19:01:10.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516681+0000", 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516682+0000", 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.009e-06 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516686+0000", 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516697+0000", 2024-04-23T19:01:10.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0511e-05 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516702+0000", 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9479999999999999e-06 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516737+0000", 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5496e-05 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516788+0000", 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0481e-05 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.516900+0000", 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111761 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518541+0000", 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001641008 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521058+0000", 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025169950000000002 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521109+0000", 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1297e-05 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521153+0000", 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4629999999999998e-05 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.776 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:465 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.184772414000001, 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044421560000000001, 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 465 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.777 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518452+0000", 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518453+0000", 2024-04-23T19:01:10.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7999999999999995e-07 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518457+0000", 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5319999999999998e-06 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518466+0000", 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9469999999999992e-06 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518470+0000", 2024-04-23T19:01:10.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5549999999999996e-06 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518511+0000", 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0710000000000002e-05 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518561+0000", 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0241999999999998e-05 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.518671+0000", 2024-04-23T19:01:10.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110241 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.521388+0000", 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002716324 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522816+0000", 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001428363 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522849+0000", 2024-04-23T19:01:10.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2771999999999997e-05 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.522895+0000", 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5890000000000003e-05 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:572 6.18 e32/26 6:1902608e:::obj_delete_at_hint.0000000024:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.112717357000001, 2024-04-23T19:01:10.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030201899999999999, 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590508+0000", 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9299999999999996e-07 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590515+0000", 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7320000000000001e-06 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590527+0000", 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.167e-05 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590533+0000", 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6879999999999996e-06 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590590+0000", 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7145000000000003e-05 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.590614+0000", 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4443e-05 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593473+0000", 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028587560000000001 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.593528+0000", 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4863e-05 2024-04-23T19:01:10.786 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:631 6.18 e32/26 6:1aba6385:::obj_delete_at_hint.0000000031:head v 32'9, mlcod=32'7)", 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.069340721000003, 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003291623, 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633884+0000", 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633886+0000", 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.401e-06 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633894+0000", 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2940000000000006e-06 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633912+0000", 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7787000000000001e-05 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633918+0000", 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8029999999999999e-06 2024-04-23T19:01:10.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633974+0000", 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5183999999999999e-05 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.633989+0000", 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4854e-05 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637141+0000", 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003152466 2024-04-23T19:01:10.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.637176+0000", 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:646 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.058321096, 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035780040000000001, 2024-04-23T19:01:10.791 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 646 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644904+0000", 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644906+0000", 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8729999999999999e-06 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644913+0000", 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499999999999997e-06 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644925+0000", 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.226e-05 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.644936+0000", 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0699999999999999e-05 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645002+0000", 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5535000000000002e-05 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645098+0000", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6058999999999996e-05 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.645303+0000", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020480100000000001 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.646869+0000", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566713 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648297+0000", 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001427357 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648393+0000", 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6154000000000001e-05 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.648482+0000", 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9001999999999999e-05 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.796 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.798185124, 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029701179999999999, 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 796 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.797 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905040+0000", 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905042+0000", 2024-04-23T19:01:10.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905053+0000", 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0787e-05 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905082+0000", 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9386999999999998e-05 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905097+0000", 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.471e-05 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905190+0000", 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2876999999999999e-05 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905418+0000", 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022811000000000001 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:10.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.905721+0000", 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000302491 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.906925+0000", 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001204374 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907859+0000", 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00093413000000000003 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.907945+0000", 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6101999999999997e-05 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.908010+0000", 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4739999999999993e-05 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:10.802 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.518748088999999, 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029816220000000002, 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 916 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:10.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184477+0000", 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184480+0000", 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:10.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184493+0000", 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.292e-05 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184523+0000", 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0499000000000001e-05 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184544+0000", 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0514e-05 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184675+0000", 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013167499999999999 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.184912+0000", 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000237159 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.185257+0000", 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034452700000000002 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.186423+0000", 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001166105 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187319+0000", 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089553699999999996 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187398+0000", 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9102000000000003e-05 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:10.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.187458+0000", 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0767000000000003e-05 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:10.808 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:10.810 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:10.810 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:10.811 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:10.811 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:10.812+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:10.911 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:10.910+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:10.987 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:10.987 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:10.987 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:10.987 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:11.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:11.012 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:11.014+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:11.113 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:11.110+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:11.114 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:11.114 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:11.114 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:11.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:11.170 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:01:11.244 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:11.248+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:11.255 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.909461839000002, 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003841957, 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 52 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347429+0000", 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6850000000000001e-06 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347439+0000", 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0611999999999999e-05 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347466+0000", 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6465000000000002e-05 2024-04-23T19:01:11.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347487+0000", 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1032000000000001e-05 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347670+0000", 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183432 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347946+0000", 2024-04-23T19:01:11.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000276073 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348170+0000", 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022377900000000001 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.350534+0000", 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023637329999999998 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351082+0000", 2024-04-23T19:01:11.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000548256 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351167+0000", 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4788000000000002e-05 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351268+0000", 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101102 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:57 7.3 e29/28 7:c609908c:::notify.5:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.899786818999999, 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037361299999999998, 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357103+0000", 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.592e-06 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357116+0000", 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3799e-05 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357148+0000", 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357165+0000", 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6375000000000002e-05 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357290+0000", 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012489700000000001 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357330+0000", 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0151000000000002e-05 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360721+0000", 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033914349999999999 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360837+0000", 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011590399999999999 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.899464778000002, 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037999269999999998, 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:11.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357424+0000", 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.145e-06 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357432+0000", 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0320000000000003e-06 2024-04-23T19:01:11.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357448+0000", 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5942000000000001e-05 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357458+0000", 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7000000000000003e-06 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357576+0000", 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117897 2024-04-23T19:01:11.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357632+0000", 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6650999999999997e-05 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361148+0000", 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035151399999999999 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361223+0000", 2024-04-23T19:01:11.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.814904183000003, 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033897950000000001, 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.270 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441987+0000", 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442002+0000", 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4806e-05 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442033+0000", 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999997e-05 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442050+0000", 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442173+0000", 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012248599999999999 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442393+0000", 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000220292 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442840+0000", 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044673299999999999 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.444723+0000", 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018828530000000001 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445094+0000", 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037100000000000002 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445257+0000", 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016315200000000001 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445373+0000", 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011658300000000001 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.275 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:282 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.802659984999998, 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052288359999999997, 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 282 2024-04-23T19:01:11.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454229+0000", 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2929999999999999e-06 2024-04-23T19:01:11.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454237+0000", 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5170000000000002e-06 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454252+0000", 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5824e-05 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454262+0000", 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3770000000000002e-06 2024-04-23T19:01:11.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454323+0000", 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0764999999999998e-05 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454416+0000", 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.31e-05 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454561+0000", 2024-04-23T19:01:11.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014562200000000001 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.455159+0000", 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059739799999999996 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459387+0000", 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042283750000000004 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459425+0000", 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8061e-05 2024-04-23T19:01:11.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459457+0000", 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1504000000000002e-05 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.796976702000002, 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029594589999999998, 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.281 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 316 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459912+0000", 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.362e-06 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459919+0000", 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5710000000000003e-06 2024-04-23T19:01:11.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459932+0000", 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3326000000000001e-05 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459939+0000", 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6630000000000004e-06 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459997+0000", 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7692000000000003e-05 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460050+0000", 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3705000000000002e-05 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460173+0000", 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245299999999999 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460773+0000", 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060017200000000005 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462748+0000", 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001975339 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462827+0000", 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8765999999999998e-05 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462871+0000", 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:01:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.473309604999997, 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032149629999999999, 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.287 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 742 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783581+0000", 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.943e-06 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783594+0000", 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3287e-05 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783627+0000", 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2310000000000001e-05 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783648+0000", 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1440000000000001e-05 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783789+0000", 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014105899999999999 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784022+0000", 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000232425 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784356+0000", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033424699999999997 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.785611+0000", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012548870000000001 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786506+0000", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089535000000000005 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786672+0000", 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165799 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786793+0000", 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121216 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.433204105999998, 2024-04-23T19:01:11.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026811600000000001, 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 760 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823686+0000", 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823698+0000", 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1413000000000001e-05 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823729+0000", 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1149999999999998e-05 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823748+0000", 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9117e-05 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823877+0000", 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128799 2024-04-23T19:01:11.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824105+0000", 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022891799999999999 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824424+0000", 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031810399999999999 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.825795+0000", 2024-04-23T19:01:11.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001371597 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826212+0000", 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041680599999999998 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826296+0000", 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4259999999999996e-05 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826365+0000", 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8585999999999997e-05 2024-04-23T19:01:11.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.303723671, 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029079140000000002, 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.298 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 817 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953167+0000", 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1999999999999999e-06 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953180+0000", 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3013000000000001e-05 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953214+0000", 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953237+0000", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2702999999999999e-05 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953382+0000", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014576899999999999 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953607+0000", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000224968 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953933+0000", 2024-04-23T19:01:11.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000325228 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955092+0000", 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001159265 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955913+0000", 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00082167299999999998 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955999+0000", 2024-04-23T19:01:11.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5625999999999996e-05 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956072+0000", 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2948999999999996e-05 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.299922590000001, 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025253509999999999, 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.303 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 819 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:11.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956967+0000", 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-06 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956974+0000", 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3930000000000002e-06 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956995+0000", 2024-04-23T19:01:11.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1086000000000001e-05 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957014+0000", 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8817e-05 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957131+0000", 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011739900000000001 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957261+0000", 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012972600000000001 2024-04-23T19:01:11.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957545+0000", 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028383400000000001 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.958589+0000", 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001044192 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959357+0000", 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00076825500000000002 2024-04-23T19:01:11.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959435+0000", 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7175999999999994e-05 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959491+0000", 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5955999999999998e-05 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.245704537000002, 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030501270000000001, 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 841 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011186+0000", 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011198+0000", 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2622999999999999e-05 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011228+0000", 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9533e-05 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011243+0000", 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011352+0000", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108832 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011570+0000", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021795500000000001 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011909+0000", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033983499999999997 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.013108+0000", 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001198897 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014087+0000", 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097877300000000006 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014170+0000", 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2599e-05 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014233+0000", 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3702999999999996e-05 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.241740944, 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027818489999999999, 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.314 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 843 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015148+0000", 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015156+0000", 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-06 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015177+0000", 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0843e-05 2024-04-23T19:01:11.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015195+0000", 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.804e-05 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015298+0000", 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103136 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015423+0000", 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125439 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015692+0000", 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026838099999999999 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.016742+0000", 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010509060000000001 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017779+0000", 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010364490000000001 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017866+0000", 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6853000000000003e-05 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017929+0000", 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2982000000000001e-05 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.232549685999999, 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027191060000000002, 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 847 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:11.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024340+0000", 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024352+0000", 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1447000000000001e-05 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024383+0000", 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0855999999999997e-05 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024404+0000", 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1100000000000001e-05 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024545+0000", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141089 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024760+0000", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000215331 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.025077+0000", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031710100000000003 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026118+0000", 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001040256 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026899+0000", 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078178399999999999 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026992+0000", 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2383e-05 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027057+0000", 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5471999999999999e-05 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.228935636999999, 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025768179999999998, 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.325 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 849 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027954+0000", 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5600000000000001e-06 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027962+0000", 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1769999999999998e-06 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027983+0000", 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0743000000000001e-05 2024-04-23T19:01:11.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028000+0000", 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.768e-05 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028097+0000", 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6498999999999999e-05 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028224+0000", 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012678599999999999 2024-04-23T19:01:11.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028520+0000", 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029674500000000001 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.029539+0000", 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010187250000000001 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030393+0000", 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085408399999999996 2024-04-23T19:01:11.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030470+0000", 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6959000000000006e-05 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030529+0000", 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8860000000000002e-05 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.18461971, 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030724720000000001, 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 868 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:11.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072271+0000", 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.464e-06 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072283+0000", 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2952999999999999e-05 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072314+0000", 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0300000000000001e-05 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072335+0000", 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072458+0000", 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012275900000000001 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072697+0000", 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023888100000000001 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.073021+0000", 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032375500000000001 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.074180+0000", 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011592110000000001 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075182+0000", 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010019300000000001 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075271+0000", 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8784999999999998e-05 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075341+0000", 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0013999999999997e-05 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.092659529999999, 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029175080000000001, 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.336 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 907 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:11.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164231+0000", 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164243+0000", 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2334000000000001e-05 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164275+0000", 2024-04-23T19:01:11.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2089999999999999e-05 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164296+0000", 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0795999999999999e-05 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164424+0000", 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012803599999999999 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164670+0000", 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024600499999999999 2024-04-23T19:01:11.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.165018+0000", 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034744700000000002 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166184+0000", 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001165824 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166984+0000", 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000800507 2024-04-23T19:01:11.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167073+0000", 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8620000000000002e-05 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167146+0000", 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3069000000000001e-05 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.088806792, 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002745632, 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 909 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:11.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168083+0000", 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9130000000000001e-06 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168093+0000", 2024-04-23T19:01:11.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0207000000000001e-05 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168124+0000", 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1003000000000001e-05 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168143+0000", 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8456000000000001e-05 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168240+0000", 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7510000000000007e-05 2024-04-23T19:01:11.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168368+0000", 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012759199999999999 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168679+0000", 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031130399999999999 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.169823+0000", 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001144122 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170629+0000", 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080621399999999998 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170715+0000", 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5859000000000006e-05 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170827+0000", 2024-04-23T19:01:11.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111452 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.993595423999999, 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031288459999999998, 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.347 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 949 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263295+0000", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263308+0000", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2747e-05 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263341+0000", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2889000000000003e-05 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263357+0000", 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6107e-05 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263512+0000", 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015534500000000001 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263881+0000", 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036884400000000001 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.264453+0000", 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057192899999999999 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.265829+0000", 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00137644 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266271+0000", 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044168300000000001 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266355+0000", 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4142999999999997e-05 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266421+0000", 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5901999999999993e-05 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:11.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.979481399999997, 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026342539999999999, 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 955 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277409+0000", 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277420+0000", 2024-04-23T19:01:11.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277451+0000", 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1180000000000003e-05 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277466+0000", 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4613000000000001e-05 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277577+0000", 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111036 2024-04-23T19:01:11.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277789+0000", 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000212275 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.278119+0000", 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032997400000000002 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279229+0000", 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011100610000000001 2024-04-23T19:01:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279898+0000", 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066872899999999996 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279976+0000", 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8382999999999998e-05 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280041+0000", 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:11.357 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.976016948999998, 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002659743, 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.358 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 957 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280872+0000", 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-06 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280880+0000", 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999998e-06 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280900+0000", 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.016e-05 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280911+0000", 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0723000000000001e-05 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281026+0000", 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115859 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281159+0000", 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013248900000000001 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281427+0000", 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000268585 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.282476+0000", 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001048282 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283367+0000", 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089120300000000003 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283463+0000", 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6052999999999997e-05 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283531+0000", 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7589000000000006e-05 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.363 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:11.365 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:11.365 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:11.368+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:11.466 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:11.468+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:11.520 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:11.520 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:11.520 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:11.520 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:11.534 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:11.577 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:11.580+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:11.668 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:11.666+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:11.742 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:11.742 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:11.742 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:11.742 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:11.742 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:11.760 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:11.769 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:11.770+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:11.870 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:11.872+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:11.930 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:11.930 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:11.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:11.930 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:11.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.930 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.574734802999998, 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:11.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:01:11.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:01:11.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:01:11.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:01:11.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:11.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:01:11.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:01:11.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:11.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:01:11.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:01:11.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:01:11.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:01:11.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:01:11.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:01:11.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:01:11.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:01:11.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.942 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:11.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:11.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.574515085000002, 2024-04-23T19:01:11.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:01:11.943 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:11.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:11.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:01:11.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:11.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:01:11.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:01:11.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:01:11.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:01:11.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:01:11.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:01:11.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:01:11.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:01:11.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:11.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:01:11.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:01:11.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:01:11.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:01:11.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:01:11.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:01:11.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:01:11.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:01:11.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.604557221, 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.956 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:01:11.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.963 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.559700472000003, 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003522248, 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 216 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371448+0000", 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999999e-06 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371466+0000", 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7462999999999999e-05 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371503+0000", 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7435999999999999e-05 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371526+0000", 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3193e-05 2024-04-23T19:01:11.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371779+0000", 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025239499999999998 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372022+0000", 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024375800000000001 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372438+0000", 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041598699999999999 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.373881+0000", 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014422930000000001 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374755+0000", 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087446599999999996 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374843+0000", 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8109999999999995e-05 2024-04-23T19:01:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374967+0000", 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124003 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.519560646000002, 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032104590000000001, 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.969 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 227 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411587+0000", 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6529999999999998e-06 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411599+0000", 2024-04-23T19:01:11.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1742999999999999e-05 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411630+0000", 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1189999999999998e-05 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411648+0000", 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7183000000000001e-05 2024-04-23T19:01:11.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411772+0000", 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012416599999999999 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411988+0000", 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021672099999999999 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.412408+0000", 2024-04-23T19:01:11.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041941400000000001 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.413758+0000", 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00135059 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414648+0000", 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088919699999999999 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414733+0000", 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4906000000000003e-05 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414795+0000", 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2695999999999997e-05 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.512869455999997, 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033551169999999999, 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 229 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.976 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418278+0000", 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3970000000000001e-06 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418290+0000", 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1513e-05 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418320+0000", 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0266000000000001e-05 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418336+0000", 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5466000000000001e-05 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418454+0000", 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118056 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418670+0000", 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021618200000000001 2024-04-23T19:01:11.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.419080+0000", 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041013699999999998 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.420493+0000", 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001412686 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421481+0000", 2024-04-23T19:01:11.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098860599999999995 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421562+0000", 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1108999999999999e-05 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421631+0000", 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8699000000000001e-05 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.505994278000003, 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00312875, 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 231 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.982 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425154+0000", 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:11.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425165+0000", 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0793e-05 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425196+0000", 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0766999999999999e-05 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425210+0000", 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4836e-05 2024-04-23T19:01:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425316+0000", 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105376 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425523+0000", 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020704499999999999 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425943+0000", 2024-04-23T19:01:11.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00042057999999999999 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.427399+0000", 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001456026 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428123+0000", 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072358800000000005 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428212+0000", 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9159000000000005e-05 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428280+0000", 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7799999999999995e-05 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:379 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.459605641000003, 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039986900000000001, 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 379 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471541+0000", 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0270000000000001e-06 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471546+0000", 2024-04-23T19:01:11.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3959999999999997e-06 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471556+0000", 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0217999999999999e-05 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471563+0000", 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7399999999999998e-06 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471612+0000", 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8761000000000003e-05 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471662+0000", 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9888000000000001e-05 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471777+0000", 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011471700000000001 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475133+0000", 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033560740000000001 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475472+0000", 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000339296 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475511+0000", 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9291e-05 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475539+0000", 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7282000000000001e-05 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:531 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.372381568000002, 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031909009999999999, 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.993 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 531 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:11.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558765+0000", 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558769+0000", 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0289999999999999e-06 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558780+0000", 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1280999999999999e-05 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558787+0000", 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6830000000000002e-06 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558845+0000", 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8724999999999998e-05 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558892+0000", 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6323999999999999e-05 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559001+0000", 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109549 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559491+0000", 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049004400000000003 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561897+0000", 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024060119999999999 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561930+0000", 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3101e-05 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561955+0000", 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4433000000000001e-05 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.998 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:610 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.31548145, 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029666979999999998, 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 610 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:11.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615666+0000", 2024-04-23T19:01:12.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9800000000000001e-06 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615673+0000", 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0899999999999999e-06 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615690+0000", 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6512999999999999e-05 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615701+0000", 2024-04-23T19:01:12.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1600000000000001e-05 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615767+0000", 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6006999999999993e-05 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615859+0000", 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2101000000000005e-05 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615995+0000", 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013539199999999999 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617510+0000", 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015155699999999999 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618530+0000", 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010198760000000001 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618591+0000", 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0832000000000003e-05 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618631+0000", 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9737000000000003e-05 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:12.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.313912307999999, 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:01:12.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:01:12.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:01:12.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:01:12.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.312029922000001, 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.010 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:12.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:01:12.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:619 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.306665821999999, 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003212482, 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 619 2024-04-23T19:01:12.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624481+0000", 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.283e-06 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624490+0000", 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1200000000000008e-06 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624508+0000", 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7744000000000002e-05 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624519+0000", 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1676e-05 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624580+0000", 2024-04-23T19:01:12.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0081000000000003e-05 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624676+0000", 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6143000000000004e-05 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:12.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624810+0000", 2024-04-23T19:01:12.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013415500000000001 2024-04-23T19:01:12.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627085+0000", 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022750740000000002 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627633+0000", 2024-04-23T19:01:12.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054769900000000002 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627667+0000", 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4493999999999999e-05 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627692+0000", 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5012999999999999e-05 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:670 6.11 6:88f5d812:::obj_delete_at_hint.0000000036:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.025 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.265933818000001, 2024-04-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002994863, 2024-04-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.026 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 670 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1699999999999997e-07 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665218+0000", 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2719999999999997e-06 2024-04-23T19:01:12.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665229+0000", 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1206000000000001e-05 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665238+0000", 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0319999999999992e-06 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665288+0000", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665336+0000", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8717999999999997e-05 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665463+0000", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126661 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.666192+0000", 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072877100000000002 2024-04-23T19:01:12.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668127+0000", 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019353669999999999 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668168+0000", 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0731e-05 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668207+0000", 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8634000000000003e-05 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.207451616999997, 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031970200000000001, 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 715 2024-04-23T19:01:12.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723697+0000", 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3340000000000002e-06 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723710+0000", 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2326e-05 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723741+0000", 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1619999999999999e-05 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723756+0000", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5037e-05 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723982+0000", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022630099999999999 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724208+0000", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000225718 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724557+0000", 2024-04-23T19:01:12.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034893499999999998 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.725862+0000", 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013045330000000001 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726736+0000", 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087459699999999996 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726825+0000", 2024-04-23T19:01:12.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8756000000000002e-05 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726891+0000", 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5863000000000003e-05 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.011548728000001, 2024-04-23T19:01:12.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033211249999999999, 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 802 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919599+0000", 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6070000000000002e-06 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919611+0000", 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1787000000000001e-05 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919641+0000", 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919656+0000", 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5293000000000001e-05 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919816+0000", 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015938500000000001 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920174+0000", 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035894399999999998 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920773+0000", 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059836899999999996 2024-04-23T19:01:12.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922133+0000", 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001360567 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922709+0000", 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057605500000000001 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922807+0000", 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942999999999994e-05 2024-04-23T19:01:12.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922918+0000", 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110479 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.900405675999998, 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030767070000000001, 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 850 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030742+0000", 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030754+0000", 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1790000000000001e-05 2024-04-23T19:01:12.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030784+0000", 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9836e-05 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030799+0000", 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030912+0000", 2024-04-23T19:01:12.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011252900000000001 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031130+0000", 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000218278 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031461+0000", 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033099799999999999 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.032550+0000", 2024-04-23T19:01:12.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001088912 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033656+0000", 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001105918 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033744+0000", 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7746999999999999e-05 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033817+0000", 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2972000000000005e-05 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.815196153000002, 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030923309999999998, 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 886 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:12.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115952+0000", 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.317e-06 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115964+0000", 2024-04-23T19:01:12.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1863e-05 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115993+0000", 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9779999999999999e-05 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116009+0000", 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5344000000000001e-05 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116117+0000", 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107932 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116333+0000", 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021693099999999999 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116674+0000", 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034013199999999999 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.117997+0000", 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001323133 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118755+0000", 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075835799999999999 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118922+0000", 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166668 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.119042+0000", 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119873 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.788295048000002, 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029548479999999999, 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.056 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 898 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142853+0000", 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2299999999999998e-06 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142863+0000", 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0662999999999999e-05 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142893+0000", 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9980000000000001e-05 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142912+0000", 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8960000000000001e-05 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143042+0000", 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013009600000000001 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143248+0000", 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000205718 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143554+0000", 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030609499999999999 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.144613+0000", 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010588220000000001 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145528+0000", 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091486599999999996 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145689+0000", 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016123900000000001 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145805+0000", 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116179 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.784292761000003, 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032876289999999998, 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:12.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 900 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:12.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146855+0000", 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.903e-06 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146864+0000", 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146886+0000", 2024-04-23T19:01:12.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2192999999999999e-05 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146898+0000", 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1497e-05 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147077+0000", 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179412 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147294+0000", 2024-04-23T19:01:12.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021702200000000001 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147780+0000", 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048607000000000001 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.148981+0000", 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012006670000000001 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.149988+0000", 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001007099 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150074+0000", 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5673000000000005e-05 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150140+0000", 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6833000000000002e-05 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:12.068 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:12.068 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:12.069 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:12.070 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:12.070+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:12.170 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:12.172+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:12.202 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:12.202 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:12.202 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:12.203 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:12.216 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:12.270 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:12.272+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:12.335 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:12.349 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:12.394 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:12.394+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:12.471 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:12.472+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.187829764999996, 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013567132000000001, 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.476 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "reached pg", 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 43 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287246+0000", 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287264+0000", 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8057e-05 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287308+0000", 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4305999999999999e-05 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287339+0000", 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0586000000000002e-05 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287542+0000", 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020379600000000001 2024-04-23T19:01:12.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287561+0000", 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8933e-05 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290847+0000", 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032856209999999999 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290866+0000", 2024-04-23T19:01:12.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9176000000000001e-05 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300494+0000", 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096278960000000004 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300809+0000", 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031514800000000001 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.150390301999998, 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00551514, 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324683+0000", 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9e-06 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324699+0000", 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324728+0000", 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9119999999999999e-05 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324750+0000", 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2512999999999999e-05 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324873+0000", 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012215500000000001 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324917+0000", 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4539999999999997e-05 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330069+0000", 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051520569999999998 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330197+0000", 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012738199999999999 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.485 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.141688529, 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003186178, 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:12.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333385+0000", 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8360000000000001e-06 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333402+0000", 2024-04-23T19:01:12.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6497000000000001e-05 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333432+0000", 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0052999999999998e-05 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333452+0000", 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0407e-05 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333590+0000", 2024-04-23T19:01:12.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138338 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333649+0000", 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8282999999999997e-05 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336446+0000", 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027977950000000001 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336569+0000", 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012296900000000001 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.133149742000001, 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011915968000000001, 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.490 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 211 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:12.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341926+0000", 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1099999999999996e-06 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341945+0000", 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9000000000000001e-05 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341993+0000", 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7503000000000002e-05 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342018+0000", 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5593e-05 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342181+0000", 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016242599999999999 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:12.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342191+0000", 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.078e-05 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.349751+0000", 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075600240000000003 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350006+0000", 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025478499999999999 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:12.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350549+0000", 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054278300000000002 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353220+0000", 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026713230000000002 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353616+0000", 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525699999999999 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353719+0000", 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102935 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353838+0000", 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119449 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:12.496 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.048294087000002, 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003042117, 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 232 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426780+0000", 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7539999999999998e-06 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426795+0000", 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426828+0000", 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2505999999999997e-05 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426844+0000", 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6350000000000001e-05 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426976+0000", 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013226899999999999 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427210+0000", 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233995 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427628+0000", 2024-04-23T19:01:12.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041769300000000001 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.428890+0000", 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012622410000000001 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429617+0000", 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00072667999999999995 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429702+0000", 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4932999999999995e-05 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429820+0000", 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118106 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:282 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'1, mlcod=0'0)", 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:12.502 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.022160237999998, 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044810049999999997, 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:12.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452913+0000", 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.61e-06 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452928+0000", 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4725999999999999e-05 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452961+0000", 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2987000000000001e-05 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452980+0000", 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9130000000000001e-05 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453231+0000", 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025115800000000002 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453282+0000", 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0399999999999999e-05 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457272+0000", 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039908950000000004 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457393+0000", 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120099 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.506 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:381 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.004007758999997, 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031594100000000001, 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 381 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.507 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471067+0000", 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7769999999999998e-06 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471080+0000", 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3723000000000001e-05 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471120+0000", 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9644000000000002e-05 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471159+0000", 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9199000000000002e-05 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471290+0000", 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013020600000000001 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471498+0000", 2024-04-23T19:01:12.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020810199999999999 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471858+0000", 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036045000000000001 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.472782+0000", 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00092351 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474065+0000", 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012835430000000001 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474154+0000", 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8752999999999995e-05 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474223+0000", 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9503000000000002e-05 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.512 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:436 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.975518741999998, 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044919260000000003, 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 436 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.513 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499555+0000", 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3070000000000001e-06 2024-04-23T19:01:12.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499568+0000", 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2493e-05 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499602+0000", 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4146999999999997e-05 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499616+0000", 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4523e-05 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499751+0000", 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013462200000000001 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499929+0000", 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177982 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.500410+0000", 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00048108299999999999 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.501598+0000", 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011874069999999999 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503787+0000", 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021889470000000001 2024-04-23T19:01:12.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503944+0000", 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157276 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.504045+0000", 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101139 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:448 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.967316398000001, 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030702529999999998, 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.519 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 448 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507757+0000", 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0099999999999998e-06 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507768+0000", 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0285999999999999e-05 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507805+0000", 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7307e-05 2024-04-23T19:01:12.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507842+0000", 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6915999999999997e-05 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507949+0000", 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107116 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508108+0000", 2024-04-23T19:01:12.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000158839 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508535+0000", 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042690000000000002 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.509707+0000", 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011724789999999999 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510553+0000", 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00084599899999999995 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510716+0000", 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016286499999999999 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510826+0000", 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109536 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.929904196999999, 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072361279999999997, 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 513 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.525 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545170+0000", 2024-04-23T19:01:12.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3120000000000001e-06 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545182+0000", 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2411e-05 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545214+0000", 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2217e-05 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545231+0000", 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6773999999999999e-05 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545374+0000", 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014263700000000001 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545518+0000", 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014400900000000001 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:12.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545965+0000", 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044757100000000001 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549086+0000", 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031200540000000001 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552249+0000", 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031637530000000001 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552336+0000", 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6953000000000006e-05 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552404+0000", 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7436999999999998e-05 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.530 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.767454628000003, 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003222716, 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 709 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707620+0000", 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707633+0000", 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.314e-05 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707664+0000", 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1040000000000001e-05 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707678+0000", 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.464e-05 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707831+0000", 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015302600000000001 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708162+0000", 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033048300000000001 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708653+0000", 2024-04-23T19:01:12.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049063600000000002 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710243+0000", 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001590082 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710645+0000", 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040251000000000002 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710729+0000", 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4336e-05 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710840+0000", 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110383 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:12.536 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.726348508000001, 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029940230000000002, 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 727 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748725+0000", 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.75e-06 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748736+0000", 2024-04-23T19:01:12.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1303e-05 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748757+0000", 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0347e-05 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748769+0000", 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2585999999999999e-05 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748873+0000", 2024-04-23T19:01:12.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103899 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749110+0000", 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023694800000000001 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749432+0000", 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032160799999999997 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.750634+0000", 2024-04-23T19:01:12.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001202231 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751548+0000", 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091438000000000001 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751642+0000", 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3468999999999996e-05 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751717+0000", 2024-04-23T19:01:12.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5501999999999996e-05 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.376197640000001, 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032013279999999998, 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.542 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 880 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098877+0000", 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9830000000000001e-06 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098888+0000", 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1306e-05 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098919+0000", 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0513000000000001e-05 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098934+0000", 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4823e-05 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099074+0000", 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013983600000000001 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099308+0000", 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234062 2024-04-23T19:01:12.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099637+0000", 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032965099999999998 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.100666+0000", 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010285680000000001 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.101917+0000", 2024-04-23T19:01:12.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012506939999999999 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102006+0000", 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9382999999999994e-05 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102075+0000", 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9509000000000001e-05 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.371806577999998, 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029265570000000002, 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 882 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103267+0000", 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.26e-06 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103279+0000", 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1384e-05 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103309+0000", 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0652999999999999e-05 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103324+0000", 2024-04-23T19:01:12.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4346e-05 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103420+0000", 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103538+0000", 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118609 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103801+0000", 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026304399999999998 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.104974+0000", 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001172761 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.105999+0000", 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010254719999999999 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106087+0000", 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7968999999999998e-05 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106192+0000", 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104279 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.553 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.368643495999997, 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034247909999999999, 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.554 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 883 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106430+0000", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7099999999999999e-06 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106440+0000", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8800000000000003e-06 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106462+0000", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2342999999999999e-05 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106474+0000", 2024-04-23T19:01:12.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.181e-05 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106622+0000", 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014796899999999999 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106999+0000", 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037749700000000002 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.107574+0000", 2024-04-23T19:01:12.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00057426199999999997 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109014+0000", 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001439989 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109686+0000", 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00067183200000000003 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109779+0000", 2024-04-23T19:01:12.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3156000000000001e-05 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109853+0000", 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4343000000000003e-05 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.364215543, 2024-04-23T19:01:12.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003034063, 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 885 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110858+0000", 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.863e-06 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110870+0000", 2024-04-23T19:01:12.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2150000000000001e-05 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110901+0000", 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1163e-05 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110916+0000", 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4724e-05 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111036+0000", 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120209 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111161+0000", 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000125012 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111421+0000", 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025950799999999998 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.112475+0000", 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010545120000000001 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113627+0000", 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001151841 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113780+0000", 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153296 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113890+0000", 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010978499999999999 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.299309518000001, 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029383579999999999, 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.565 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 913 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175764+0000", 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2340000000000001e-06 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175776+0000", 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1776e-05 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175807+0000", 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999998e-05 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175821+0000", 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175937+0000", 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115543 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176166+0000", 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022886099999999999 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176486+0000", 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031968799999999999 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.177674+0000", 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011888770000000001 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178510+0000", 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00083547700000000005 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178599+0000", 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9445999999999997e-05 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178701+0000", 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101266 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.570 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.270495783000001, 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003226638, 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 925 2024-04-23T19:01:12.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204578+0000", 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.187e-06 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204592+0000", 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3645999999999999e-05 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204622+0000", 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0642999999999998e-05 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204637+0000", 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4780000000000001e-05 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204816+0000", 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000178975 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205038+0000", 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221745 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205375+0000", 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033716799999999999 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.206493+0000", 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011176980000000001 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207654+0000", 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001161668 2024-04-23T19:01:12.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207741+0000", 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6312999999999998e-05 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207803+0000", 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1815000000000004e-05 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.576 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.266127935999997, 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00291888, 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 927 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208946+0000", 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.753e-06 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208955+0000", 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7799999999999995e-06 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208986+0000", 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0976000000000003e-05 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209001+0000", 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.45e-05 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209200+0000", 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019944900000000001 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209348+0000", 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014803799999999999 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209624+0000", 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027591099999999999 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.210737+0000", 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001112352 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211714+0000", 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00097736900000000007 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211801+0000", 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7002999999999994e-05 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211863+0000", 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1748999999999994e-05 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.262845659, 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002883722, 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:12.582 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 928 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:12.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212228+0000", 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1500000000000002e-06 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212239+0000", 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0477e-05 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212269+0000", 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0522999999999999e-05 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212284+0000", 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212462+0000", 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017774800000000001 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212686+0000", 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022414900000000001 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212983+0000", 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029747699999999998 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214294+0000", 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001310507 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214953+0000", 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065902500000000004 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215046+0000", 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3319000000000006e-05 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215110+0000", 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3536999999999998e-05 2024-04-23T19:01:12.587 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.588 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.588 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.588 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:12.588 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:12.588 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:12.589 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:12.590 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:12.592+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:12.690 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:12.690+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:12.759 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:12.759 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:12.759 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:12.759 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:12.773 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:12.812 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:12.818 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:12.818+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:12.892 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:12.892+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:12.942 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:12.943 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:12.947 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:12.947 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:12.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:12.963 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:12.963 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:12.980 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:12.980 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:12.992 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:12.996+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:12.996 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:12.996 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:13.014 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:13.014 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:13.033 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:13.034 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:13.051 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:13.051 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:13.070 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:13.071 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:13.080 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:13.081 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:13.095 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:13.132 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:13.136+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:13.194 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:13.196+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:13.203 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:01:13.213 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:13.214 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:13.227 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:13.296 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:13.294+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:13.354 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:13.354 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:13.369 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:13.410 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:13.410+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:13.497 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:13.494+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:13.532 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:13.532 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:13.546 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:13.598 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:13.600+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:13.700 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:13.704+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:13.708 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:13.708 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:13.722 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:13.801 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:13.798+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:13.845 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:13.845 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:13.859 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:13.902 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:13.902+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:14.003 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:14.002+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:14.023 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:14.023 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:14.038 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:14.104 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:14.108+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:14.146 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:14.147 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:14.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:14.190 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:01:14.216 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:14.216+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:14.305 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:14.308+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:14.328 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:14.328 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:14.341 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:14.406 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:14.406+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:14.492 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:14.492 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:14.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:14.507 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:14.506+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:14.608 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:14.608+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:14.626 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:14.626 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:14.639 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:14.724 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:14.728+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:14.787 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:14.787 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:14.800 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:14.809 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:14.806+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:14.910 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:14.912+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:15.010 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:15.010+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:15.011 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:15.011 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:15.029 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:15.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:15.111 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:15.110+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:15.212 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:15.210+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:15.242 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:15.242 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:15.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:15.311 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:15.312 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:15.312 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:15.316+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:15.341 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:15.341 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:15.372 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:15.373 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:15.390 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:15.390 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:15.401 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:15.401 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:15.401 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:15.413 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:15.414+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:15.419 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:15.423 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:15.423 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:15.443 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:15.463 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:15.463 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:15.483 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:15.483 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:15.515 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:15.514+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.204428708000002, 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003841957, 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.551 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 52 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347426+0000", 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347429+0000", 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6850000000000001e-06 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347439+0000", 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0611999999999999e-05 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347466+0000", 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6465000000000002e-05 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347487+0000", 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1032000000000001e-05 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347670+0000", 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183432 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.347946+0000", 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000276073 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.348170+0000", 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022377900000000001 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.350534+0000", 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023637329999999998 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351082+0000", 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000548256 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351167+0000", 2024-04-23T19:01:15.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4788000000000002e-05 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.351268+0000", 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101102 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:57 7.3 e29/28 7:c609908c:::notify.5:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.194753687999999, 2024-04-23T19:01:15.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037361299999999998, 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357101+0000", 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357103+0000", 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.592e-06 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357116+0000", 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3799e-05 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357148+0000", 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:15.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357165+0000", 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6375000000000002e-05 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357290+0000", 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012489700000000001 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357330+0000", 2024-04-23T19:01:15.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0151000000000002e-05 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360721+0000", 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033914349999999999 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360837+0000", 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011590399999999999 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.194431647000002, 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037999269999999998, 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357423+0000", 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357424+0000", 2024-04-23T19:01:15.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.145e-06 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357432+0000", 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0320000000000003e-06 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357448+0000", 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5942000000000001e-05 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357458+0000", 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7000000000000003e-06 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357576+0000", 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117897 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357632+0000", 2024-04-23T19:01:15.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6650999999999997e-05 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361148+0000", 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035151399999999999 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361223+0000", 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5420000000000006e-05 2024-04-23T19:01:15.566 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.109871052000003, 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033897950000000001, 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.567 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 236 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441984+0000", 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.441987+0000", 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3100000000000001e-06 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442002+0000", 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4806e-05 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442033+0000", 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999997e-05 2024-04-23T19:01:15.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442050+0000", 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442173+0000", 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012248599999999999 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442393+0000", 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000220292 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.442840+0000", 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044673299999999999 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.444723+0000", 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018828530000000001 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445094+0000", 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037100000000000002 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445257+0000", 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016315200000000001 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.445373+0000", 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011658300000000001 2024-04-23T19:01:15.572 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:282 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.097626853999998, 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052288359999999997, 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 282 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454228+0000", 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454229+0000", 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2929999999999999e-06 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454237+0000", 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5170000000000002e-06 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454252+0000", 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5824e-05 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454262+0000", 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3770000000000002e-06 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454323+0000", 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0764999999999998e-05 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454416+0000", 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.31e-05 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.454561+0000", 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014562200000000001 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.455159+0000", 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059739799999999996 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459387+0000", 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042283750000000004 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459425+0000", 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8061e-05 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459457+0000", 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1504000000000002e-05 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:316 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.091943571000002, 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029594589999999998, 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.579 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 316 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:15.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459911+0000", 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459912+0000", 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.362e-06 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459919+0000", 2024-04-23T19:01:15.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5710000000000003e-06 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459932+0000", 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3326000000000001e-05 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459939+0000", 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6630000000000004e-06 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.459997+0000", 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7692000000000003e-05 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460050+0000", 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3705000000000002e-05 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460173+0000", 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245299999999999 2024-04-23T19:01:15.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.460773+0000", 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00060017200000000005 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462748+0000", 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001975339 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462827+0000", 2024-04-23T19:01:15.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8765999999999998e-05 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.462871+0000", 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.768276473999997, 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032149629999999999, 2024-04-23T19:01:15.585 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 742 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:15.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783578+0000", 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783581+0000", 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.943e-06 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783594+0000", 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3287e-05 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783627+0000", 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2310000000000001e-05 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783648+0000", 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1440000000000001e-05 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.783789+0000", 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014105899999999999 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784022+0000", 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000232425 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.784356+0000", 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033424699999999997 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.785611+0000", 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012548870000000001 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786506+0000", 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089535000000000005 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786672+0000", 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165799 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.786793+0000", 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121216 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.591 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.728170974999998, 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026811600000000001, 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 760 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823684+0000", 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823686+0000", 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4099999999999998e-06 2024-04-23T19:01:15.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823698+0000", 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1413000000000001e-05 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823729+0000", 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1149999999999998e-05 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823748+0000", 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9117e-05 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.823877+0000", 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128799 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824105+0000", 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022891799999999999 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.824424+0000", 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031810399999999999 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.825795+0000", 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001371597 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826212+0000", 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041680599999999998 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826296+0000", 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4259999999999996e-05 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.826365+0000", 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8585999999999997e-05 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.597 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.59869054, 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029079140000000002, 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 817 2024-04-23T19:01:15.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953164+0000", 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953167+0000", 2024-04-23T19:01:15.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1999999999999999e-06 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953180+0000", 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3013000000000001e-05 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953214+0000", 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3519999999999998e-05 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953237+0000", 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2702999999999999e-05 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953382+0000", 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014576899999999999 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953607+0000", 2024-04-23T19:01:15.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000224968 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.953933+0000", 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000325228 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955092+0000", 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001159265 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955913+0000", 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00082167299999999998 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.955999+0000", 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5625999999999996e-05 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956072+0000", 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2948999999999996e-05 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.594889459000001, 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025253509999999999, 2024-04-23T19:01:15.604 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 819 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956965+0000", 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956967+0000", 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.517e-06 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956974+0000", 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3930000000000002e-06 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.956995+0000", 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1086000000000001e-05 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957014+0000", 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8817e-05 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957131+0000", 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011739900000000001 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957261+0000", 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012972600000000001 2024-04-23T19:01:15.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.957545+0000", 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00028383400000000001 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.958589+0000", 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001044192 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959357+0000", 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00076825500000000002 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959435+0000", 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7175999999999994e-05 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.959491+0000", 2024-04-23T19:01:15.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5955999999999998e-05 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.540671406000001, 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030501270000000001, 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 841 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011183+0000", 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011186+0000", 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5670000000000002e-06 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011198+0000", 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2622999999999999e-05 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011228+0000", 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9533e-05 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011243+0000", 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011352+0000", 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108832 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011570+0000", 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021795500000000001 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.011909+0000", 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033983499999999997 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.013108+0000", 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001198897 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014087+0000", 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00097877300000000006 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014170+0000", 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2599e-05 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.014233+0000", 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3702999999999996e-05 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.536707813, 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027818489999999999, 2024-04-23T19:01:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 843 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:15.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015147+0000", 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015148+0000", 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015156+0000", 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2200000000000003e-06 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015177+0000", 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0843e-05 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015195+0000", 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.804e-05 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015298+0000", 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103136 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015423+0000", 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125439 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.015692+0000", 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026838099999999999 2024-04-23T19:01:15.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.016742+0000", 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010509060000000001 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017779+0000", 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010364490000000001 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017866+0000", 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6853000000000003e-05 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.017929+0000", 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2982000000000001e-05 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.623 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.527516554999998, 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027191060000000002, 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 847 2024-04-23T19:01:15.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024338+0000", 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024340+0000", 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024352+0000", 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1447000000000001e-05 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024383+0000", 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0855999999999997e-05 2024-04-23T19:01:15.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024404+0000", 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1100000000000001e-05 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024545+0000", 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000141089 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.024760+0000", 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000215331 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.025077+0000", 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031710100000000003 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026118+0000", 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001040256 2024-04-23T19:01:15.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026899+0000", 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00078178399999999999 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.026992+0000", 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2383e-05 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027057+0000", 2024-04-23T19:01:15.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5471999999999999e-05 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.523902505999999, 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025768179999999998, 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 849 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027952+0000", 2024-04-23T19:01:15.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027954+0000", 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5600000000000001e-06 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027962+0000", 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1769999999999998e-06 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.027983+0000", 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0743000000000001e-05 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028000+0000", 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.768e-05 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028097+0000", 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6498999999999999e-05 2024-04-23T19:01:15.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028224+0000", 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012678599999999999 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.028520+0000", 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029674500000000001 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.029539+0000", 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010187250000000001 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030393+0000", 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00085408399999999996 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030470+0000", 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6959000000000006e-05 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030529+0000", 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8860000000000002e-05 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.479586578999999, 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030724720000000001, 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.636 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 868 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072268+0000", 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072271+0000", 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.464e-06 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072283+0000", 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2952999999999999e-05 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072314+0000", 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0300000000000001e-05 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072335+0000", 2024-04-23T19:01:15.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072458+0000", 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012275900000000001 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.072697+0000", 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023888100000000001 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.073021+0000", 2024-04-23T19:01:15.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032375500000000001 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.074180+0000", 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011592110000000001 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075182+0000", 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010019300000000001 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075271+0000", 2024-04-23T19:01:15.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8784999999999998e-05 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.075341+0000", 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0013999999999997e-05 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.642 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.387626398999998, 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029175080000000001, 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 907 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164228+0000", 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164231+0000", 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164243+0000", 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2334000000000001e-05 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164275+0000", 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2089999999999999e-05 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164296+0000", 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0795999999999999e-05 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164424+0000", 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012803599999999999 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.164670+0000", 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024600499999999999 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.165018+0000", 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034744700000000002 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166184+0000", 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001165824 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.166984+0000", 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000800507 2024-04-23T19:01:15.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167073+0000", 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8620000000000002e-05 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.167146+0000", 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3069000000000001e-05 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.383773660999999, 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002745632, 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 909 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168081+0000", 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168083+0000", 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9130000000000001e-06 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168093+0000", 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0207000000000001e-05 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168124+0000", 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1003000000000001e-05 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168143+0000", 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8456000000000001e-05 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168240+0000", 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7510000000000007e-05 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168368+0000", 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012759199999999999 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.168679+0000", 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031130399999999999 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.169823+0000", 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001144122 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170629+0000", 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00080621399999999998 2024-04-23T19:01:15.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170715+0000", 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5859000000000006e-05 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.170827+0000", 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111452 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.288562292999998, 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031288459999999998, 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 949 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263292+0000", 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263295+0000", 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8169999999999999e-06 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263308+0000", 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2747e-05 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263341+0000", 2024-04-23T19:01:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2889000000000003e-05 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263357+0000", 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6107e-05 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263512+0000", 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015534500000000001 2024-04-23T19:01:15.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.263881+0000", 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036884400000000001 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.264453+0000", 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057192899999999999 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.265829+0000", 2024-04-23T19:01:15.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00137644 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266271+0000", 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00044168300000000001 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266355+0000", 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4142999999999997e-05 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.266421+0000", 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5901999999999993e-05 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.274448268999997, 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026342539999999999, 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.661 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 955 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277406+0000", 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277409+0000", 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277420+0000", 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.129e-05 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277451+0000", 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1180000000000003e-05 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277466+0000", 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4613000000000001e-05 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277577+0000", 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111036 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.277789+0000", 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000212275 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.278119+0000", 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032997400000000002 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279229+0000", 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011100610000000001 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279898+0000", 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066872899999999996 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.279976+0000", 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8382999999999998e-05 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280041+0000", 2024-04-23T19:01:15.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.270983817999998, 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002659743, 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:15.668 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 957 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280871+0000", 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280872+0000", 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5200000000000001e-06 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280880+0000", 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2799999999999998e-06 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280900+0000", 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.016e-05 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.280911+0000", 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0723000000000001e-05 2024-04-23T19:01:15.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281026+0000", 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115859 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281159+0000", 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013248900000000001 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:15.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.281427+0000", 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000268585 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.282476+0000", 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001048282 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283367+0000", 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00089120300000000003 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:15.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283463+0000", 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6052999999999997e-05 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.283531+0000", 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7589000000000006e-05 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:15.674 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:15.676 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:15.676 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:15.674+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:15.776 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:15.780+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:15.840 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:15.840 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:15.840 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:15.841 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:15.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:15.904 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:15.908+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:15.979 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:15.980+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:16.032 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:16.032 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:16.032 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:16.032 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:16.032 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:16.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:16.088 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:16.092+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:16.181 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:16.184+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:16.200 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.845671922000001, 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:01:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:01:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.845452203999997, 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:01:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:01:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:01:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.875494340000003, 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:01:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.830637590999999, 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003522248, 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 216 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371448+0000", 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999999e-06 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371466+0000", 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7462999999999999e-05 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371503+0000", 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7435999999999999e-05 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371526+0000", 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3193e-05 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371779+0000", 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025239499999999998 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372022+0000", 2024-04-23T19:01:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024375800000000001 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372438+0000", 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041598699999999999 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.373881+0000", 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014422930000000001 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374755+0000", 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087446599999999996 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374843+0000", 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8109999999999995e-05 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374967+0000", 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124003 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.790497764999998, 2024-04-23T19:01:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032104590000000001, 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 227 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411587+0000", 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6529999999999998e-06 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411599+0000", 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1742999999999999e-05 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411630+0000", 2024-04-23T19:01:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1189999999999998e-05 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411648+0000", 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7183000000000001e-05 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411772+0000", 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012416599999999999 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411988+0000", 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021672099999999999 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.412408+0000", 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041941400000000001 2024-04-23T19:01:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.413758+0000", 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00135059 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414648+0000", 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088919699999999999 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414733+0000", 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4906000000000003e-05 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414795+0000", 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2695999999999997e-05 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.783806575, 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033551169999999999, 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 229 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418278+0000", 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3970000000000001e-06 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418290+0000", 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1513e-05 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418320+0000", 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0266000000000001e-05 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418336+0000", 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5466000000000001e-05 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418454+0000", 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118056 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418670+0000", 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021618200000000001 2024-04-23T19:01:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.419080+0000", 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041013699999999998 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.420493+0000", 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001412686 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421481+0000", 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098860599999999995 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421562+0000", 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1108999999999999e-05 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421631+0000", 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8699000000000001e-05 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.776931396999998, 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00312875, 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 231 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425154+0000", 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425165+0000", 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0793e-05 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425196+0000", 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0766999999999999e-05 2024-04-23T19:01:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425210+0000", 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4836e-05 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425316+0000", 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105376 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425523+0000", 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020704499999999999 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425943+0000", 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00042057999999999999 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.427399+0000", 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001456026 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428123+0000", 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072358800000000005 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428212+0000", 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9159000000000005e-05 2024-04-23T19:01:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428280+0000", 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7799999999999995e-05 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:379 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.730542759999999, 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039986900000000001, 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 379 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471541+0000", 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0270000000000001e-06 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471546+0000", 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3959999999999997e-06 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471556+0000", 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0217999999999999e-05 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471563+0000", 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7399999999999998e-06 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471612+0000", 2024-04-23T19:01:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8761000000000003e-05 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471662+0000", 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9888000000000001e-05 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471777+0000", 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011471700000000001 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475133+0000", 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033560740000000001 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475472+0000", 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000339296 2024-04-23T19:01:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475511+0000", 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9291e-05 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475539+0000", 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7282000000000001e-05 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:531 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.643318686999997, 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031909009999999999, 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 531 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558765+0000", 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558769+0000", 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0289999999999999e-06 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558780+0000", 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1280999999999999e-05 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558787+0000", 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6830000000000002e-06 2024-04-23T19:01:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558845+0000", 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8724999999999998e-05 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558892+0000", 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6323999999999999e-05 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559001+0000", 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109549 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559491+0000", 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049004400000000003 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561897+0000", 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024060119999999999 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561930+0000", 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3101e-05 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561955+0000", 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4433000000000001e-05 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:610 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.586418569000003, 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029666979999999998, 2024-04-23T19:01:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 610 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615666+0000", 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9800000000000001e-06 2024-04-23T19:01:16.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615673+0000", 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0899999999999999e-06 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615690+0000", 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6512999999999999e-05 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615701+0000", 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1600000000000001e-05 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615767+0000", 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6006999999999993e-05 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615859+0000", 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2101000000000005e-05 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615995+0000", 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013539199999999999 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617510+0000", 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015155699999999999 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618530+0000", 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010198760000000001 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618591+0000", 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0832000000000003e-05 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618631+0000", 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9737000000000003e-05 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.584849427000002, 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.275 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:01:16.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:01:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.582967041000003, 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.282 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:619 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.577602941000002, 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003212482, 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.290 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 619 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624481+0000", 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.283e-06 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624490+0000", 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1200000000000008e-06 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624508+0000", 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7744000000000002e-05 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624519+0000", 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1676e-05 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624580+0000", 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0081000000000003e-05 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624676+0000", 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6143000000000004e-05 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624810+0000", 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013415500000000001 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627085+0000", 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022750740000000002 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627633+0000", 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054769900000000002 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627667+0000", 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4493999999999999e-05 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627692+0000", 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5012999999999999e-05 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:670 6.11 6:88f5d812:::obj_delete_at_hint.0000000036:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:16.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.536870937000003, 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002994863, 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 670 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1699999999999997e-07 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665218+0000", 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2719999999999997e-06 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665229+0000", 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1206000000000001e-05 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665238+0000", 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0319999999999992e-06 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665288+0000", 2024-04-23T19:01:16.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665336+0000", 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8717999999999997e-05 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665463+0000", 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126661 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.666192+0000", 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072877100000000002 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668127+0000", 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019353669999999999 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668168+0000", 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0731e-05 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668207+0000", 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8634000000000003e-05 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.478388735999999, 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031970200000000001, 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 715 2024-04-23T19:01:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:16.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723697+0000", 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3340000000000002e-06 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723710+0000", 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2326e-05 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723741+0000", 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1619999999999999e-05 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723756+0000", 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5037e-05 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723982+0000", 2024-04-23T19:01:16.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022630099999999999 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724208+0000", 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000225718 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724557+0000", 2024-04-23T19:01:16.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034893499999999998 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.725862+0000", 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013045330000000001 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726736+0000", 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087459699999999996 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726825+0000", 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8756000000000002e-05 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726891+0000", 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5863000000000003e-05 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.282485846999997, 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033211249999999999, 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 802 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919599+0000", 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6070000000000002e-06 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919611+0000", 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1787000000000001e-05 2024-04-23T19:01:16.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919641+0000", 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919656+0000", 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5293000000000001e-05 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919816+0000", 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015938500000000001 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920174+0000", 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035894399999999998 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920773+0000", 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059836899999999996 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922133+0000", 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001360567 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922709+0000", 2024-04-23T19:01:16.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057605500000000001 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922807+0000", 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942999999999994e-05 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922918+0000", 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110479 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.318 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.171342795000001, 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030767070000000001, 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 850 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030742+0000", 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030754+0000", 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1790000000000001e-05 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030784+0000", 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9836e-05 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030799+0000", 2024-04-23T19:01:16.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030912+0000", 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011252900000000001 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031130+0000", 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000218278 2024-04-23T19:01:16.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031461+0000", 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033099799999999999 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.032550+0000", 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001088912 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033656+0000", 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001105918 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033744+0000", 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7746999999999999e-05 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033817+0000", 2024-04-23T19:01:16.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2972000000000005e-05 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.086133271999998, 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030923309999999998, 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.326 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 886 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115952+0000", 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.317e-06 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115964+0000", 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1863e-05 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115993+0000", 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9779999999999999e-05 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116009+0000", 2024-04-23T19:01:16.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5344000000000001e-05 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116117+0000", 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107932 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116333+0000", 2024-04-23T19:01:16.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021693099999999999 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116674+0000", 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034013199999999999 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.117997+0000", 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001323133 2024-04-23T19:01:16.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118755+0000", 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075835799999999999 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118922+0000", 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166668 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.119042+0000", 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119873 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.059232166999998, 2024-04-23T19:01:16.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029548479999999999, 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 898 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142853+0000", 2024-04-23T19:01:16.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2299999999999998e-06 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142863+0000", 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0662999999999999e-05 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142893+0000", 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9980000000000001e-05 2024-04-23T19:01:16.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142912+0000", 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8960000000000001e-05 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143042+0000", 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013009600000000001 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143248+0000", 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000205718 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143554+0000", 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030609499999999999 2024-04-23T19:01:16.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.144613+0000", 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010588220000000001 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145528+0000", 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091486599999999996 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145689+0000", 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016123900000000001 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145805+0000", 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116179 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.340 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.055229879999999, 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032876289999999998, 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:16.341 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 900 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:16.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146855+0000", 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.903e-06 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146864+0000", 2024-04-23T19:01:16.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146886+0000", 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2192999999999999e-05 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146898+0000", 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1497e-05 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147077+0000", 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179412 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147294+0000", 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021702200000000001 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:16.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147780+0000", 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048607000000000001 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.148981+0000", 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012006670000000001 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.149988+0000", 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001007099 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150074+0000", 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5673000000000005e-05 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:16.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150140+0000", 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6833000000000002e-05 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:16.348 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:16.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:01:16.351 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:16.351 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:16.352+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:16.451 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:16.452+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:16.482 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:16.482 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:16.482 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:16.482 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:16.496 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:16.552 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:16.556+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:16.619 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:16.619 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:16.619 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:16.619 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:16.619 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:16.634 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:16.653 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:16.656+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:16.754 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:16.754+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.472954940000001, 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013567132000000001, 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.759 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "reached pg", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 43 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:16.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287246+0000", 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287264+0000", 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8057e-05 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287308+0000", 2024-04-23T19:01:16.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4305999999999999e-05 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287339+0000", 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0586000000000002e-05 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287542+0000", 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020379600000000001 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:16.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287561+0000", 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8933e-05 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290847+0000", 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032856209999999999 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290866+0000", 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9176000000000001e-05 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300494+0000", 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096278960000000004 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300809+0000", 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031514800000000001 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.435515477000003, 2024-04-23T19:01:16.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00551514, 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324683+0000", 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9e-06 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324699+0000", 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324728+0000", 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9119999999999999e-05 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324750+0000", 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2512999999999999e-05 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324873+0000", 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012215500000000001 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324917+0000", 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4539999999999997e-05 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330069+0000", 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051520569999999998 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330197+0000", 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012738199999999999 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:16.768 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.426813703999997, 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003186178, 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333385+0000", 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8360000000000001e-06 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333402+0000", 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6497000000000001e-05 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333432+0000", 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0052999999999998e-05 2024-04-23T19:01:16.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333452+0000", 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0407e-05 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333590+0000", 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138338 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333649+0000", 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8282999999999997e-05 2024-04-23T19:01:16.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336446+0000", 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027977950000000001 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336569+0000", 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012296900000000001 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.772 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.418274916999998, 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011915968000000001, 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 211 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341926+0000", 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1099999999999996e-06 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341945+0000", 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9000000000000001e-05 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341993+0000", 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7503000000000002e-05 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342018+0000", 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5593e-05 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342181+0000", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016242599999999999 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342191+0000", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.078e-05 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.349751+0000", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075600240000000003 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350006+0000", 2024-04-23T19:01:16.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025478499999999999 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350549+0000", 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054278300000000002 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353220+0000", 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026713230000000002 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353616+0000", 2024-04-23T19:01:16.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525699999999999 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353719+0000", 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102935 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353838+0000", 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119449 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.333419262, 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003042117, 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 232 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.779 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426780+0000", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7539999999999998e-06 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426795+0000", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426828+0000", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2505999999999997e-05 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426844+0000", 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6350000000000001e-05 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426976+0000", 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013226899999999999 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427210+0000", 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233995 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427628+0000", 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041769300000000001 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.428890+0000", 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012622410000000001 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429617+0000", 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00072667999999999995 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429702+0000", 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4932999999999995e-05 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429820+0000", 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118106 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:282 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'1, mlcod=0'0)", 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:16.784 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.307285413000002, 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044810049999999997, 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:16.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452913+0000", 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.61e-06 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452928+0000", 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4725999999999999e-05 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452961+0000", 2024-04-23T19:01:16.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2987000000000001e-05 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452980+0000", 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9130000000000001e-05 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453231+0000", 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025115800000000002 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453282+0000", 2024-04-23T19:01:16.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0399999999999999e-05 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457272+0000", 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039908950000000004 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457393+0000", 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120099 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:381 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.289132934000001, 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031594100000000001, 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 381 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471067+0000", 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7769999999999998e-06 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471080+0000", 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3723000000000001e-05 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471120+0000", 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9644000000000002e-05 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471159+0000", 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9199000000000002e-05 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471290+0000", 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013020600000000001 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471498+0000", 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020810199999999999 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471858+0000", 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036045000000000001 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.472782+0000", 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00092351 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474065+0000", 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012835430000000001 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474154+0000", 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8752999999999995e-05 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474223+0000", 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9503000000000002e-05 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:436 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.260643917000003, 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044919260000000003, 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.794 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 436 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:16.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499555+0000", 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3070000000000001e-06 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499568+0000", 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2493e-05 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499602+0000", 2024-04-23T19:01:16.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4146999999999997e-05 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499616+0000", 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4523e-05 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499751+0000", 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013462200000000001 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499929+0000", 2024-04-23T19:01:16.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177982 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.500410+0000", 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00048108299999999999 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.501598+0000", 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011874069999999999 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503787+0000", 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021889470000000001 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503944+0000", 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157276 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.504045+0000", 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101139 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.799 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:448 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.252441572999999, 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030702529999999998, 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 448 2024-04-23T19:01:16.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507757+0000", 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0099999999999998e-06 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507768+0000", 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0285999999999999e-05 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507805+0000", 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7307e-05 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507842+0000", 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6915999999999997e-05 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507949+0000", 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107116 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508108+0000", 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000158839 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:16.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508535+0000", 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042690000000000002 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.509707+0000", 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011724789999999999 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510553+0000", 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00084599899999999995 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510716+0000", 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016286499999999999 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510826+0000", 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109536 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.215029371999996, 2024-04-23T19:01:16.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072361279999999997, 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 513 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545170+0000", 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3120000000000001e-06 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545182+0000", 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2411e-05 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545214+0000", 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2217e-05 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545231+0000", 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6773999999999999e-05 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545374+0000", 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014263700000000001 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545518+0000", 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014400900000000001 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545965+0000", 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044757100000000001 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549086+0000", 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031200540000000001 2024-04-23T19:01:16.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552249+0000", 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031637530000000001 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552336+0000", 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6953000000000006e-05 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552404+0000", 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7436999999999998e-05 2024-04-23T19:01:16.810 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.052579803, 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003222716, 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.811 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 709 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707620+0000", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707633+0000", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.314e-05 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707664+0000", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1040000000000001e-05 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707678+0000", 2024-04-23T19:01:16.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.464e-05 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707831+0000", 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015302600000000001 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708162+0000", 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033048300000000001 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708653+0000", 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049063600000000002 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710243+0000", 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001590082 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710645+0000", 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040251000000000002 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710729+0000", 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4336e-05 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710840+0000", 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110383 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.011473682999998, 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029940230000000002, 2024-04-23T19:01:16.816 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 727 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748725+0000", 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.75e-06 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748736+0000", 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1303e-05 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748757+0000", 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0347e-05 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748769+0000", 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2585999999999999e-05 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748873+0000", 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103899 2024-04-23T19:01:16.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749110+0000", 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023694800000000001 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749432+0000", 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032160799999999997 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.750634+0000", 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001202231 2024-04-23T19:01:16.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751548+0000", 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091438000000000001 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751642+0000", 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3468999999999996e-05 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751717+0000", 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5501999999999996e-05 2024-04-23T19:01:16.821 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.661322814999998, 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032013279999999998, 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.822 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 880 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098877+0000", 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9830000000000001e-06 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098888+0000", 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1306e-05 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098919+0000", 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0513000000000001e-05 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098934+0000", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4823e-05 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099074+0000", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013983600000000001 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099308+0000", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234062 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:16.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099637+0000", 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032965099999999998 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.100666+0000", 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010285680000000001 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.101917+0000", 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012506939999999999 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102006+0000", 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9382999999999994e-05 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102075+0000", 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9509000000000001e-05 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.827 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.656931753000002, 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029265570000000002, 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 882 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103267+0000", 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.26e-06 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103279+0000", 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1384e-05 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103309+0000", 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0652999999999999e-05 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103324+0000", 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4346e-05 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103420+0000", 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:01:16.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103538+0000", 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118609 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103801+0000", 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026304399999999998 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.104974+0000", 2024-04-23T19:01:16.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001172761 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.105999+0000", 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010254719999999999 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106087+0000", 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7968999999999998e-05 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106192+0000", 2024-04-23T19:01:16.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104279 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.653768671000002, 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034247909999999999, 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.833 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 883 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106430+0000", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7099999999999999e-06 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106440+0000", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8800000000000003e-06 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106462+0000", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2342999999999999e-05 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106474+0000", 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.181e-05 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106622+0000", 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014796899999999999 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106999+0000", 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037749700000000002 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:16.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.107574+0000", 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00057426199999999997 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109014+0000", 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001439989 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109686+0000", 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00067183200000000003 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109779+0000", 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3156000000000001e-05 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109853+0000", 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4343000000000003e-05 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.649340717999998, 2024-04-23T19:01:16.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003034063, 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 885 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110858+0000", 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.863e-06 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110870+0000", 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2150000000000001e-05 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110901+0000", 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1163e-05 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110916+0000", 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4724e-05 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111036+0000", 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120209 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111161+0000", 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000125012 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111421+0000", 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025950799999999998 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.112475+0000", 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010545120000000001 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113627+0000", 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001151841 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113780+0000", 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153296 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113890+0000", 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010978499999999999 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.843 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.584434692999999, 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029383579999999999, 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 913 2024-04-23T19:01:16.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175764+0000", 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2340000000000001e-06 2024-04-23T19:01:16.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175776+0000", 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1776e-05 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175807+0000", 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999998e-05 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175821+0000", 2024-04-23T19:01:16.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175937+0000", 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115543 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176166+0000", 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022886099999999999 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176486+0000", 2024-04-23T19:01:16.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031968799999999999 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.177674+0000", 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011888770000000001 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178510+0000", 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00083547700000000005 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178599+0000", 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9445999999999997e-05 2024-04-23T19:01:16.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178701+0000", 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101266 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.555620957999999, 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003226638, 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.849 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 925 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204578+0000", 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.187e-06 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204592+0000", 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3645999999999999e-05 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204622+0000", 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0642999999999998e-05 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204637+0000", 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4780000000000001e-05 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204816+0000", 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000178975 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205038+0000", 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221745 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205375+0000", 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033716799999999999 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.206493+0000", 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011176980000000001 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207654+0000", 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001161668 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207741+0000", 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6312999999999998e-05 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207803+0000", 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1815000000000004e-05 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.854 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.551253111000001, 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00291888, 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 927 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.855 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208946+0000", 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.753e-06 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208955+0000", 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7799999999999995e-06 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208986+0000", 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0976000000000003e-05 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209001+0000", 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.45e-05 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209200+0000", 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019944900000000001 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209348+0000", 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014803799999999999 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209624+0000", 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027591099999999999 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.210737+0000", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001112352 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211714+0000", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00097736900000000007 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211801+0000", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7002999999999994e-05 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211863+0000", 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1748999999999994e-05 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.547970833999997, 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002883722, 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:16.860 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 928 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212228+0000", 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1500000000000002e-06 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212239+0000", 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0477e-05 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212269+0000", 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0522999999999999e-05 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212284+0000", 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212462+0000", 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017774800000000001 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212686+0000", 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022414900000000001 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212983+0000", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029747699999999998 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214294+0000", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001310507 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214953+0000", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065902500000000004 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:16.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215046+0000", 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3319000000000006e-05 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215110+0000", 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3536999999999998e-05 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:16.865 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:16.867 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:16.867 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:16.868+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:16.968 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:16.966+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:17.038 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:17.038 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:17.038 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:17.038 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:17.052 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:17.069 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:17.072+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:17.170 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:17.170+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:17.220 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:17.220 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:17.220 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:17.220 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:17.220 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:17.221 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:01:17.234 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:17.282 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:17.282+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:17.371 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:17.372+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.076428391999997, 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085602839999999996, 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 48 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331687+0000", 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331702+0000", 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.486e-05 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331735+0000", 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3272999999999998e-05 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331758+0000", 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2633000000000002e-05 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331922+0000", 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164356 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332211+0000", 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028900799999999999 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332486+0000", 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275044 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.334812+0000", 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023258720000000001 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340081+0000", 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052694229999999996 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340176+0000", 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4674999999999997e-05 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340244+0000", 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7726999999999997e-05 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253696272512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.067461637999997, 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035096519999999998, 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 49 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340652+0000", 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340660+0000", 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6320000000000008e-06 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340685+0000", 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5171e-05 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340698+0000", 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2525e-05 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340814+0000", 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011663900000000001 2024-04-23T19:01:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340955+0000", 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014095899999999999 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.341217+0000", 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026212099999999998 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.342176+0000", 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095870199999999997 2024-04-23T19:01:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344001+0000", 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00182467 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344070+0000", 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9146000000000005e-05 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344160+0000", 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0038999999999996e-05 2024-04-23T19:01:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.097790957000001, 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004746737, 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 205 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310325+0000", 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6739999999999999e-06 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310342+0000", 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7062999999999999e-05 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310372+0000", 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0116000000000001e-05 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310395+0000", 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3025999999999999e-05 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310720+0000", 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000325242 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311086+0000", 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036572699999999999 2024-04-23T19:01:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311891+0000", 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080526000000000003 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.313563+0000", 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001672251 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314820+0000", 2024-04-23T19:01:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001256783 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314965+0000", 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144699 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.315068+0000", 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102896 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.024186471, 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003601885, 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 220 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383929+0000", 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3160000000000001e-06 2024-04-23T19:01:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383942+0000", 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3207000000000001e-05 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383971+0000", 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8883000000000001e-05 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384007+0000", 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6335999999999999e-05 2024-04-23T19:01:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384141+0000", 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013357899999999999 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384482+0000", 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034114099999999999 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.385195+0000", 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00071281399999999998 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.386715+0000", 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001520478 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387369+0000", 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065341900000000003 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387457+0000", 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8172999999999998e-05 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387527+0000", 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0538999999999997e-05 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.394438+0000", 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.013673470000001, 2024-04-23T19:01:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034638210000000002, 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 223 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394438+0000", 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394438+0000", 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394441+0000", 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2699999999999999e-06 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394452+0000", 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1507e-05 2024-04-23T19:01:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394483+0000", 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0463e-05 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394498+0000", 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5393e-05 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394633+0000", 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013455300000000001 2024-04-23T19:01:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.394837+0000", 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020451099999999999 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.395243+0000", 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040543399999999998 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.396607+0000", 2024-04-23T19:01:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013640799999999999 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.397758+0000", 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001151011 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.397836+0000", 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8563e-05 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.397902+0000", 2024-04-23T19:01:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6036000000000003e-05 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.006096135, 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038023179999999998, 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 225 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402018+0000", 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2469999999999998e-06 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402029+0000", 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1287000000000001e-05 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402061+0000", 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1405999999999997e-05 2024-04-23T19:01:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402075+0000", 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4593000000000001e-05 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402208+0000", 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013251300000000001 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402559+0000", 2024-04-23T19:01:17.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035087699999999998 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.403320+0000", 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076132700000000001 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.404820+0000", 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015002679999999999 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405556+0000", 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00073558499999999997 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405709+0000", 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153065 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405818+0000", 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010915 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.443 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.406087+0000", 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.002024652999999, 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033769210000000002, 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 226 2024-04-23T19:01:17.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406087+0000", 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406087+0000", 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406090+0000", 2024-04-23T19:01:17.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406101+0000", 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1569999999999999e-05 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406132+0000", 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1279000000000003e-05 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406147+0000", 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4552999999999999e-05 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406292+0000", 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014522299999999999 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406520+0000", 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022773800000000001 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.406951+0000", 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043064999999999998 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.408556+0000", 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016051349999999999 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.409307+0000", 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00075177000000000002 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.409394+0000", 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6856999999999999e-05 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.409464+0000", 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9931999999999994e-05 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.449 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:289 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.953902651, 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036979719999999999, 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 289 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454211+0000", 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.567e-06 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454222+0000", 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1323e-05 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454253+0000", 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0843000000000003e-05 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454273+0000", 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9524000000000001e-05 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454663+0000", 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039064299999999998 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454787+0000", 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123843 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455041+0000", 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025372099999999999 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.456156+0000", 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011157179999999999 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457617+0000", 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001460109 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457783+0000", 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016658499999999999 2024-04-23T19:01:17.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457907+0000", 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124096 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:344 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.945400173000003, 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040128489999999998, 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.455 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 344 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462715+0000", 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7530000000000002e-06 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462725+0000", 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0334e-05 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462750+0000", 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4646000000000001e-05 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462779+0000", 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9886000000000002e-05 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462929+0000", 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014975599999999999 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463152+0000", 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022302499999999999 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463707+0000", 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00055493600000000001 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465489+0000", 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017817460000000001 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466471+0000", 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098237600000000008 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466620+0000", 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878600000000001 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466725+0000", 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010460500000000001 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.460 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:378 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.938571602000003, 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045344950000000004, 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.461 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 378 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469543+0000", 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3800000000000001e-06 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469558+0000", 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5216e-05 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469592+0000", 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4276999999999997e-05 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469612+0000", 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9973e-05 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469788+0000", 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017606800000000001 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469994+0000", 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020596500000000001 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.470297+0000", 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000303145 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471492+0000", 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011943139999999999 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473878+0000", 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002386371 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473972+0000", 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3603000000000005e-05 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474075+0000", 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103183 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.466 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:467 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.888615008000002, 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040446919999999999, 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 467 2024-04-23T19:01:17.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519499+0000", 2024-04-23T19:01:17.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519510+0000", 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1073000000000001e-05 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519539+0000", 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.885e-05 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519553+0000", 2024-04-23T19:01:17.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4073000000000001e-05 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519679+0000", 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012514500000000001 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519800+0000", 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121048 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520138+0000", 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033848299999999999 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.521245+0000", 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011068479999999999 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523318+0000", 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020726669999999998 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523451+0000", 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013325300000000001 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523542+0000", 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0811999999999997e-05 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:512 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:17.472 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.863410623, 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046289160000000003, 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 512 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544703+0000", 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544714+0000", 2024-04-23T19:01:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1036000000000001e-05 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544743+0000", 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9096000000000001e-05 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544764+0000", 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0273999999999999e-05 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544903+0000", 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139147 2024-04-23T19:01:17.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545058+0000", 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015533499999999999 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545435+0000", 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037699499999999998 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546776+0000", 2024-04-23T19:01:17.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013404840000000001 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549119+0000", 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002342939 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549255+0000", 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013645399999999999 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549330+0000", 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5181999999999999e-05 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.478 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:513 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'5, mlcod=32'3)", 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.861958432000002, 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005799584, 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546155+0000", 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.815e-06 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546169+0000", 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3691e-05 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546201+0000", 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546221+0000", 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0462000000000002e-05 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546368+0000", 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014708500000000001 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546409+0000", 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0970000000000002e-05 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551835+0000", 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054259850000000004 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551953+0000", 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117716 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.482 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:518 6.1c e32/26 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 32'4, mlcod=32'2)", 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.551111+0000", 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.857000864, 2024-04-23T19:01:17.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003384822, 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551111+0000", 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551111+0000", 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551113+0000", 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8139999999999999e-06 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551127+0000", 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4042999999999999e-05 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551163+0000", 2024-04-23T19:01:17.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6451e-05 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551182+0000", 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8189000000000002e-05 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551301+0000", 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011920400000000001 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551355+0000", 2024-04-23T19:01:17.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3792999999999998e-05 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.554416+0000", 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030610979999999999 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.554496+0000", 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0229999999999996e-05 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:648 6.d 6:b72b1478:::obj_delete_at_hint.0000000033:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.762381255000001, 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038820410000000001, 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 648 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645733+0000", 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.03e-06 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645743+0000", 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0433e-05 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645773+0000", 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0153000000000001e-05 2024-04-23T19:01:17.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645794+0000", 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0747e-05 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645886+0000", 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1908000000000002e-05 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.646006+0000", 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119591 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.646227+0000", 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221258 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.647077+0000", 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00085041200000000004 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649399+0000", 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023215129999999999 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649520+0000", 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120754 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649613+0000", 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3241999999999999e-05 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.493 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.828111+0000", 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.580000779999999, 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034574100000000002, 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 763 2024-04-23T19:01:17.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828111+0000", 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828111+0000", 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828114+0000", 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.334e-06 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828125+0000", 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1643e-05 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828156+0000", 2024-04-23T19:01:17.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0769000000000003e-05 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828171+0000", 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4780000000000001e-05 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828324+0000", 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015331599999999999 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.828671+0000", 2024-04-23T19:01:17.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034657999999999998 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.829231+0000", 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00056020600000000005 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.830431+0000", 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001199908 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.831305+0000", 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00087387599999999999 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.831458+0000", 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153232 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.831569+0000", 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110766 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.499 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.835421+0000", 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.572691333000002, 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034109470000000001, 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 766 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.500 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835421+0000", 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835421+0000", 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835422+0000", 2024-04-23T19:01:17.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.863e-06 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835432+0000", 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8099999999999992e-06 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835458+0000", 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6097000000000001e-05 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835471+0000", 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3003000000000001e-05 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835601+0000", 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013000899999999999 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.835951+0000", 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034924100000000003 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.836488+0000", 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00053740899999999998 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.837695+0000", 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012071510000000001 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.838567+0000", 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00087227300000000002 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.838721+0000", 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153542 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.838832+0000", 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110549 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.505 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:795 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.899542+0000", 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.508570057999997, 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034838569999999999, 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 795 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899542+0000", 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899542+0000", 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899544+0000", 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9929999999999998e-06 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899555+0000", 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0740000000000001e-05 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899586+0000", 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1220000000000003e-05 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899600+0000", 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4474000000000001e-05 2024-04-23T19:01:17.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899728+0000", 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127205 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.899963+0000", 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023527199999999999 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.900456+0000", 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049270200000000003 2024-04-23T19:01:17.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.901831+0000", 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013756930000000001 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.902749+0000", 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091810999999999998 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.902904+0000", 2024-04-23T19:01:17.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015485499999999999 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.903026+0000", 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121593 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.083480+0000", 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.324632217000001, 2024-04-23T19:01:17.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003390241, 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 874 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083480+0000", 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083480+0000", 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083482+0000", 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2730000000000001e-06 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083493+0000", 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1440000000000001e-05 2024-04-23T19:01:17.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083524+0000", 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0713000000000002e-05 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083539+0000", 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4436e-05 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.083700+0000", 2024-04-23T19:01:17.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016169900000000001 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.084065+0000", 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036495100000000002 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.084608+0000", 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054302599999999995 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.085882+0000", 2024-04-23T19:01:17.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012736729999999999 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.086602+0000", 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00072053500000000001 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.086753+0000", 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015089899999999999 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.086870+0000", 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011659600000000001 2024-04-23T19:01:17.516 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.161685728000002, 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035628050000000001, 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:17.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 943 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246428+0000", 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2460000000000002e-06 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246440+0000", 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1226999999999999e-05 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246470+0000", 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0695999999999999e-05 2024-04-23T19:01:17.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246491+0000", 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.048e-05 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246632+0000", 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141345 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246974+0000", 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034169799999999998 2024-04-23T19:01:17.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.247552+0000", 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000578375 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.248830+0000", 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00127765 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249718+0000", 2024-04-23T19:01:17.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00088796000000000003 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249870+0000", 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015214199999999999 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249989+0000", 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118986 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:17.522 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:17.523 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:17.523 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:17.524 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:17.525 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:17.522+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:17.625 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:17.622+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:17.675 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:17.675 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:17.691 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:17.692 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:17.696 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:17.696 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:17.696 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:17.696 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:17.708 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:17.708 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:17.710 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:17.725 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:17.725 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:17.742 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:17.743 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:17.754 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:17.754+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:17.762 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:17.780 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:17.797 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:17.798 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:17.826 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:17.828+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:17.878 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:17.878 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:17.892 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:17.927 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:17.928+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:18.015 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.015 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.029 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:18.030 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:18.026+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:18.132 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:18.130+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:18.196 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.196 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.211 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:18.254 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:18.254+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:18.335 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:18.334+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:18.376 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.376 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.390 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:18.436 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:18.434+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:18.536 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:18.540+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:18.555 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.555 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.569 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:18.637 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:18.638+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:18.685 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.685 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.699 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:18.738 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:18.738+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:18.820 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.820 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.834 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:18.839 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:18.838+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:18.939 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:18.938+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:18.952 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:18.952 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:18.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:19.040 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:19.038+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr:Note: switching to '5bf3b3a9b161d70b9aa7806055bdae202e03111c'. 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T19:01:19.061 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr: git switch -c 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr:Or undo this operation with: 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr: git switch - 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr: 2024-04-23T19:01:19.062 INFO:tasks.workunit.client.0.smithi169.stderr:HEAD is now at 5bf3b3a9b16 boost/redis: Point boost_redis submodule to 1.85 tag 2024-04-23T19:01:19.066 DEBUG:teuthology.orchestra.run.smithi169:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T19:01:19.072 INFO:tasks.workunit.client.0.smithi169.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T19:01:19.074 INFO:tasks.workunit.client.0.smithi169.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T19:01:19.074 INFO:tasks.workunit.client.0.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T19:01:19.081 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:19.081 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:19.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:19.141 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:19.142+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:19.242 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:19.244+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:19.242 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:01:19.251 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:19.251 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:19.267 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:19.360 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:19.364+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:19.425 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:19.425 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:19.439 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:19.444 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:19.442+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:19.545 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:19.548+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:19.595 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:19.596 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:19.610 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:01:19.646 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:19.646+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:19.724 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:19.724 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:19.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:19.780 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:19.784+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:19.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:19.847 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:19.846+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:19.847 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:19.848 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:19.850 INFO:tasks.workunit.client.0.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T19:01:19.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:19.917 INFO:tasks.workunit.client.0.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T19:01:19.948 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:19.948+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:19.953 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:19.953 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:19.971 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:19.971 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:19.974 INFO:tasks.workunit.client.0.smithi169.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T19:01:19.976 INFO:tasks.workunit.client.0.smithi169.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T19:01:19.976 INFO:tasks.workunit.client.0.smithi169.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T19:01:19.988 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:20.009 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:20.017 INFO:tasks.workunit.client.0.smithi169.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T19:01:20.020 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:20.020 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:20.020 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:20.021 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-23T19:01:20.021 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T19:01:20.029 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:20.033 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:20.035 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-04-23T19:01:20.036 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-04-23T19:01:20.036 DEBUG:teuthology.orchestra.run.smithi169:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5bf3b3a9b161d70b9aa7806055bdae202e03111c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-04-23T19:01:20.050 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:20.050 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:20.051 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:20.052+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:20.070 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:20.071 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:20.090 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:20.091 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:20.152 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:20.156+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:20.162 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:20.162 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:20.162 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:20.162 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:20.162 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:20.175 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:20.260 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:20.264+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:20.327 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:20.327 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:20.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:20.327 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:20.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.327 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.972252576999999, 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:01:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:01:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 56.972032859000002, 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:01:20.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:01:20.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:01:20.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:20.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:20.339 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.002074995000001, 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:01:20.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.957218245999996, 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003522248, 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 216 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371445+0000", 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371448+0000", 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1439999999999999e-06 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371466+0000", 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7462999999999999e-05 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371503+0000", 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7435999999999999e-05 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371526+0000", 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3193e-05 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.371779+0000", 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025239499999999998 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372022+0000", 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024375800000000001 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.372438+0000", 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041598699999999999 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.373881+0000", 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014422930000000001 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374755+0000", 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087446599999999996 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374843+0000", 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8109999999999995e-05 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.374967+0000", 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000124003 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.350 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.917078420000003, 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032104590000000001, 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 227 2024-04-23T19:01:20.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411585+0000", 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411587+0000", 2024-04-23T19:01:20.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6529999999999998e-06 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411599+0000", 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1742999999999999e-05 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411630+0000", 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1189999999999998e-05 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411648+0000", 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7183000000000001e-05 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411772+0000", 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012416599999999999 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.411988+0000", 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021672099999999999 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.412408+0000", 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041941400000000001 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.413758+0000", 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00135059 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414648+0000", 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088919699999999999 2024-04-23T19:01:20.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414733+0000", 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4906000000000003e-05 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.414795+0000", 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2695999999999997e-05 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.910387229999998, 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033551169999999999, 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 229 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418276+0000", 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418278+0000", 2024-04-23T19:01:20.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3970000000000001e-06 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418290+0000", 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1513e-05 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418320+0000", 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0266000000000001e-05 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418336+0000", 2024-04-23T19:01:20.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5466000000000001e-05 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418454+0000", 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118056 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.418670+0000", 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021618200000000001 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.419080+0000", 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041013699999999998 2024-04-23T19:01:20.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.420493+0000", 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001412686 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421481+0000", 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00098860599999999995 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421562+0000", 2024-04-23T19:01:20.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1108999999999999e-05 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.421631+0000", 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8699000000000001e-05 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.903512051999996, 2024-04-23T19:01:20.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00312875, 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 231 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425151+0000", 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425154+0000", 2024-04-23T19:01:20.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7800000000000001e-06 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425165+0000", 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0793e-05 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425196+0000", 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0766999999999999e-05 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425210+0000", 2024-04-23T19:01:20.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4836e-05 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425316+0000", 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105376 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425523+0000", 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020704499999999999 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:20.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.425943+0000", 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00042057999999999999 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.427399+0000", 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001456026 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428123+0000", 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072358800000000005 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428212+0000", 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9159000000000005e-05 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.428280+0000", 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7799999999999995e-05 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:379 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.857123414999997, 2024-04-23T19:01:20.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039986900000000001, 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 379 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471540+0000", 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471541+0000", 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0270000000000001e-06 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471546+0000", 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3959999999999997e-06 2024-04-23T19:01:20.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471556+0000", 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0217999999999999e-05 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471563+0000", 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7399999999999998e-06 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471612+0000", 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8761000000000003e-05 2024-04-23T19:01:20.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471662+0000", 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9888000000000001e-05 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.471777+0000", 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011471700000000001 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475133+0000", 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033560740000000001 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475472+0000", 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000339296 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475511+0000", 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9291e-05 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.475539+0000", 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7282000000000001e-05 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:531 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.769899342000002, 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031909009999999999, 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.374 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 531 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558764+0000", 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558765+0000", 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558769+0000", 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0289999999999999e-06 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558780+0000", 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1280999999999999e-05 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558787+0000", 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6830000000000002e-06 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558845+0000", 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8724999999999998e-05 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.558892+0000", 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6323999999999999e-05 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559001+0000", 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109549 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.559491+0000", 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049004400000000003 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561897+0000", 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024060119999999999 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561930+0000", 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3101e-05 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.561955+0000", 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4433000000000001e-05 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.379 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:610 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.712999224000001, 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029666979999999998, 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 610 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615664+0000", 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615666+0000", 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9800000000000001e-06 2024-04-23T19:01:20.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615673+0000", 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0899999999999999e-06 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615690+0000", 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6512999999999999e-05 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615701+0000", 2024-04-23T19:01:20.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1600000000000001e-05 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615767+0000", 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6006999999999993e-05 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615859+0000", 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2101000000000005e-05 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:20.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.615995+0000", 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013539199999999999 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617510+0000", 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015155699999999999 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618530+0000", 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010198760000000001 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618591+0000", 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0832000000000003e-05 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618631+0000", 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9737000000000003e-05 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.711430082, 2024-04-23T19:01:20.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:01:20.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:01:20.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:01:20.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.709547696000001, 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.391 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:20.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:01:20.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.396 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:619 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.704183596, 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003212482, 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 619 2024-04-23T19:01:20.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624480+0000", 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624481+0000", 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.283e-06 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624490+0000", 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1200000000000008e-06 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624508+0000", 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7744000000000002e-05 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624519+0000", 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1676e-05 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624580+0000", 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0081000000000003e-05 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624676+0000", 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6143000000000004e-05 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:20.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624810+0000", 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013415500000000001 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627085+0000", 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022750740000000002 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627633+0000", 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00054769900000000002 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627667+0000", 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4493999999999999e-05 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.627692+0000", 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5012999999999999e-05 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:670 6.11 6:88f5d812:::obj_delete_at_hint.0000000036:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:20.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.663451592000001, 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002994863, 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 670 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665212+0000", 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1699999999999997e-07 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665218+0000", 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2719999999999997e-06 2024-04-23T19:01:20.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665229+0000", 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1206000000000001e-05 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665238+0000", 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0319999999999992e-06 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665288+0000", 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9654000000000003e-05 2024-04-23T19:01:20.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665336+0000", 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8717999999999997e-05 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.665463+0000", 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126661 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.666192+0000", 2024-04-23T19:01:20.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00072877100000000002 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668127+0000", 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019353669999999999 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668168+0000", 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0731e-05 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.668207+0000", 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8634000000000003e-05 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.604969390999997, 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031970200000000001, 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 715 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723694+0000", 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723697+0000", 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3340000000000002e-06 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723710+0000", 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2326e-05 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723741+0000", 2024-04-23T19:01:20.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1619999999999999e-05 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723756+0000", 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5037e-05 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.723982+0000", 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022630099999999999 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724208+0000", 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000225718 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.724557+0000", 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034893499999999998 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.725862+0000", 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013045330000000001 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726736+0000", 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00087459699999999996 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726825+0000", 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8756000000000002e-05 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.726891+0000", 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5863000000000003e-05 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.409066502000002, 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033211249999999999, 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 802 2024-04-23T19:01:20.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919597+0000", 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919599+0000", 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6070000000000002e-06 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919611+0000", 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1787000000000001e-05 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919641+0000", 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919656+0000", 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5293000000000001e-05 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.919816+0000", 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015938500000000001 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920174+0000", 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035894399999999998 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.920773+0000", 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059836899999999996 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922133+0000", 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001360567 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922709+0000", 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00057605500000000001 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922807+0000", 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942999999999994e-05 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.922918+0000", 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110479 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.419 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.297923449999999, 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030767070000000001, 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 850 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030740+0000", 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030742+0000", 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030754+0000", 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1790000000000001e-05 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030784+0000", 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9836e-05 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030799+0000", 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5469999999999999e-05 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.030912+0000", 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011252900000000001 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031130+0000", 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000218278 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.031461+0000", 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033099799999999999 2024-04-23T19:01:20.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.032550+0000", 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001088912 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033656+0000", 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001105918 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033744+0000", 2024-04-23T19:01:20.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7746999999999999e-05 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.033817+0000", 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2972000000000005e-05 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.212713927000003, 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030923309999999998, 2024-04-23T19:01:20.425 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 886 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115949+0000", 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115952+0000", 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.317e-06 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115964+0000", 2024-04-23T19:01:20.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1863e-05 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.115993+0000", 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9779999999999999e-05 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116009+0000", 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5344000000000001e-05 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116117+0000", 2024-04-23T19:01:20.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107932 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116333+0000", 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021693099999999999 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.116674+0000", 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00034013199999999999 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.117997+0000", 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001323133 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118755+0000", 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075835799999999999 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.118922+0000", 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000166668 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.119042+0000", 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119873 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.185812822000003, 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029548479999999999, 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.431 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 898 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142850+0000", 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142853+0000", 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2299999999999998e-06 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142863+0000", 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0662999999999999e-05 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142893+0000", 2024-04-23T19:01:20.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9980000000000001e-05 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.142912+0000", 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8960000000000001e-05 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143042+0000", 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013009600000000001 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143248+0000", 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000205718 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.143554+0000", 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030609499999999999 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.144613+0000", 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010588220000000001 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145528+0000", 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00091486599999999996 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145689+0000", 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016123900000000001 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.145805+0000", 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116179 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.436 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.181810534999997, 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032876289999999998, 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 900 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:20.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146853+0000", 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146855+0000", 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.903e-06 2024-04-23T19:01:20.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146864+0000", 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2599999999999994e-06 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146886+0000", 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2192999999999999e-05 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.146898+0000", 2024-04-23T19:01:20.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1497e-05 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147077+0000", 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000179412 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147294+0000", 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021702200000000001 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.147780+0000", 2024-04-23T19:01:20.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048607000000000001 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.148981+0000", 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012006670000000001 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.149988+0000", 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001007099 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150074+0000", 2024-04-23T19:01:20.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5673000000000005e-05 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:27.150140+0000", 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6833000000000002e-05 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:20.442 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:20.443 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records in 2024-04-23T19:01:20.443 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records out 2024-04-23T19:01:20.443 INFO:tasks.workunit.client.0.smithi169.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122701 s, 855 MB/s 2024-04-23T19:01:20.444 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:20.445 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:20.442+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:20.539 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_20 2024-04-23T19:01:20.544 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:20.548+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:20.578 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:20.578 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:20.579 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:20.579 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:20.593 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:20.645 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:20.642+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:20.674 INFO:tasks.workunit.client.0.smithi169.stdout:quota set for the bucket: buck_2024_03_23_19_01_20 2024-04-23T19:01:20.718 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:20.719 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:20.719 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:20.719 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:20.719 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:20.734 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:20.745 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:20.748+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:20.847 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:20.846+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:20.904 INFO:tasks.workunit.client.0.smithi169.stdout:quota enabled for the bucket: buck_2024_03_23_19_01_20 2024-04-23T19:01:20.904 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 10Mb. 2024-04-23T19:01:20.904 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:01:20.904 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:20.904 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - Test max objects passed 2024-04-23T19:01:20.904 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.626167324000001, 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013567132000000001, 2024-04-23T19:01:20.914 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "reached pg", 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 43 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287246+0000", 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287264+0000", 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8057e-05 2024-04-23T19:01:20.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287308+0000", 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4305999999999999e-05 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287339+0000", 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0586000000000002e-05 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287542+0000", 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020379600000000001 2024-04-23T19:01:20.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287561+0000", 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8933e-05 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290847+0000", 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032856209999999999 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:20.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290866+0000", 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9176000000000001e-05 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300494+0000", 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096278960000000004 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300809+0000", 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031514800000000001 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 57.588727861000002, 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00551514, 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:20.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324683+0000", 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9e-06 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324699+0000", 2024-04-23T19:01:20.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324728+0000", 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9119999999999999e-05 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324750+0000", 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2512999999999999e-05 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324873+0000", 2024-04-23T19:01:20.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012215500000000001 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324917+0000", 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4539999999999997e-05 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330069+0000", 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051520569999999998 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330197+0000", 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012738199999999999 2024-04-23T19:01:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 57.580026087999997, 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003186178, 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333383+0000", 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333385+0000", 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8360000000000001e-06 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333402+0000", 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6497000000000001e-05 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333432+0000", 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0052999999999998e-05 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333452+0000", 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0407e-05 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333590+0000", 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138338 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333649+0000", 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8282999999999997e-05 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336446+0000", 2024-04-23T19:01:20.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027977950000000001 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336569+0000", 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012296900000000001 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.571487300999998, 2024-04-23T19:01:20.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011915968000000001, 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 211 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341926+0000", 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1099999999999996e-06 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341945+0000", 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9000000000000001e-05 2024-04-23T19:01:20.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341993+0000", 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7503000000000002e-05 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342018+0000", 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5593e-05 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342181+0000", 2024-04-23T19:01:20.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016242599999999999 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342191+0000", 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.078e-05 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.349751+0000", 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075600240000000003 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350006+0000", 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025478499999999999 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350549+0000", 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054278300000000002 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353220+0000", 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026713230000000002 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353616+0000", 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525699999999999 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353719+0000", 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102935 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353838+0000", 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119449 2024-04-23T19:01:20.934 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.486631645999999, 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003042117, 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.935 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 232 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426778+0000", 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426780+0000", 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7539999999999998e-06 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426795+0000", 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426828+0000", 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2505999999999997e-05 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426844+0000", 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6350000000000001e-05 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.426976+0000", 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013226899999999999 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427210+0000", 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233995 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:20.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.427628+0000", 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041769300000000001 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.428890+0000", 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012622410000000001 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429617+0000", 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00072667999999999995 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429702+0000", 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4932999999999995e-05 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.429820+0000", 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118106 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:282 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'1, mlcod=0'0)", 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.460497797000002, 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044810049999999997, 2024-04-23T19:01:20.940 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452913+0000", 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.61e-06 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452928+0000", 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4725999999999999e-05 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452961+0000", 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2987000000000001e-05 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452980+0000", 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9130000000000001e-05 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453231+0000", 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025115800000000002 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453282+0000", 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0399999999999999e-05 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457272+0000", 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039908950000000004 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457393+0000", 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120099 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:381 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:20.944 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.442345318000001, 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031594100000000001, 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 381 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471064+0000", 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471067+0000", 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7769999999999998e-06 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471080+0000", 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3723000000000001e-05 2024-04-23T19:01:20.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471120+0000", 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9644000000000002e-05 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471159+0000", 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9199000000000002e-05 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471290+0000", 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013020600000000001 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471498+0000", 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020810199999999999 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471858+0000", 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036045000000000001 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.472782+0000", 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00092351 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474065+0000", 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012835430000000001 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474154+0000", 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8752999999999995e-05 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474223+0000", 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9503000000000002e-05 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.949 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:436 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.413856301000003, 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044919260000000003, 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 436 2024-04-23T19:01:20.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:20.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499555+0000", 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3070000000000001e-06 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499568+0000", 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2493e-05 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499602+0000", 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4146999999999997e-05 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499616+0000", 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4523e-05 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499751+0000", 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013462200000000001 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499929+0000", 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177982 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.500410+0000", 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00048108299999999999 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.501598+0000", 2024-04-23T19:01:20.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011874069999999999 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503787+0000", 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021889470000000001 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503944+0000", 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157276 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.504045+0000", 2024-04-23T19:01:20.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101139 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:448 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.405653956999998, 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030702529999999998, 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.956 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 448 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507755+0000", 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507757+0000", 2024-04-23T19:01:20.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0099999999999998e-06 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507768+0000", 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0285999999999999e-05 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507805+0000", 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7307e-05 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507842+0000", 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6915999999999997e-05 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.507949+0000", 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107116 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508108+0000", 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000158839 2024-04-23T19:01:20.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.508535+0000", 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042690000000000002 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.509707+0000", 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011724789999999999 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510553+0000", 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00084599899999999995 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510716+0000", 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016286499999999999 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.510826+0000", 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109536 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.961 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.368241756000003, 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072361279999999997, 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.962 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 513 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545170+0000", 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3120000000000001e-06 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545182+0000", 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2411e-05 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545214+0000", 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2217e-05 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545231+0000", 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6773999999999999e-05 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545374+0000", 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014263700000000001 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545518+0000", 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014400900000000001 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545965+0000", 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044757100000000001 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549086+0000", 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031200540000000001 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552249+0000", 2024-04-23T19:01:20.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031637530000000001 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552336+0000", 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6953000000000006e-05 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552404+0000", 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7436999999999998e-05 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.205792187, 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003222716, 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 709 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.968 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707617+0000", 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707620+0000", 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:20.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707633+0000", 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.314e-05 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707664+0000", 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1040000000000001e-05 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707678+0000", 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.464e-05 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.707831+0000", 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015302600000000001 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708162+0000", 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033048300000000001 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.708653+0000", 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049063600000000002 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710243+0000", 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001590082 2024-04-23T19:01:20.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710645+0000", 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040251000000000002 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710729+0000", 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4336e-05 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.710840+0000", 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110383 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.164686066999998, 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029940230000000002, 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.974 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 727 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748723+0000", 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748725+0000", 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.75e-06 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748736+0000", 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1303e-05 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748757+0000", 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0347e-05 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748769+0000", 2024-04-23T19:01:20.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2585999999999999e-05 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.748873+0000", 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103899 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749110+0000", 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023694800000000001 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.749432+0000", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032160799999999997 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.750634+0000", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001202231 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751548+0000", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091438000000000001 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751642+0000", 2024-04-23T19:01:20.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3468999999999996e-05 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.751717+0000", 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5501999999999996e-05 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.814535198999998, 2024-04-23T19:01:20.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032013279999999998, 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 880 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098874+0000", 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098877+0000", 2024-04-23T19:01:20.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9830000000000001e-06 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098888+0000", 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1306e-05 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098919+0000", 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0513000000000001e-05 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.098934+0000", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4823e-05 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099074+0000", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013983600000000001 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099308+0000", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234062 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:20.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.099637+0000", 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032965099999999998 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.100666+0000", 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010285680000000001 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.101917+0000", 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012506939999999999 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102006+0000", 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9382999999999994e-05 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.102075+0000", 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9509000000000001e-05 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.986 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.810144137000002, 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029265570000000002, 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 882 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.987 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103265+0000", 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103267+0000", 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.26e-06 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103279+0000", 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1384e-05 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103309+0000", 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0652999999999999e-05 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103324+0000", 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4346e-05 2024-04-23T19:01:20.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103420+0000", 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103538+0000", 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118609 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:20.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.103801+0000", 2024-04-23T19:01:20.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026304399999999998 2024-04-23T19:01:20.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.104974+0000", 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001172761 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.105999+0000", 2024-04-23T19:01:20.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010254719999999999 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106087+0000", 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7968999999999998e-05 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106192+0000", 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104279 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.995 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.806981055000001, 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034247909999999999, 2024-04-23T19:01:20.996 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 883 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:20.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106428+0000", 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106430+0000", 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7099999999999999e-06 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106440+0000", 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8800000000000003e-06 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106462+0000", 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2342999999999999e-05 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:20.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106474+0000", 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.181e-05 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106622+0000", 2024-04-23T19:01:21.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014796899999999999 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.106999+0000", 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037749700000000002 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:21.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.107574+0000", 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00057426199999999997 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109014+0000", 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001439989 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109686+0000", 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00067183200000000003 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109779+0000", 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3156000000000001e-05 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.109853+0000", 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4343000000000003e-05 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.003 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.802553101999997, 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003034063, 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 885 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110856+0000", 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110858+0000", 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.863e-06 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110870+0000", 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2150000000000001e-05 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110901+0000", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1163e-05 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.110916+0000", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4724e-05 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111036+0000", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120209 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111161+0000", 2024-04-23T19:01:21.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000125012 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.111421+0000", 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025950799999999998 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.112475+0000", 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010545120000000001 2024-04-23T19:01:21.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113627+0000", 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001151841 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113780+0000", 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153296 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.113890+0000", 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010978499999999999 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.010 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.737647076999998, 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029383579999999999, 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 913 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175762+0000", 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175764+0000", 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2340000000000001e-06 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175776+0000", 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1776e-05 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175807+0000", 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999998e-05 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175821+0000", 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4589999999999999e-05 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.175937+0000", 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115543 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176166+0000", 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022886099999999999 2024-04-23T19:01:21.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.176486+0000", 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031968799999999999 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.177674+0000", 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011888770000000001 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178510+0000", 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00083547700000000005 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178599+0000", 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9445999999999997e-05 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.178701+0000", 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101266 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.708833341999998, 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003226638, 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.017 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 925 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204576+0000", 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204578+0000", 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.187e-06 2024-04-23T19:01:21.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204592+0000", 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3645999999999999e-05 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204622+0000", 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0642999999999998e-05 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204637+0000", 2024-04-23T19:01:21.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4780000000000001e-05 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.204816+0000", 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000178975 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205038+0000", 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221745 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.205375+0000", 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033716799999999999 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.206493+0000", 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011176980000000001 2024-04-23T19:01:21.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207654+0000", 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001161668 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207741+0000", 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6312999999999998e-05 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.207803+0000", 2024-04-23T19:01:21.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1815000000000004e-05 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.704465495000001, 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00291888, 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 927 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208944+0000", 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208946+0000", 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.753e-06 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208955+0000", 2024-04-23T19:01:21.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7799999999999995e-06 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.208986+0000", 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0976000000000003e-05 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209001+0000", 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.45e-05 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209200+0000", 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019944900000000001 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209348+0000", 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014803799999999999 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.209624+0000", 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027591099999999999 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.210737+0000", 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001112352 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211714+0000", 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00097736900000000007 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211801+0000", 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7002999999999994e-05 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.211863+0000", 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1748999999999994e-05 2024-04-23T19:01:21.030 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.701183217999997, 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002883722, 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 928 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212226+0000", 2024-04-23T19:01:21.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212228+0000", 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1500000000000002e-06 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212239+0000", 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0477e-05 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212269+0000", 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0522999999999999e-05 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212284+0000", 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4810000000000001e-05 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212462+0000", 2024-04-23T19:01:21.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017774800000000001 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212686+0000", 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022414900000000001 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.212983+0000", 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029747699999999998 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214294+0000", 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001310507 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.214953+0000", 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065902500000000004 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215046+0000", 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3319000000000006e-05 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.215110+0000", 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3536999999999998e-05 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.037 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:21.039 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:21.039 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:21.038+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:21.140 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:21.138+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:21.167 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:01:21.167 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:21.191 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records in 2024-04-23T19:01:21.191 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records out 2024-04-23T19:01:21.191 INFO:tasks.workunit.client.0.smithi169.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0210818 s, 497 MB/s 2024-04-23T19:01:21.213 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:21.213 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:21.213 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:21.213 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:21.227 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:21.270 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:21.270+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:21.341 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:21.344+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:21.348 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_21 2024-04-23T19:01:21.401 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:21.401 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:21.401 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:21.401 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:21.401 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:21.417 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:21.442 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:21.444+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:21.542 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.209135336999999, 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085602839999999996, 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.543 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 48 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331687+0000", 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331702+0000", 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.486e-05 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331735+0000", 2024-04-23T19:01:21.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3272999999999998e-05 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331758+0000", 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2633000000000002e-05 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331922+0000", 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164356 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332211+0000", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028900799999999999 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332486+0000", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275044 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.334812+0000", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023258720000000001 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340081+0000", 2024-04-23T19:01:21.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052694229999999996 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340176+0000", 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4674999999999997e-05 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340244+0000", 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7726999999999997e-05 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.548 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253696272512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.200168583, 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035096519999999998, 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 49 2024-04-23T19:01:21.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340650+0000", 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340652+0000", 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340660+0000", 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6320000000000008e-06 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340685+0000", 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5171e-05 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340698+0000", 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2525e-05 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340814+0000", 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011663900000000001 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340955+0000", 2024-04-23T19:01:21.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014095899999999999 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.341217+0000", 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026212099999999998 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.342176+0000", 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095870199999999997 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344001+0000", 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00182467 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344070+0000", 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9146000000000005e-05 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.344160+0000", 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0038999999999996e-05 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.230497902000003, 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004746737, 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.555 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 205 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310325+0000", 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6739999999999999e-06 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310342+0000", 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7062999999999999e-05 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310372+0000", 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0116000000000001e-05 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310395+0000", 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3025999999999999e-05 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310720+0000", 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000325242 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311086+0000", 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036572699999999999 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311891+0000", 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080526000000000003 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.313563+0000", 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001672251 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314820+0000", 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001256783 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314965+0000", 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144699 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.315068+0000", 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102896 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.560 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.156893416000003, 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003601885, 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 220 2024-04-23T19:01:21.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383925+0000", 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383929+0000", 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3160000000000001e-06 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383942+0000", 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3207000000000001e-05 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.383971+0000", 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8883000000000001e-05 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384007+0000", 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6335999999999999e-05 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384141+0000", 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013357899999999999 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.384482+0000", 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034114099999999999 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.385195+0000", 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00071281399999999998 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.386715+0000", 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001520478 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387369+0000", 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00065341900000000003 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387457+0000", 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8172999999999998e-05 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.387527+0000", 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0538999999999997e-05 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.566 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.138803080000002, 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038023179999999998, 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 225 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.567 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402016+0000", 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402018+0000", 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2469999999999998e-06 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402029+0000", 2024-04-23T19:01:21.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1287000000000001e-05 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402061+0000", 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1405999999999997e-05 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402075+0000", 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4593000000000001e-05 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402208+0000", 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013251300000000001 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.402559+0000", 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035087699999999998 2024-04-23T19:01:21.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.403320+0000", 2024-04-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076132700000000001 2024-04-23T19:01:21.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.404820+0000", 2024-04-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015002679999999999 2024-04-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405556+0000", 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00073558499999999997 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405709+0000", 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153065 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.405818+0000", 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010915 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:289 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.086609596000002, 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036979719999999999, 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.575 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 289 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454209+0000", 2024-04-23T19:01:21.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454211+0000", 2024-04-23T19:01:21.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.567e-06 2024-04-23T19:01:21.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454222+0000", 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1323e-05 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454253+0000", 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0843000000000003e-05 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454273+0000", 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9524000000000001e-05 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454663+0000", 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039064299999999998 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.454787+0000", 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123843 2024-04-23T19:01:21.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.455041+0000", 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025372099999999999 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.456156+0000", 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011157179999999999 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457617+0000", 2024-04-23T19:01:21.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001460109 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457783+0000", 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016658499999999999 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457907+0000", 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124096 2024-04-23T19:01:21.582 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:344 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.078107117999998, 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040128489999999998, 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.583 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 344 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462715+0000", 2024-04-23T19:01:21.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7530000000000002e-06 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462725+0000", 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0334e-05 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462750+0000", 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4646000000000001e-05 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462779+0000", 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9886000000000002e-05 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462929+0000", 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014975599999999999 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463152+0000", 2024-04-23T19:01:21.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022302499999999999 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463707+0000", 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00055493600000000001 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465489+0000", 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017817460000000001 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466471+0000", 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098237600000000008 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466620+0000", 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878600000000001 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466725+0000", 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010460500000000001 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:378 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.071278546999999, 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045344950000000004, 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.591 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 378 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469543+0000", 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3800000000000001e-06 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469558+0000", 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5216e-05 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469592+0000", 2024-04-23T19:01:21.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4276999999999997e-05 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469612+0000", 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9973e-05 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469788+0000", 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017606800000000001 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469994+0000", 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020596500000000001 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.470297+0000", 2024-04-23T19:01:21.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000303145 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471492+0000", 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011943139999999999 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473878+0000", 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002386371 2024-04-23T19:01:21.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473972+0000", 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3603000000000005e-05 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474075+0000", 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103183 2024-04-23T19:01:21.597 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:467 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.021321952999998, 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040446919999999999, 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.598 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 467 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:21.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519499+0000", 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519510+0000", 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1073000000000001e-05 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519539+0000", 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.885e-05 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519553+0000", 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4073000000000001e-05 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519679+0000", 2024-04-23T19:01:21.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012514500000000001 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519800+0000", 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121048 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520138+0000", 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033848299999999999 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.521245+0000", 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011068479999999999 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523318+0000", 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020726669999999998 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523451+0000", 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013325300000000001 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523542+0000", 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0811999999999997e-05 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:512 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.605 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.996117568000003, 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046289160000000003, 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 512 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544703+0000", 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:21.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544714+0000", 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1036000000000001e-05 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544743+0000", 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9096000000000001e-05 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544764+0000", 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0273999999999999e-05 2024-04-23T19:01:21.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544903+0000", 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139147 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545058+0000", 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015533499999999999 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545435+0000", 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037699499999999998 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546776+0000", 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013404840000000001 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549119+0000", 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002342939 2024-04-23T19:01:21.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549255+0000", 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013645399999999999 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549330+0000", 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5181999999999999e-05 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:513 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'5, mlcod=32'3)", 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.994665376999997, 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005799584, 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546155+0000", 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.815e-06 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546169+0000", 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3691e-05 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546201+0000", 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546221+0000", 2024-04-23T19:01:21.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0462000000000002e-05 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546368+0000", 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014708500000000001 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546409+0000", 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0970000000000002e-05 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551835+0000", 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054259850000000004 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551953+0000", 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117716 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:648 6.d 6:b72b1478:::obj_delete_at_hint.0000000033:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.895088200000004, 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038820410000000001, 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.617 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 648 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645731+0000", 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645733+0000", 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.03e-06 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645743+0000", 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0433e-05 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645773+0000", 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0153000000000001e-05 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645794+0000", 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0747e-05 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.645886+0000", 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1908000000000002e-05 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.646006+0000", 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119591 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.646227+0000", 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000221258 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.647077+0000", 2024-04-23T19:01:21.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00085041200000000004 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649399+0000", 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023215129999999999 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649520+0000", 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120754 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.649613+0000", 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3241999999999999e-05 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.294392672999997, 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035628050000000001, 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.623 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 943 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246426+0000", 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246428+0000", 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2460000000000002e-06 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246440+0000", 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1226999999999999e-05 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246470+0000", 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0695999999999999e-05 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246491+0000", 2024-04-23T19:01:21.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.048e-05 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246632+0000", 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141345 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.246974+0000", 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034169799999999998 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.247552+0000", 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000578375 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.248830+0000", 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00127765 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249718+0000", 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00088796000000000003 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249870+0000", 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015214199999999999 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:27.249989+0000", 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118986 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1076 4.32 4:4dfd0dc5:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.0158780220000001, 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072734380000000001, 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1076 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524942+0000", 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4139999999999999e-06 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524950+0000", 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1389999999999995e-06 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524968+0000", 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980999999999999e-05 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524994+0000", 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5633e-05 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525155+0000", 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016075799999999999 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525403+0000", 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024827699999999998 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525709+0000", 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030619600000000001 2024-04-23T19:01:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.528078+0000", 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023689760000000001 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.531940+0000", 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038613710000000002 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532090+0000", 2024-04-23T19:01:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015073500000000001 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532214+0000", 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012395799999999999 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1083 4.32 4:4e794105:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.0157694690000001, 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080107340000000003, 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1083 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525050+0000", 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7399999999999991e-07 2024-04-23T19:01:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525056+0000", 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3399999999999997e-06 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525072+0000", 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6308999999999999e-05 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525081+0000", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4999999999999999e-06 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526456+0000", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013756829999999999 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526821+0000", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036475100000000002 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527313+0000", 2024-04-23T19:01:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049206800000000002 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532390+0000", 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050770650000000004 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532903+0000", 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00051322599999999998 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532990+0000", 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7132000000000005e-05 2024-04-23T19:01:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.533060+0000", 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9685999999999997e-05 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1086 4.25 4:a7d96929:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.015161513, 2024-04-23T19:01:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.007062975, 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1086 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525659+0000", 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2100000000000001e-06 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525670+0000", 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.118e-05 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525684+0000", 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525697+0000", 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2456000000000001e-05 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525779+0000", 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2269999999999997e-05 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525929+0000", 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014989300000000001 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526117+0000", 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018751400000000001 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527644+0000", 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001527612 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532623+0000", 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049787410000000001 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532676+0000", 2024-04-23T19:01:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3615000000000001e-05 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532720+0000", 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.388e-05 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:1081 4.3 e52/22 4:c2ab2700:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.5:head v 52'1, mlcod=0'0)", 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.526120+0000", 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.014699386, 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00366358, 2024-04-23T19:01:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526120+0000", 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526120+0000", 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526121+0000", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-06 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526130+0000", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1870000000000003e-06 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526152+0000", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1285999999999999e-05 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526170+0000", 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7866000000000001e-05 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526480+0000", 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031079300000000002 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526524+0000", 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3986000000000002e-05 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.529681+0000", 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003156453 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.529783+0000", 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102249 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.67971051699999996, 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:01:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:01:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:01:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:01:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1113 3.28 3:171e86a1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.65479416300000004, 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019880546999999998, 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1113 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886026+0000", 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3300000000000001e-07 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889886+0000", 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599490000000001 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889908+0000", 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2824e-05 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889918+0000", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.893e-06 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890103+0000", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018468900000000001 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890374+0000", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027112300000000001 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.891238+0000", 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086359200000000005 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.902456+0000", 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011218271 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905711+0000", 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032550919999999998 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905828+0000", 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117365 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905905+0000", 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6915999999999993e-05 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4646.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796980963920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.53975819999999997, 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045538920000000004, 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4646", 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001062+0000", 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6729999999999999e-06 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001071+0000", 2024-04-23T19:01:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4640000000000006e-06 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001110+0000", 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8798999999999999e-05 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001126+0000", 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6364000000000001e-05 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001227+0000", 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100945 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001380+0000", 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153361 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001601+0000", 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000220824 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.003537+0000", 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019358120000000001 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005193+0000", 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001655672 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005387+0000", 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000194787 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005615+0000", 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022719099999999999 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:21.668 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:21.668 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:21.542+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:21.669 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:21.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:01:21.671 INFO:tasks.workunit.client.0.smithi169.stdout:bucket quota max_objs set for the given user: buck_2024_03_23_19_01_21 2024-04-23T19:01:21.671 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:21.671+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:21.772 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:21.770+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:21.848 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:21.848 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:21.848 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:21.848 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:21.857 INFO:tasks.workunit.client.0.smithi169.stdout:quota enabled for the bucket: buck_2024_03_23_19_01_21 2024-04-23T19:01:21.857 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 10Mb. 2024-04-23T19:01:21.857 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:01:21.857 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:21.857 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - Test max objects for the given user passed 2024-04-23T19:01:21.857 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:21.862 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:21.906 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:21.906+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:21.974 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:21.974+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:22.039 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:22.039 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:22.039 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:22.039 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:22.039 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:22.055 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:22.075 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:22.075+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:22.080 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:01:22.081 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:22.102 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records in 2024-04-23T19:01:22.102 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records out 2024-04-23T19:01:22.102 INFO:tasks.workunit.client.0.smithi169.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0189354 s, 554 MB/s 2024-04-23T19:01:22.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:22.179 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:22.179+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4452.0:36 5.9 e25/24 5:90f831dc:::zone_info.2fe9869b-25a1-4b09-be2c-4e9208a04c5d:head v 25'1, mlcod=0'0)", 2024-04-23T19:01:22.230 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 62.889746301999999, 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038336279999999999, 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339270+0000", 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0900000000000002e-07 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339278+0000", 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1200000000000002e-06 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339294+0000", 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6725e-05 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339311+0000", 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339445+0000", 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013386600000000001 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339497+0000", 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1471999999999998e-05 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343010+0000", 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035131630000000001 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343103+0000", 2024-04-23T19:01:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3076000000000001e-05 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.917880068999999, 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253696271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.897368133999997, 2024-04-23T19:01:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056192660000000004, 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331650+0000", 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.977e-06 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331663+0000", 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2255999999999999e-05 2024-04-23T19:01:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331694+0000", 2024-04-23T19:01:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1250000000000001e-05 2024-04-23T19:01:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331714+0000", 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9874e-05 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331876+0000", 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016204500000000001 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332107+0000", 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000231072 2024-04-23T19:01:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333144+0000", 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001037615 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.335757+0000", 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026121959999999998 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336906+0000", 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001149478 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337056+0000", 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000149722 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337267+0000", 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000210781 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:465 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.712033671, 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038716359999999999, 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516983+0000", 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0300000000000001e-06 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516991+0000", 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1329999999999999e-06 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517005+0000", 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3720000000000001e-05 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517019+0000", 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4773000000000001e-05 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517142+0000", 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012258200000000001 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517196+0000", 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3582999999999998e-05 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520763+0000", 2024-04-23T19:01:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035673900000000001 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520853+0000", 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0425000000000002e-05 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:466 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.709147346000002, 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037160069999999999, 2024-04-23T19:01:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519869+0000", 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.347e-06 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519880+0000", 2024-04-23T19:01:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0406e-05 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519908+0000", 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7872999999999999e-05 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519921+0000", 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2962999999999999e-05 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520041+0000", 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120579 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520093+0000", 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2231000000000002e-05 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523472+0000", 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00337858 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523584+0000", 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011202800000000001 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.706945482999998, 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041565439999999999, 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522071+0000", 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4640000000000001e-06 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522082+0000", 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0566e-05 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522106+0000", 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4502999999999999e-05 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522124+0000", 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522233+0000", 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108633 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522268+0000", 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5200000000000002e-05 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526155+0000", 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038872030000000001 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526227+0000", 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1248999999999995e-05 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:472 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'7, mlcod=32'5)", 2024-04-23T19:01:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:01:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.703139769000003, 2024-04-23T19:01:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029499230000000001, 2024-04-23T19:01:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525876+0000", 2024-04-23T19:01:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525877+0000", 2024-04-23T19:01:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.793e-06 2024-04-23T19:01:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525893+0000", 2024-04-23T19:01:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5302999999999999e-05 2024-04-23T19:01:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525922+0000", 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8736999999999999e-05 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.525940+0000", 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8683000000000001e-05 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526091+0000", 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015075200000000001 2024-04-23T19:01:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526144+0000", 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3359999999999997e-05 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528717+0000", 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025726820000000002 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.528826+0000", 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108613 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:831 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'13, mlcod=32'11)", 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.243520226999998, 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033014849999999998, 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985495+0000", 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985497+0000", 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.587e-06 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985510+0000", 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2813000000000001e-05 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985545+0000", 2024-04-23T19:01:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5073000000000001e-05 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985569+0000", 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3816999999999999e-05 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985696+0000", 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127355 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.985732+0000", 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5923999999999997e-05 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.988714+0000", 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029824529999999999 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.988797+0000", 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2463e-05 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4788.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94706236334944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.440016+0000", 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.788999365, 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0028011080000000001, 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4788", 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1695038295", 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 45 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440016+0000", 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440016+0000", 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440018+0000", 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440029+0000", 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0380000000000001e-05 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440050+0000", 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.124e-05 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440062+0000", 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2336e-05 2024-04-23T19:01:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440160+0000", 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7558000000000003e-05 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440315+0000", 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000155635 2024-04-23T19:01:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.440533+0000", 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000217591 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.441956+0000", 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014225279999999999 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.442580+0000", 2024-04-23T19:01:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00062445899999999995 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.442711+0000", 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000130529 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.442817+0000", 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000106638 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4646.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.005033+0000", 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.2239824269999999, 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029204650000000001, 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4646", 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005033+0000", 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005033+0000", 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005036+0000", 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9699999999999999e-06 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005047+0000", 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1089e-05 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005083+0000", 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6220000000000002e-05 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005125+0000", 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1802999999999999e-05 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005207+0000", 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1940000000000005e-05 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005291+0000", 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4079000000000006e-05 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005414+0000", 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000122421 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.006240+0000", 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00082665099999999997 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.007902+0000", 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00166179 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.007931+0000", 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8912999999999999e-05 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.007953+0000", 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2589e-05 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4646.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796980969600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.008080+0000", 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.220935616, 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0028731439999999998, 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4646", 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 53 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008080+0000", 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008080+0000", 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008081+0000", 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.643e-06 2024-04-23T19:01:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008090+0000", 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5639999999999997e-06 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008114+0000", 2024-04-23T19:01:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3943000000000001e-05 2024-04-23T19:01:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008126+0000", 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2439999999999999e-05 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008177+0000", 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0887999999999998e-05 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008218+0000", 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0651000000000001e-05 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.008304+0000", 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5822000000000006e-05 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.009113+0000", 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080953500000000001 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.010592+0000", 2024-04-23T19:01:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014784830000000001 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.010764+0000", 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017176800000000001 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.010953+0000", 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000189407 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1210 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.891243601, 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067467129999999997, 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1210 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337774+0000", 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.72e-06 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337780+0000", 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2339999999999999e-06 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337794+0000", 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4217e-05 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337802+0000", 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100000000000003e-06 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337903+0000", 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101047 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338041+0000", 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013782399999999999 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338256+0000", 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215467 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.339632+0000", 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013758970000000001 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344441+0000", 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004809064 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344482+0000", 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0428e-05 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344519+0000", 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6705000000000002e-05 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1216 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.89112237100000002, 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067969930000000003, 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1216 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337894+0000", 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8199999999999999e-07 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337898+0000", 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3749999999999996e-06 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337908+0000", 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0292000000000001e-05 2024-04-23T19:01:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337917+0000", 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2069999999999995e-06 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338539+0000", 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00062252800000000001 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338640+0000", 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100412 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338785+0000", 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014592899999999999 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.340035+0000", 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001249411 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344619+0000", 2024-04-23T19:01:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045837100000000004 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344656+0000", 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7694999999999997e-05 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344690+0000", 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3751999999999998e-05 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4679.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94237568166176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.443477+0000", 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.78553829100000006, 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027624469999999999, 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4679", 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/4032160260", 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 53 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443477+0000", 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443477+0000", 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443478+0000", 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0979999999999999e-06 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443483+0000", 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8060000000000002e-06 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443496+0000", 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.278e-05 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443504+0000", 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2719999999999997e-06 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443556+0000", 2024-04-23T19:01:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1560000000000001e-05 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443619+0000", 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3072999999999997e-05 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.443727+0000", 2024-04-23T19:01:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010798699999999999 2024-04-23T19:01:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.444268+0000", 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000541101 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.446131+0000", 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018633359999999999 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.446168+0000", 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6557999999999998e-05 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.446240+0000", 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1876000000000001e-05 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.65183371199999995, 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056182469999999998, 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577183+0000", 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4099999999999997e-07 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577187+0000", 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8959999999999996e-06 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577198+0000", 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1535000000000001e-05 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577204+0000", 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7729999999999996e-06 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577285+0000", 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0679999999999993e-05 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577370+0000", 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5883000000000004e-05 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577457+0000", 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6501000000000004e-05 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.578218+0000", 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076112900000000004 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582735+0000", 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045166909999999998 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582772+0000", 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7514e-05 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582800+0000", 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7704000000000001e-05 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4715.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94883869179184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.712801+0000", 2024-04-23T19:01:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.51621486000000005, 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030477550000000001, 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4715", 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/251614066", 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 45 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712801+0000", 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712801+0000", 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712803+0000", 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0099999999999998e-06 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712811+0000", 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9540000000000004e-06 2024-04-23T19:01:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712834+0000", 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3558999999999999e-05 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712847+0000", 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3363000000000001e-05 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.712959+0000", 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111502 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.713199+0000", 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023997299999999999 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.713604+0000", 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000405315 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.714849+0000", 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012447230000000001 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.715638+0000", 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00078860599999999996 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.715755+0000", 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117411 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.715848+0000", 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3338999999999995e-05 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4715.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94883869179184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.489986857, 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041245029999999998, 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4715", 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/251614066", 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 68 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739031+0000", 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0269999999999998e-06 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739038+0000", 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6480000000000003e-06 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739060+0000", 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2041000000000001e-05 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739070+0000", 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2660000000000007e-06 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739168+0000", 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8647000000000006e-05 2024-04-23T19:01:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739240+0000", 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2275999999999997e-05 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739412+0000", 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017175 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.740367+0000", 2024-04-23T19:01:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095455300000000002 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.742977+0000", 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026103229999999999 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.743050+0000", 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3231000000000004e-05 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.743153+0000", 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102741 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.27708976299999999, 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058651459999999999, 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951927+0000", 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.426e-06 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951932+0000", 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2449999999999998e-06 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951949+0000", 2024-04-23T19:01:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6197000000000001e-05 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951960+0000", 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1430000000000001e-05 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952028+0000", 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7764999999999999e-05 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952128+0000", 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9846999999999995e-05 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952275+0000", 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014731799999999999 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.953530+0000", 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012555890000000001 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957674+0000", 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041432489999999999 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957727+0000", 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3266999999999997e-05 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957791+0000", 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3812999999999994e-05 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1327 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.15447750900000001, 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041744629999999998, 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1327 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074541+0000", 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8849999999999999e-06 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074547+0000", 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6499999999999999e-06 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074562+0000", 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4673e-05 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074570+0000", 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5410000000000003e-06 2024-04-23T19:01:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074626+0000", 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.6140999999999997e-05 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074701+0000", 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5227000000000003e-05 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074805+0000", 2024-04-23T19:01:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010398 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075985+0000", 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011795760000000001 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078636+0000", 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002651811 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078680+0000", 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3813999999999998e-05 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078712+0000", 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2165000000000001e-05 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1333 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.15438228100000001, 2024-04-23T19:01:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044982269999999996, 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1333 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074634+0000", 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8400000000000004e-07 2024-04-23T19:01:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074637+0000", 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.898e-06 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074643+0000", 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7780000000000002e-06 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074649+0000", 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7400000000000001e-06 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074762+0000", 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112959 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074976+0000", 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213687 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075329+0000", 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000353426 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.076812+0000", 2024-04-23T19:01:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014828899999999999 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079040+0000", 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022278340000000002 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079093+0000", 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.287e-05 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079131+0000", 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8560999999999999e-05 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:22.358 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:22.359 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:22.360 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:22.360 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_22 2024-04-23T19:01:22.360 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:22.361 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:22.361 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:22.361 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:22.362 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:22.362 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:22.363 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:22.363 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:22.363 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:22.363 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:22.364 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:22.364 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:22.359+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:22.371 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:22.372 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:22.391 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:22.391 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:22.408 INFO:tasks.workunit.client.0.smithi169.stdout:quota set for the bucket: buck_2024_03_23_19_01_22 2024-04-23T19:01:22.460 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:22.459+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:22.501 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:22.501 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:22.516 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:22.566 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:22.566+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:22.638 INFO:tasks.workunit.client.0.smithi169.stdout:quota enabled for the bucket: buck_2024_03_23_19_01_22 2024-04-23T19:01:22.638 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 10Mb. 2024-04-23T19:01:22.639 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:01:22.648 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records in 2024-04-23T19:01:22.648 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records out 2024-04-23T19:01:22.648 INFO:tasks.workunit.client.0.smithi169.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00835657 s, 1.3 GB/s 2024-04-23T19:01:22.653 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:22.653 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:22.661 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:22.663+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:22.667 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:22.702 INFO:tasks.workunit.client.0.smithi169.stdout:readding file to bucket: 10MBfile1 2024-04-23T19:01:22.702 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:22.702 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-04-23T19:01:22.702 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:22.762 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:22.762+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:22.835 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:22.836 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:22.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:22.898 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:22.898+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:22.957 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:01:22.957 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:22.964 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:22.962+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:01:22.976 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:22.976 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:22.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:23.023 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records in 2024-04-23T19:01:23.023 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records out 2024-04-23T19:01:23.023 INFO:tasks.workunit.client.0.smithi169.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0633406 s, 166 MB/s 2024-04-23T19:01:23.065 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:23.062+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:23.140 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:23.140 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:23.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:23.200 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:23.203+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:23.209 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_23 2024-04-23T19:01:23.266 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:23.267+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:23.273 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:23.273 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:23.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:23.368 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:23.366+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:23.449 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:23.449 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:23.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:23.468 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:23.471+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:23.497 INFO:tasks.workunit.client.0.smithi169.stdout:bucket quota max_objs set for the given user: buck_2024_03_23_19_01_23 2024-04-23T19:01:23.569 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:23.566+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:23.581 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:23.581 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:23.595 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:23.670 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:23.670+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:23.753 INFO:tasks.workunit.client.0.smithi169.stdout:quota enabled for the bucket: buck_2024_03_23_19_01_23 2024-04-23T19:01:23.753 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 10Mb. 2024-04-23T19:01:23.753 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:01:23.756 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:23.756 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:23.770 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:23.771+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:23.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:23.790 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records in 2024-04-23T19:01:23.790 INFO:tasks.workunit.client.0.smithi169.stderr:1+0 records out 2024-04-23T19:01:23.790 INFO:tasks.workunit.client.0.smithi169.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0340258 s, 308 MB/s 2024-04-23T19:01:23.817 INFO:tasks.workunit.client.0.smithi169.stdout:readding file to bucket: 10MBfile1 2024-04-23T19:01:23.817 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:23.817 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-04-23T19:01:23.817 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:23.872 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:23.870+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:23.907 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:23.907 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:23.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:24.016 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:24.019+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:24.074 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:24.075+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:24.081 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:24.081 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:24.097 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:24.097 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:01:24.097 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:24.188 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:24.191+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:24.257 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:24.257 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:24.269 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_24 2024-04-23T19:01:24.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:24.276 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:24.274+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:24.378 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:24.378+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:24.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:24.434 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:24.434 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:24.449 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:24.474 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:24.474 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_23_19_01_24 with max size as zero 2024-04-23T19:01:24.474 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:24.474 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:24.479 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:24.478+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:24.551 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:24.568 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:24.580 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:24.578+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:24.587 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:24.590 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:24.590 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:24.604 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:24.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:24.628 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:24.628 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:24.644 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_24 2024-04-23T19:01:24.652 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:24.652 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:24.682 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:24.683+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:24.686 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:24.721 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:24.751 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253696265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 61.397053245999999, 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050062450000000003, 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356411+0000", 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356412+0000", 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-06 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356439+0000", 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.69e-05 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356499+0000", 2024-04-23T19:01:24.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9654000000000002e-05 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356516+0000", 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356667+0000", 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015088300000000001 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356779+0000", 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011254799999999999 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356954+0000", 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175036 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.358069+0000", 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0011146610000000001 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361180+0000", 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031114419999999999 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361317+0000", 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013631900000000001 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361417+0000", 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000100148 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 61.396833528000002, 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049665359999999997, 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 58 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356630+0000", 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356632+0000", 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356639+0000", 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9979999999999997e-06 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356655+0000", 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6274e-05 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356666+0000", 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0797e-05 2024-04-23T19:01:24.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.356791+0000", 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012571300000000001 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357016+0000", 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022467799999999999 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.357264+0000", 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024775600000000002 2024-04-23T19:01:24.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.360982+0000", 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037185489999999998 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361443+0000", 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00046099500000000001 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361532+0000", 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8239000000000007e-05 2024-04-23T19:01:24.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:23.361597+0000", 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5216999999999996e-05 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.426875664000001, 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043476909999999999, 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.763 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 207 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326588+0000", 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326591+0000", 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1760000000000002e-06 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326605+0000", 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326645+0000", 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9576999999999997e-05 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326668+0000", 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3336000000000002e-05 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.326815+0000", 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014628199999999999 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327173+0000", 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000358208 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.327839+0000", 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00066647099999999997 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.329290+0000", 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00145061 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330779+0000", 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014887290000000001 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330871+0000", 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2454999999999995e-05 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.330936+0000", 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4807000000000005e-05 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:611 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.136230750999999, 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042157039999999998, 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 611 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.769 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617233+0000", 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617234+0000", 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7900000000000007e-07 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617239+0000", 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2859999999999999e-06 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617253+0000", 2024-04-23T19:01:24.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3535e-05 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617262+0000", 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4769999999999992e-06 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617365+0000", 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102725 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617427+0000", 2024-04-23T19:01:24.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1939000000000004e-05 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.617564+0000", 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136914 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.618725+0000", 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001160592 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621333+0000", 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026081780000000001 2024-04-23T19:01:24.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621386+0000", 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3041000000000003e-05 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.621449+0000", 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3038000000000002e-05 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:613 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 58.134348365000001, 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052480779999999998, 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 613 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619116+0000", 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619117+0000", 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1990000000000001e-06 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619122+0000", 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3079999999999998e-06 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619135+0000", 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2855e-05 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619141+0000", 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3350000000000003e-06 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619179+0000", 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-05 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619231+0000", 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848000000000002e-05 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.619364+0000", 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013374 2024-04-23T19:01:24.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.620707+0000", 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013428190000000001 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624267+0000", 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035595269999999998 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624322+0000", 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:24.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:26.624364+0000", 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1928000000000002e-05 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4788.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94706236350704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.451351+0000", 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3021127239999997, 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041016739999999996, 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.780 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4788", 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/1695038295", 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 55 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451351+0000", 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451351+0000", 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451352+0000", 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3499999999999996e-07 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451355+0000", 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1429999999999998e-06 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451364+0000", 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5660000000000007e-06 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451368+0000", 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7400000000000004e-06 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451433+0000", 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5011000000000005e-05 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451514+0000", 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0488999999999995e-05 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.451667+0000", 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015347200000000001 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452413+0000", 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00074581699999999996 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.455370+0000", 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029571129999999999 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.455399+0000", 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8866000000000001e-05 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.455453+0000", 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3822000000000001e-05 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4788.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94706236354400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.452603+0000", 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3008609250000003, 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055081239999999997, 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4788", 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/1695038295", 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 57 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452603+0000", 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452603+0000", 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452604+0000", 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9399999999999993e-07 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452608+0000", 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.658e-06 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452617+0000", 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2660000000000007e-06 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452622+0000", 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0089999999999998e-06 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452658+0000", 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6195999999999997e-05 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452699+0000", 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0725000000000001e-05 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.452777+0000", 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8205000000000001e-05 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.455162+0000", 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023849850000000001 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.458047+0000", 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002884944 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.458076+0000", 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9237000000000001e-05 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.458111+0000", 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4904999999999999e-05 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1078 4.17 4:eb08d353:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.525784+0000", 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.2276803100000002, 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0075171580000000003, 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.791 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1078 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525784+0000", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525784+0000", 2024-04-23T19:01:24.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525785+0000", 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5999999999999999e-06 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525794+0000", 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0329999999999997e-06 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525817+0000", 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.287e-05 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525834+0000", 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6599000000000002e-05 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525918+0000", 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4504000000000003e-05 2024-04-23T19:01:24.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526028+0000", 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109595 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526166+0000", 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000138286 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.529505+0000", 2024-04-23T19:01:24.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033386290000000001 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.533242+0000", 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037376250000000001 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.533269+0000", 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6483999999999999e-05 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.533301+0000", 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1933000000000001e-05 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1079 4.29 4:94cee8a4:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.525884+0000", 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.2275797590000002, 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066828520000000004, 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.797 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1079 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525884+0000", 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525884+0000", 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525886+0000", 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2900000000000001e-06 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525895+0000", 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5129999999999996e-06 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525919+0000", 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4423e-05 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.525960+0000", 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0978e-05 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526210+0000", 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024938599999999999 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526491+0000", 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000281589 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526928+0000", 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00043655799999999998 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532379+0000", 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054512010000000001 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532516+0000", 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136876 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532543+0000", 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7484999999999999e-05 2024-04-23T19:01:24.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532567+0000", 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3553e-05 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1080 4.19 4:982fcf22:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.526005+0000", 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.2274584429999997, 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063653219999999996, 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.803 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1080 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526005+0000", 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526005+0000", 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526007+0000", 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.124e-06 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526017+0000", 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.024e-05 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526041+0000", 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4369e-05 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526061+0000", 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9936e-05 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526300+0000", 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000238817 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526399+0000", 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9321000000000007e-05 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.526568+0000", 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000168822 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.529796+0000", 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032277629999999998 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532295+0000", 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024992059999999999 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532337+0000", 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1604999999999999e-05 2024-04-23T19:01:24.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.532371+0000", 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4119000000000003e-05 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4806.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.640585+0000", 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1128786340000003, 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053296619999999998, 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.809 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4806", 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/4007176350", 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 56 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640585+0000", 2024-04-23T19:01:24.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640585+0000", 2024-04-23T19:01:24.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640586+0000", 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1300000000000001e-07 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640588+0000", 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9290000000000001e-06 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640593+0000", 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8690000000000001e-06 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640597+0000", 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4010000000000001e-06 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640635+0000", 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8099000000000002e-05 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640708+0000", 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2558999999999994e-05 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.640776+0000", 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8936000000000005e-05 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.642948+0000", 2024-04-23T19:01:24.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021712279999999999 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.645864+0000", 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029161040000000001 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.645893+0000", 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8779999999999999e-05 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.645915+0000", 2024-04-23T19:01:24.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2344000000000002e-05 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:1110 3.5 e52/20 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head v 52'1, mlcod=0'0)", 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.867020+0000", 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.8864442869999998, 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015514735, 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.867020+0000", 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.867020+0000", 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.867021+0000", 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8649999999999999e-06 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.871090+0000", 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040686439999999997 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.871113+0000", 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2476e-05 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.871123+0000", 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0672e-05 2024-04-23T19:01:24.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.871203+0000", 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0079000000000004e-05 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.871229+0000", 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5962999999999999e-05 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.882495+0000", 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011265528 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.882534+0000", 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9508000000000002e-05 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:1113 3.28 e52/20 3:171e86a1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1_10Mb.:head v 52'1, mlcod=0'0)", 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:20.892286+0000", 2024-04-23T19:01:24.820 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.861178341, 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0082740169999999998, 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.892286+0000", 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.892286+0000", 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.892287+0000", 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4729999999999999e-06 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.896011+0000", 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037235469999999998 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.896033+0000", 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2412000000000002e-05 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.896046+0000", 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2632999999999999e-05 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.896115+0000", 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9500999999999997e-05 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.896133+0000", 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7388e-05 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.900508+0000", 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043751329999999998 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:20.900560+0000", 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1929999999999999e-05 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4646.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.011366+0000", 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7420977249999998, 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053723249999999998, 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4646", 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 56 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011366+0000", 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011366+0000", 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011367+0000", 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4499999999999997e-07 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011369+0000", 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0829999999999998e-06 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011374+0000", 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2680000000000002e-06 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011378+0000", 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5889999999999999e-06 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011421+0000", 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3600999999999998e-05 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011491+0000", 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9575999999999999e-05 2024-04-23T19:01:24.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.011602+0000", 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011103399999999999 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.016416+0000", 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048139050000000003 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.016646+0000", 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00023019499999999999 2024-04-23T19:01:24.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.016698+0000", 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2278000000000003e-05 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.016739+0000", 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0351e-05 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.830 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4664.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.300222+0000", 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.4532415780000001, 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050993119999999999, 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4664", 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/889819541", 2024-04-23T19:01:24.831 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 56 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300222+0000", 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300222+0000", 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300223+0000", 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4700000000000001e-07 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300226+0000", 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2780000000000002e-06 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300234+0000", 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5610000000000001e-06 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300238+0000", 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1130000000000003e-06 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300277+0000", 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9240999999999999e-05 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300375+0000", 2024-04-23T19:01:24.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7942000000000005e-05 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.300506+0000", 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013043700000000001 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.302539+0000", 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020336519999999999 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.305258+0000", 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027184330000000001 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.305286+0000", 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8558999999999999e-05 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.305322+0000", 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5448999999999999e-05 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:1246 3.28 e52/20 3:16f1103d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2_10Mb.:head v 52'3, mlcod=52'1)", 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.845186+0000", 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.9082780860000002, 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014084686000000001, 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.845186+0000", 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.845186+0000", 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.845188+0000", 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.858e-06 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.849938+0000", 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047498749999999998 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.849961+0000", 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2994e-05 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.849971+0000", 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0057999999999999e-05 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.850037+0000", 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6014999999999997e-05 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.850058+0000", 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0874e-05 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.859168+0000", 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091107549999999999 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.859271+0000", 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010225699999999999 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1330 4.19 4:9bbc6adf:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:22.075271+0000", 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.6781924579999998, 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042669960000000003, 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.841 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1330 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075271+0000", 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075271+0000", 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075272+0000", 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7599999999999997e-07 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075275+0000", 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7499999999999999e-06 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075285+0000", 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0154e-05 2024-04-23T19:01:24.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075291+0000", 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4960000000000001e-06 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075344+0000", 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2305000000000002e-05 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075441+0000", 2024-04-23T19:01:24.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7306000000000007e-05 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.075543+0000", 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102187 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.078891+0000", 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033477590000000001 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.079479+0000", 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00058777600000000003 2024-04-23T19:01:24.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.079514+0000", 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4827999999999999e-05 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.079538+0000", 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4859e-05 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4754.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132820514320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:22.214002+0000", 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.5394620789999998, 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043326679999999996, 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4754", 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/250576395", 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 55 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214002+0000", 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214002+0000", 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214002+0000", 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1600000000000001e-07 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214006+0000", 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9190000000000001e-06 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214016+0000", 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0114e-05 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214022+0000", 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3750000000000002e-06 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214061+0000", 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9632999999999998e-05 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214113+0000", 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1187999999999998e-05 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214190+0000", 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6958000000000004e-05 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.215265+0000", 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001075749 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218217+0000", 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029518690000000002 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218287+0000", 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9660999999999996e-05 2024-04-23T19:01:24.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218335+0000", 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7586000000000001e-05 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4754.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:22.214045+0000", 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.539419112, 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045182269999999997, 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.852 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4754", 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/250576395", 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 56 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214045+0000", 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214045+0000", 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214045+0000", 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2100000000000002e-07 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214047+0000", 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.029e-06 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214052+0000", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0080000000000002e-06 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214056+0000", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214103+0000", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7519999999999999e-05 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214175+0000", 2024-04-23T19:01:24.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2075000000000004e-05 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.214286+0000", 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110417 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218382+0000", 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040961130000000002 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218504+0000", 2024-04-23T19:01:24.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0001225 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218541+0000", 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6267999999999999e-05 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.218563+0000", 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2463000000000002e-05 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.857 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1352 4.23 4:c7e922e6:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:22.257361+0000", 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.4961030829999999, 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043294700000000002, 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1352 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:24.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257361+0000", 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257361+0000", 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257361+0000", 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4199999999999995e-07 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:24.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257365+0000", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5269999999999999e-06 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257373+0000", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8869999999999992e-06 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257379+0000", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6620000000000002e-06 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257860+0000", 2024-04-23T19:01:24.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00048166499999999999 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.257966+0000", 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105608 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.258115+0000", 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014966600000000001 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.260367+0000", 2024-04-23T19:01:24.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022515310000000002 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.261601+0000", 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001234232 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.261656+0000", 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5081000000000003e-05 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:22.261690+0000", 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3969e-05 2024-04-23T19:01:24.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.863 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.863 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.863 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:24.863 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:24.863 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:24.864 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:24.865 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:24.865 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_23_19_01_24 with max objects as zero 2024-04-23T19:01:24.865 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:24.865 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:24.865 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:24.862+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:24.965 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:24.967+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:24.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:01:24.991 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_24 2024-04-23T19:01:25.002 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:25.002 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:25.002 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:25.002 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:25.016 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:25.065 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:25.066+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:25.147 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:25.147 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:25.147 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:25.148 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:25.148 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:25.151 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:25.151 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_23_19_01_24 max objects -1 2024-04-23T19:01:25.151 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:25.151 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:25.163 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:25.206 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:25.206+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:25.267 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:25.266+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:25.298 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_25 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-23T19:01:25.341 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.053255116000003, 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013567132000000001, 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "reached pg", 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 43 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.342 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287246+0000", 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:01:25.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287264+0000", 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8057e-05 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287308+0000", 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4305999999999999e-05 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287339+0000", 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0586000000000002e-05 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287542+0000", 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020379600000000001 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287561+0000", 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8933e-05 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290847+0000", 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032856209999999999 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290866+0000", 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9176000000000001e-05 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300494+0000", 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096278960000000004 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300809+0000", 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031514800000000001 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 62.015815652999997, 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00551514, 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.347 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324683+0000", 2024-04-23T19:01:25.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9e-06 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324699+0000", 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324728+0000", 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9119999999999999e-05 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324750+0000", 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2512999999999999e-05 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324873+0000", 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012215500000000001 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324917+0000", 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4539999999999997e-05 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330069+0000", 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051520569999999998 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330197+0000", 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012738199999999999 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:25.351 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.998575092999999, 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011915968000000001, 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 211 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341926+0000", 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1099999999999996e-06 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341945+0000", 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9000000000000001e-05 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341993+0000", 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7503000000000002e-05 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342018+0000", 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5593e-05 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342181+0000", 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016242599999999999 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342191+0000", 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.078e-05 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.349751+0000", 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075600240000000003 2024-04-23T19:01:25.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350006+0000", 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025478499999999999 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350549+0000", 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054278300000000002 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353220+0000", 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026713230000000002 2024-04-23T19:01:25.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353616+0000", 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525699999999999 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353719+0000", 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102935 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353838+0000", 2024-04-23T19:01:25.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119449 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:282 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'1, mlcod=0'0)", 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.887585588999997, 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044810049999999997, 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452913+0000", 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.61e-06 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452928+0000", 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4725999999999999e-05 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452961+0000", 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2987000000000001e-05 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452980+0000", 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9130000000000001e-05 2024-04-23T19:01:25.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453231+0000", 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025115800000000002 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453282+0000", 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0399999999999999e-05 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457272+0000", 2024-04-23T19:01:25.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039908950000000004 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457393+0000", 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120099 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:436 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.840944092999997, 2024-04-23T19:01:25.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044919260000000003, 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 436 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499555+0000", 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3070000000000001e-06 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499568+0000", 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2493e-05 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499602+0000", 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4146999999999997e-05 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499616+0000", 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4523e-05 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499751+0000", 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013462200000000001 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499929+0000", 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177982 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.500410+0000", 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00048108299999999999 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.501598+0000", 2024-04-23T19:01:25.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011874069999999999 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503787+0000", 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021889470000000001 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503944+0000", 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157276 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.504045+0000", 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101139 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.795329547999998, 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072361279999999997, 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.368 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 513 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545170+0000", 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3120000000000001e-06 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545182+0000", 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2411e-05 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545214+0000", 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2217e-05 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545231+0000", 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6773999999999999e-05 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545374+0000", 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014263700000000001 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545518+0000", 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014400900000000001 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545965+0000", 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044757100000000001 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549086+0000", 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031200540000000001 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552249+0000", 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031637530000000001 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552336+0000", 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6953000000000006e-05 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552404+0000", 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7436999999999998e-05 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1111 3.1a 3:5847a424:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.866186+0000", 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.4743113350000003, 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016766961, 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.374 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1111 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866186+0000", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866186+0000", 2024-04-23T19:01:25.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866189+0000", 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4800000000000001e-06 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.872847+0000", 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066574759999999998 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.872903+0000", 2024-04-23T19:01:25.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5998999999999997e-05 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.872931+0000", 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8296000000000001e-05 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.873049+0000", 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118312 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.873269+0000", 2024-04-23T19:01:25.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021922700000000001 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.873464+0000", 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195811 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.881511+0000", 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080466240000000005 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882831+0000", 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013201459999999999 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882887+0000", 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5847999999999998e-05 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882953+0000", 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5741999999999995e-05 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1217 4.3d 4:bf1584ff:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337888+0000", 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.0026088800000004, 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041428300000000001, 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.380 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1217 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337888+0000", 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337888+0000", 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337889+0000", 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0999999999999997e-07 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337894+0000", 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0429999999999998e-06 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337906+0000", 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.147e-05 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337914+0000", 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5539999999999998e-06 2024-04-23T19:01:25.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338561+0000", 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00064736999999999998 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338709+0000", 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014705799999999999 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:25.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338876+0000", 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016780300000000001 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.339737+0000", 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086046500000000004 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.341975+0000", 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022377899999999999 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.342004+0000", 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9855000000000001e-05 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.342031+0000", 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6611999999999999e-05 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.386 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1345 4.c 4:329c90a2:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256550+0000", 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0839470609999999, 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045595339999999996, 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.387 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1345 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256550+0000", 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256550+0000", 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256553+0000", 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3629999999999998e-06 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256569+0000", 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5509999999999999e-05 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256606+0000", 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7329999999999997e-05 2024-04-23T19:01:25.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256629+0000", 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3088999999999999e-05 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256731+0000", 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101587 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256882+0000", 2024-04-23T19:01:25.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015081599999999999 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257050+0000", 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167935 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257909+0000", 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00085946999999999998 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.261044+0000", 2024-04-23T19:01:25.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031346519999999999 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.261074+0000", 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0602999999999998e-05 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.261110+0000", 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5179000000000003e-05 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1731 4.1a 4:58ba57b6:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.631465+0000", 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.70903222899999996, 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044473270000000001, 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1731 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631465+0000", 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631465+0000", 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631467+0000", 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631476+0000", 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6500000000000002e-06 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631496+0000", 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0869e-05 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631514+0000", 2024-04-23T19:01:25.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7147e-05 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631752+0000", 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000238507 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632055+0000", 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030290200000000002 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632564+0000", 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00050908099999999999 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635200+0000", 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026361930000000002 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635680+0000", 2024-04-23T19:01:25.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047947099999999998 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635808+0000", 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127885 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635912+0000", 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104529 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1737 4.22 4:4775d094:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.631557+0000", 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.70894047400000004, 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056345149999999997, 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1737 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.399 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631557+0000", 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631557+0000", 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631558+0000", 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.567e-06 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631566+0000", 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4830000000000002e-06 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631695+0000", 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129185 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631721+0000", 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6489999999999999e-05 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631904+0000", 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018289399999999999 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632214+0000", 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030974900000000001 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632598+0000", 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038404200000000002 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.634708+0000", 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021101340000000001 2024-04-23T19:01:25.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.637023+0000", 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00231533 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.637130+0000", 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010656499999999999 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.637191+0000", 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1075999999999996e-05 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.404 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1738 4.35 4:af1d171f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.631800+0000", 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.70869743399999996, 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005052773, 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.405 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1738 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631800+0000", 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631800+0000", 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631802+0000", 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631814+0000", 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2386e-05 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631840+0000", 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5522999999999999e-05 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631867+0000", 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7257e-05 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.633231+0000", 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001363932 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.633584+0000", 2024-04-23T19:01:25.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035364899999999999 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.634044+0000", 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00045957399999999997 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635965+0000", 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019206259999999999 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.636637+0000", 2024-04-23T19:01:25.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00067254800000000003 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.636751+0000", 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114045 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.636852+0000", 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101259 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1822 4.18 4:18db89aa:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839049+0000", 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.50144763599999997, 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051059490000000003, 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1822 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839049+0000", 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839049+0000", 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839052+0000", 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4499999999999998e-06 2024-04-23T19:01:25.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839062+0000", 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9299999999999998e-06 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839095+0000", 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3612999999999998e-05 2024-04-23T19:01:25.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839110+0000", 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5036e-05 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839254+0000", 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143542 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839505+0000", 2024-04-23T19:01:25.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025109999999999998 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839781+0000", 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027574300000000001 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842157+0000", 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023764530000000002 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843974+0000", 2024-04-23T19:01:25.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018171540000000001 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844055+0000", 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0609e-05 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844155+0000", 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100319 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1824 4.1a 4:58ba57b6:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839158+0000", 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.50133872700000004, 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038910669999999998, 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1824 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.417 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839158+0000", 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839158+0000", 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839160+0000", 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3200000000000001e-06 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839169+0000", 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7790000000000007e-06 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839191+0000", 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1180000000000001e-05 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839207+0000", 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5860000000000001e-05 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839448+0000", 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024115700000000001 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839667+0000", 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021898999999999999 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839946+0000", 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027893699999999999 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842242+0000", 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022962569999999999 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842810+0000", 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00056793600000000001 2024-04-23T19:01:25.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842947+0000", 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013695600000000001 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843049+0000", 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010269500000000001 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.422 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1830 4.22 4:4775d094:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839244+0000", 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.501253438, 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050084489999999999, 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1830 2024-04-23T19:01:25.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839244+0000", 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839244+0000", 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839245+0000", 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.283e-06 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839251+0000", 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9630000000000003e-06 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839270+0000", 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9196000000000001e-05 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839286+0000", 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5634e-05 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840344+0000", 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010585659999999999 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840551+0000", 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000206541 2024-04-23T19:01:25.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840826+0000", 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027540600000000001 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843068+0000", 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022418490000000002 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844014+0000", 2024-04-23T19:01:25.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00094583099999999995 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844161+0000", 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014680800000000001 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844252+0000", 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1372000000000005e-05 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.428 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1831 4.35 4:af1d171f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839307+0000", 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.50119058900000002, 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038828809999999999, 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1831 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.429 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839307+0000", 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839307+0000", 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839308+0000", 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.333e-06 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839333+0000", 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5392999999999999e-05 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839385+0000", 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1696000000000001e-05 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839408+0000", 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3173e-05 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839556+0000", 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014753800000000001 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839757+0000", 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000200931 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840712+0000", 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095511800000000003 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842062+0000", 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013503499999999999 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842980+0000", 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00091791799999999999 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843088+0000", 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107759 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843189+0000", 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101672 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:1843 4.34 e53/22 4:2c1d3239:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.7.5:head v 53'7, mlcod=53'5)", 2024-04-23T19:01:25.434 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.982385+0000", 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.35811237899999998, 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00371697, 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982385+0000", 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982385+0000", 2024-04-23T19:01:25.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982386+0000", 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7239999999999999e-06 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982399+0000", 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2986000000000001e-05 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982428+0000", 2024-04-23T19:01:25.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8096999999999999e-05 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982445+0000", 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7770000000000001e-05 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982621+0000", 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000176164 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.982684+0000", 2024-04-23T19:01:25.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3015999999999994e-05 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.985989+0000", 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033047770000000001 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.986102+0000", 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011243600000000001 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1937 4.c 4:3311fddb:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.146191+0000", 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.19430562900000001, 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039143099999999998, 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1937 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146191+0000", 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146191+0000", 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146194+0000", 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4540000000000001e-06 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146209+0000", 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5413e-05 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146248+0000", 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9141999999999999e-05 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146272+0000", 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3710000000000002e-05 2024-04-23T19:01:25.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146368+0000", 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5785999999999994e-05 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146459+0000", 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1305999999999996e-05 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146574+0000", 2024-04-23T19:01:25.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011502699999999999 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.148060+0000", 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001485744 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150053+0000", 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019929909999999999 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150079+0000", 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5902e-05 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150106+0000", 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6835e-05 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1938 4.3d 4:bee3c28b:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.146320+0000", 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.19417753700000001, 2024-04-23T19:01:25.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040283020000000001, 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1938 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146320+0000", 2024-04-23T19:01:25.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146320+0000", 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146321+0000", 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3260000000000001e-06 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146327+0000", 2024-04-23T19:01:25.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3969999999999999e-06 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146350+0000", 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2677e-05 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146366+0000", 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6266e-05 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146463+0000", 2024-04-23T19:01:25.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6595000000000006e-05 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146711+0000", 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024831700000000001 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.147030+0000", 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031911899999999998 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.148134+0000", 2024-04-23T19:01:25.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001103793 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150090+0000", 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019559120000000002 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150221+0000", 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013099100000000001 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150348+0000", 2024-04-23T19:01:25.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126909 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:1936 4.34 e53/22 4:2c1d3239:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.7.5:head v 53'8, mlcod=53'6)", 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.146525+0000", 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.19397234099999999, 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003522205, 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146525+0000", 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146525+0000", 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146526+0000", 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.47e-07 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146532+0000", 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7279999999999998e-06 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146545+0000", 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2787e-05 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146553+0000", 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6359999999999994e-06 2024-04-23T19:01:25.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146956+0000", 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040282099999999998 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146992+0000", 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6633e-05 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150014+0000", 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003022032 2024-04-23T19:01:25.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150047+0000", 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2620999999999998e-05 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.454 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:25.456 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:25.456 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:25.454+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:25.485 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:25.486 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_23_19_01_25 with max size -1 2024-04-23T19:01:25.486 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:25.486 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:25.557 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:25.559+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:25.627 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:25.627 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:25.627 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:25.627 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:25.641 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:25.658 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:25.659+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:25.759 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:25.759+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:25.761 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:25.762 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:25.762 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:25.762 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:25.762 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:25.776 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:25.860 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:25.859+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:25.896 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:25.897 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 62.565444028000002, 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085602839999999996, 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 48 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.898 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331687+0000", 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331702+0000", 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.486e-05 2024-04-23T19:01:25.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331735+0000", 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3272999999999998e-05 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331758+0000", 2024-04-23T19:01:25.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2633000000000002e-05 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331922+0000", 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164356 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332211+0000", 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028900799999999999 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332486+0000", 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275044 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.334812+0000", 2024-04-23T19:01:25.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023258720000000001 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340081+0000", 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052694229999999996 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340176+0000", 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4674999999999997e-05 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340244+0000", 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7726999999999997e-05 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.906 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.586806592999999, 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004746737, 2024-04-23T19:01:25.907 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.908 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.908 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.908 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.908 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.908 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.908 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 205 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:25.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310325+0000", 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6739999999999999e-06 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310342+0000", 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7062999999999999e-05 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310372+0000", 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0116000000000001e-05 2024-04-23T19:01:25.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310395+0000", 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3025999999999999e-05 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310720+0000", 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000325242 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311086+0000", 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036572699999999999 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311891+0000", 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080526000000000003 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.313563+0000", 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001672251 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314820+0000", 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001256783 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314965+0000", 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144699 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.315068+0000", 2024-04-23T19:01:25.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102896 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:344 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.434415809000001, 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040128489999999998, 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 344 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462715+0000", 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7530000000000002e-06 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462725+0000", 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0334e-05 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462750+0000", 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4646000000000001e-05 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462779+0000", 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9886000000000002e-05 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462929+0000", 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014975599999999999 2024-04-23T19:01:25.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463152+0000", 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022302499999999999 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463707+0000", 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00055493600000000001 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465489+0000", 2024-04-23T19:01:25.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017817460000000001 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466471+0000", 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098237600000000008 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466620+0000", 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878600000000001 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466725+0000", 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010460500000000001 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:378 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.427587238000001, 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045344950000000004, 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.925 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 378 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469543+0000", 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3800000000000001e-06 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469558+0000", 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5216e-05 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469592+0000", 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4276999999999997e-05 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469612+0000", 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9973e-05 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469788+0000", 2024-04-23T19:01:25.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017606800000000001 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469994+0000", 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020596500000000001 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.470297+0000", 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000303145 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471492+0000", 2024-04-23T19:01:25.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011943139999999999 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473878+0000", 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002386371 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473972+0000", 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3603000000000005e-05 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474075+0000", 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103183 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:467 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.377630644, 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040446919999999999, 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.931 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 467 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:25.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519499+0000", 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519510+0000", 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1073000000000001e-05 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519539+0000", 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.885e-05 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519553+0000", 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4073000000000001e-05 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519679+0000", 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012514500000000001 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519800+0000", 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121048 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520138+0000", 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033848299999999999 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.521245+0000", 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011068479999999999 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523318+0000", 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020726669999999998 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523451+0000", 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013325300000000001 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523542+0000", 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0811999999999997e-05 2024-04-23T19:01:25.936 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:512 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.352426258999998, 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046289160000000003, 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 512 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544703+0000", 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544714+0000", 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1036000000000001e-05 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544743+0000", 2024-04-23T19:01:25.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9096000000000001e-05 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544764+0000", 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0273999999999999e-05 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544903+0000", 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139147 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545058+0000", 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015533499999999999 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545435+0000", 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037699499999999998 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546776+0000", 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013404840000000001 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549119+0000", 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002342939 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549255+0000", 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013645399999999999 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549330+0000", 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5181999999999999e-05 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.942 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:513 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'5, mlcod=32'3)", 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.350974067999999, 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005799584, 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546155+0000", 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.815e-06 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546169+0000", 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3691e-05 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546201+0000", 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546221+0000", 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0462000000000002e-05 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546368+0000", 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014708500000000001 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546409+0000", 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0970000000000002e-05 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551835+0000", 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054259850000000004 2024-04-23T19:01:25.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551953+0000", 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117716 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1076 4.32 4:4dfd0dc5:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3721867129999996, 2024-04-23T19:01:25.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072734380000000001, 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1076 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:25.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524942+0000", 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4139999999999999e-06 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524950+0000", 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1389999999999995e-06 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524968+0000", 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980999999999999e-05 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524994+0000", 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5633e-05 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525155+0000", 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016075799999999999 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525403+0000", 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024827699999999998 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525709+0000", 2024-04-23T19:01:25.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030619600000000001 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.528078+0000", 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023689760000000001 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.531940+0000", 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038613710000000002 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532090+0000", 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015073500000000001 2024-04-23T19:01:25.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532214+0000", 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012395799999999999 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1083 4.32 4:4e794105:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.37207816, 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080107340000000003, 2024-04-23T19:01:25.953 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1083 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525050+0000", 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7399999999999991e-07 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525056+0000", 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3399999999999997e-06 2024-04-23T19:01:25.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525072+0000", 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6308999999999999e-05 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525081+0000", 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4999999999999999e-06 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526456+0000", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013756829999999999 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526821+0000", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036475100000000002 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527313+0000", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049206800000000002 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532390+0000", 2024-04-23T19:01:25.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050770650000000004 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532903+0000", 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00051322599999999998 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532990+0000", 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7132000000000005e-05 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.533060+0000", 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9685999999999997e-05 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1086 4.25 4:a7d96929:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3714702040000004, 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.007062975, 2024-04-23T19:01:25.959 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1086 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525659+0000", 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2100000000000001e-06 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525670+0000", 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.118e-05 2024-04-23T19:01:25.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525684+0000", 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525697+0000", 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2456000000000001e-05 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525779+0000", 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2269999999999997e-05 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525929+0000", 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014989300000000001 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526117+0000", 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018751400000000001 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527644+0000", 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001527612 2024-04-23T19:01:25.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532623+0000", 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049787410000000001 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532676+0000", 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3615000000000001e-05 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532720+0000", 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.388e-05 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.0360192079999999, 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.965 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:25.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.970 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1113 3.28 3:171e86a1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.0111028539999998, 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019880546999999998, 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.971 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1113 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886026+0000", 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3300000000000001e-07 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889886+0000", 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599490000000001 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889908+0000", 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2824e-05 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889918+0000", 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.893e-06 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890103+0000", 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018468900000000001 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890374+0000", 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027112300000000001 2024-04-23T19:01:25.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.891238+0000", 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086359200000000005 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.902456+0000", 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011218271 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905711+0000", 2024-04-23T19:01:25.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032550919999999998 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905828+0000", 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117365 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905905+0000", 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6915999999999993e-05 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4646.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796980963920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.8960668910000003, 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045538920000000004, 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4646", 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:25.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001062+0000", 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6729999999999999e-06 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001071+0000", 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4640000000000006e-06 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001110+0000", 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8798999999999999e-05 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001126+0000", 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6364000000000001e-05 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001227+0000", 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100945 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001380+0000", 2024-04-23T19:01:25.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153361 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001601+0000", 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000220824 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.003537+0000", 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019358120000000001 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005193+0000", 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001655672 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005387+0000", 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000194787 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005615+0000", 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022719099999999999 2024-04-23T19:01:25.982 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901328134912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3246609449999998, 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048685860000000003, 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:25.983 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572469+0000", 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.869e-06 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572477+0000", 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6940000000000001e-06 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572503+0000", 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5822000000000001e-05 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572519+0000", 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6433999999999999e-05 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572618+0000", 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8214999999999994e-05 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572731+0000", 2024-04-23T19:01:25.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113315 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572931+0000", 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019991599999999999 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.573759+0000", 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00082765300000000003 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577202+0000", 2024-04-23T19:01:25.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034436190000000002 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577256+0000", 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3665000000000002e-05 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577335+0000", 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9383999999999998e-05 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.988 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1246 3.28 3:16f1103d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.057364314, 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019343636000000001, 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:25.989 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1246 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839765+0000", 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7740000000000001e-06 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843622+0000", 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038567240000000002 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843645+0000", 2024-04-23T19:01:25.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2914000000000001e-05 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843654+0000", 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1609999999999992e-06 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843718+0000", 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4377999999999999e-05 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843848+0000", 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012942100000000001 2024-04-23T19:01:25.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.844251+0000", 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403772 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.856774+0000", 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012522995 2024-04-23T19:01:25.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.858917+0000", 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021430659999999999 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.859031+0000", 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113486 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.859107+0000", 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5945000000000006e-05 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363203577120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:25.996 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.949175887, 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042896130000000003, 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:25.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:25.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947953+0000", 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6099999999999999e-07 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:25.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947957+0000", 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4580000000000003e-06 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947971+0000", 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.385e-05 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947980+0000", 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7280000000000001e-06 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948046+0000", 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5995999999999996e-05 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948160+0000", 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114815 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948362+0000", 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020172000000000001 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.949000+0000", 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00063831000000000001 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952086+0000", 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030852050000000002 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952160+0000", 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4568999999999997e-05 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952241+0000", 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100999999999995e-05 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.003 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1348 4.36 4:6f4c9504:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.640422177, 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041593339999999998, 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1348 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256707+0000", 2024-04-23T19:01:26.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3769999999999999e-06 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256715+0000", 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5529999999999993e-06 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256737+0000", 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1297e-05 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256760+0000", 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3173e-05 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256887+0000", 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012725099999999999 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257082+0000", 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195334 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257527+0000", 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044436500000000001 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.259546+0000", 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002019074 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260800+0000", 2024-04-23T19:01:26.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012539439999999999 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260836+0000", 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6529999999999998e-05 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260865+0000", 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8436e-05 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1825 4.38 4:1f7cfc2f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.05806625, 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005534153, 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1825 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839064+0000", 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.283e-06 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839074+0000", 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.059e-05 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839109+0000", 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5039000000000001e-05 2024-04-23T19:01:26.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839131+0000", 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1929999999999998e-05 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839357+0000", 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000226204 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839578+0000", 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022065400000000001 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839841+0000", 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026246 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842547+0000", 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002706539 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844315+0000", 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017682380000000001 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844480+0000", 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164594 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844596+0000", 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115622 2024-04-23T19:01:26.015 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1953 4.36 4:6d01787f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.610101479, 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068941840000000002, 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1953 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287027+0000", 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1489999999999999e-06 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287034+0000", 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6039999999999998e-06 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287053+0000", 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9598000000000001e-05 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287062+0000", 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7730000000000005e-06 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287194+0000", 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013187100000000001 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287324+0000", 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129527 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287487+0000", 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016380600000000001 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288505+0000", 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010178979999999999 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293813+0000", 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005308012 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293875+0000", 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1163999999999999e-05 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293920+0000", 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5782000000000003e-05 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.021 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2046 4.36 4:6d01787f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.42607768800000001, 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041496939999999998, 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.022 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2046 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471052+0000", 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471062+0000", 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0144e-05 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471104+0000", 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1705999999999997e-05 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471125+0000", 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1588999999999999e-05 2024-04-23T19:01:26.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471325+0000", 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019935499999999999 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471531+0000", 2024-04-23T19:01:26.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020597700000000001 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471811+0000", 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028025000000000001 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.473852+0000", 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020408269999999998 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475005+0000", 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001153449 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475116+0000", 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110306 2024-04-23T19:01:26.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475200+0000", 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3987999999999996e-05 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.029 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:01:26.032 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:26.032 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:26.030+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:26.133 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:26.131+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:26.202 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:26.202 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:26.216 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:26.232 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:26.235+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:26.333 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:26.333 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:26.334 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:26.334 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:26.334 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:26.334 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:26.335+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:26.347 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:26.434 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:26.435+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:26.475 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:26.475 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:26.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:26.475 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:26.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.475 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4452.0:36 5.9 e25/24 5:90f831dc:::zone_info.2fe9869b-25a1-4b09-be2c-4e9208a04c5d:head v 25'1, mlcod=0'0)", 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.136104918000001, 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038336279999999999, 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339270+0000", 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0900000000000002e-07 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339278+0000", 2024-04-23T19:01:26.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1200000000000002e-06 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339294+0000", 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6725e-05 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339311+0000", 2024-04-23T19:01:26.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:01:26.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339445+0000", 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013386600000000001 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339497+0000", 2024-04-23T19:01:26.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1471999999999998e-05 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343010+0000", 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035131630000000001 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343103+0000", 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3076000000000001e-05 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.164238685000001, 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:26.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:26.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:26.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:26.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:26.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.492 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253696271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.143726749999999, 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056192660000000004, 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.493 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331650+0000", 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.977e-06 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331663+0000", 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2255999999999999e-05 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331694+0000", 2024-04-23T19:01:26.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1250000000000001e-05 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331714+0000", 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9874e-05 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331876+0000", 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016204500000000001 2024-04-23T19:01:26.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332107+0000", 2024-04-23T19:01:26.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000231072 2024-04-23T19:01:26.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333144+0000", 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001037615 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.335757+0000", 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026121959999999998 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336906+0000", 2024-04-23T19:01:26.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001149478 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337056+0000", 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000149722 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337267+0000", 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000210781 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:465 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.958392287000002, 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038716359999999999, 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516983+0000", 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0300000000000001e-06 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516991+0000", 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1329999999999999e-06 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517005+0000", 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3720000000000001e-05 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517019+0000", 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4773000000000001e-05 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517142+0000", 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012258200000000001 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517196+0000", 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3582999999999998e-05 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520763+0000", 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035673900000000001 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520853+0000", 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0425000000000002e-05 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.503 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:466 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.955505961999997, 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037160069999999999, 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519869+0000", 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.347e-06 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519880+0000", 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0406e-05 2024-04-23T19:01:26.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519908+0000", 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7872999999999999e-05 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519921+0000", 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2962999999999999e-05 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520041+0000", 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120579 2024-04-23T19:01:26.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520093+0000", 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2231000000000002e-05 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523472+0000", 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00337858 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523584+0000", 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011202800000000001 2024-04-23T19:01:26.507 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.953304099, 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041565439999999999, 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522071+0000", 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4640000000000001e-06 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522082+0000", 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0566e-05 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522106+0000", 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4502999999999999e-05 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522124+0000", 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522233+0000", 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108633 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522268+0000", 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5200000000000002e-05 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526155+0000", 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038872030000000001 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526227+0000", 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1248999999999995e-05 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1210 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1376022170000004, 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067467129999999997, 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.512 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1210 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337774+0000", 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.72e-06 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337780+0000", 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2339999999999999e-06 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337794+0000", 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4217e-05 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337802+0000", 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100000000000003e-06 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337903+0000", 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101047 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338041+0000", 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013782399999999999 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338256+0000", 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215467 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.339632+0000", 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013758970000000001 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344441+0000", 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004809064 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344482+0000", 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0428e-05 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344519+0000", 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6705000000000002e-05 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1216 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.137480987, 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067969930000000003, 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1216 2024-04-23T19:01:26.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337894+0000", 2024-04-23T19:01:26.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8199999999999999e-07 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337898+0000", 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3749999999999996e-06 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337908+0000", 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0292000000000001e-05 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337917+0000", 2024-04-23T19:01:26.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2069999999999995e-06 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338539+0000", 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00062252800000000001 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338640+0000", 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100412 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338785+0000", 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014592899999999999 2024-04-23T19:01:26.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.340035+0000", 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001249411 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344619+0000", 2024-04-23T19:01:26.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045837100000000004 2024-04-23T19:01:26.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344656+0000", 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7694999999999997e-05 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344690+0000", 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3751999999999998e-05 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.8981923280000004, 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056182469999999998, 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.527 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:26.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577183+0000", 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4099999999999997e-07 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577187+0000", 2024-04-23T19:01:26.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8959999999999996e-06 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577198+0000", 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1535000000000001e-05 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577204+0000", 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7729999999999996e-06 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577285+0000", 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0679999999999993e-05 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577370+0000", 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5883000000000004e-05 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577457+0000", 2024-04-23T19:01:26.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6501000000000004e-05 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.578218+0000", 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076112900000000004 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582735+0000", 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045166909999999998 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582772+0000", 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7514e-05 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582800+0000", 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7704000000000001e-05 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4715.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94883869179184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7363454730000001, 2024-04-23T19:01:26.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041245029999999998, 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4715", 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/251614066", 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 68 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739031+0000", 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0269999999999998e-06 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739038+0000", 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6480000000000003e-06 2024-04-23T19:01:26.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739060+0000", 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2041000000000001e-05 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739070+0000", 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2660000000000007e-06 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739168+0000", 2024-04-23T19:01:26.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8647000000000006e-05 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739240+0000", 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2275999999999997e-05 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739412+0000", 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017175 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.740367+0000", 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095455300000000002 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.742977+0000", 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026103229999999999 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.743050+0000", 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3231000000000004e-05 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.743153+0000", 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102741 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.5234483789999995, 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058651459999999999, 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.539 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951927+0000", 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.426e-06 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951932+0000", 2024-04-23T19:01:26.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2449999999999998e-06 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951949+0000", 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6197000000000001e-05 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951960+0000", 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1430000000000001e-05 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952028+0000", 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7764999999999999e-05 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952128+0000", 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9846999999999995e-05 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952275+0000", 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014731799999999999 2024-04-23T19:01:26.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.953530+0000", 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012555890000000001 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957674+0000", 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041432489999999999 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957727+0000", 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3266999999999997e-05 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957791+0000", 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3812999999999994e-05 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1327 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:26.545 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.4008361249999997, 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041744629999999998, 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1327 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074541+0000", 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8849999999999999e-06 2024-04-23T19:01:26.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074547+0000", 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6499999999999999e-06 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074562+0000", 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4673e-05 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074570+0000", 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5410000000000003e-06 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074626+0000", 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.6140999999999997e-05 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074701+0000", 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5227000000000003e-05 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074805+0000", 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010398 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075985+0000", 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011795760000000001 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078636+0000", 2024-04-23T19:01:26.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002651811 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078680+0000", 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3813999999999998e-05 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078712+0000", 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2165000000000001e-05 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1333 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.4007408970000004, 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044982269999999996, 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1333 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.552 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074634+0000", 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8400000000000004e-07 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074637+0000", 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.898e-06 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074643+0000", 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7780000000000002e-06 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074649+0000", 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7400000000000001e-06 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074762+0000", 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112959 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074976+0000", 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213687 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075329+0000", 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000353426 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.076812+0000", 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014828899999999999 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079040+0000", 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022278340000000002 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079093+0000", 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.287e-05 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079131+0000", 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8560999999999999e-05 2024-04-23T19:01:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1349 4.3c 4:3d2e0823:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256595+0000", 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.2187787190000003, 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041180310000000003, 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1349 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256595+0000", 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256595+0000", 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256597+0000", 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.75e-06 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256605+0000", 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9519999999999994e-06 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256621+0000", 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6195999999999999e-05 2024-04-23T19:01:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256629+0000", 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4919999999999996e-06 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256709+0000", 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0179999999999995e-05 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256907+0000", 2024-04-23T19:01:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000197868 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257190+0000", 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028284300000000002 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.258158+0000", 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00096825700000000004 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260638+0000", 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002480215 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260680+0000", 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1950999999999999e-05 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260713+0000", 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3327000000000001e-05 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.5211.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.750425+0000", 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.7249495050000001, 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039809090000000004, 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.5211", 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1763254879", 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750425+0000", 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750425+0000", 2024-04-23T19:01:26.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750427+0000", 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1069999999999999e-06 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750436+0000", 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0459999999999994e-06 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750465+0000", 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8969999999999999e-05 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750479+0000", 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.43e-05 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750601+0000", 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121758 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750727+0000", 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012597899999999999 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750908+0000", 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018145699999999999 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.752072+0000", 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001163615 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.754216+0000", 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021443230000000001 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.754296+0000", 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9929e-05 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.754405+0000", 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109425 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.569 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1828 4.3c 4:3c9611cc:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.636331462, 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043086649999999997, 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.570 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1828 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839044+0000", 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.703e-06 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839054+0000", 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2099999999999999e-06 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839077+0000", 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3544e-05 2024-04-23T19:01:26.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839095+0000", 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7856e-05 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839361+0000", 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000266216 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839575+0000", 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213594 2024-04-23T19:01:26.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839864+0000", 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028965000000000002 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842214+0000", 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00235002 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843075+0000", 2024-04-23T19:01:26.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086051599999999997 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843282+0000", 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020680399999999999 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843351+0000", 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9552000000000001e-05 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1832 4.5 4:a211101a:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.6362413199999999, 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044515809999999996, 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1832 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839134+0000", 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.207e-06 2024-04-23T19:01:26.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839141+0000", 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9929999999999998e-06 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839172+0000", 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1346000000000001e-05 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839274+0000", 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101822 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839518+0000", 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000244114 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839728+0000", 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020958700000000001 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840016+0000", 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028844999999999999 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842977+0000", 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002960786 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843329+0000", 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035216199999999999 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843476+0000", 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014658800000000001 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843584+0000", 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108526 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.5232.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.938125+0000", 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.5372492260000001, 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040466770000000003, 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.5232", 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3466563576", 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:26.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938125+0000", 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938125+0000", 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938126+0000", 2024-04-23T19:01:26.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.119e-06 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938131+0000", 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7190000000000001e-06 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938145+0000", 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4513e-05 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938153+0000", 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5689999999999999e-06 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938228+0000", 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5335999999999998e-05 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938298+0000", 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9432999999999997e-05 2024-04-23T19:01:26.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938411+0000", 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011367899999999999 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.940280+0000", 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00186878 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.942093+0000", 2024-04-23T19:01:26.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018125369999999999 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.942133+0000", 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0911000000000002e-05 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.942172+0000", 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8080999999999997e-05 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1948 4.20 4:04fe9b97:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.188401544, 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043859700000000003, 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1948 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286975+0000", 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0339999999999999e-06 2024-04-23T19:01:26.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286982+0000", 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0870000000000001e-06 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287006+0000", 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4607999999999999e-05 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287018+0000", 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1260000000000001e-05 2024-04-23T19:01:26.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287104+0000", 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6796e-05 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287326+0000", 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022200900000000001 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:26.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287568+0000", 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024147 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288970+0000", 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014020219999999999 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291283+0000", 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023136490000000001 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291327+0000", 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3058e-05 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291358+0000", 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2041 4.20 4:04fe9b97:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:26.593 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471031+0000", 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.004342826, 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040386420000000003, 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2041 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:26.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471031+0000", 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471031+0000", 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471034+0000", 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6599999999999999e-06 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471046+0000", 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2176e-05 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471076+0000", 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0107000000000002e-05 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471093+0000", 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7070000000000001e-05 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471279+0000", 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018535000000000001 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471508+0000", 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022973399999999999 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471806+0000", 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029814000000000002 2024-04-23T19:01:26.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.473662+0000", 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001855759 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474883+0000", 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001220718 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:26.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475007+0000", 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012433499999999999 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475070+0000", 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2593000000000002e-05 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:26.599 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:26.601 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:26.601 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:26.598+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:26.702 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:26.702+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:26.745 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:26.770 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:26.771 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:26.771 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:26.771 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:26.784 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:26.791 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records in 2024-04-23T19:01:26.791 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records out 2024-04-23T19:01:26.791 INFO:tasks.workunit.client.0.smithi169.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.30411 s, 1.6 GB/s 2024-04-23T19:01:26.830 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:26.830+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:26.891 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:26.891 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:26.904 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:26.902+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:26.910 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:26.910 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:26.928 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:26.929 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:26.946 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_26 2024-04-23T19:01:26.947 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:26.947 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:26.961 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:26.962 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:26.962 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:26.962 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:26.962 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:26.967 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:26.967 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:26.977 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:26.989 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:26.989 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:27.011 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:27.012 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:27.018 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:27.018+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:27.031 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:27.031 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:27.072 INFO:tasks.workunit.client.0.smithi169.stdout:quota set for the bucket: buck_2024_03_23_19_01_26 2024-04-23T19:01:27.106 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:27.107+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:27.146 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.146 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:27.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:27.212 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:27.215+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:27.278 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.278 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:27.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:27.333 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:27.335+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:27.409 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:27.410+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:27.448 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.448 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:27.461 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:27.510 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:27.510+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:27.583 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.583 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:27.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:27.640 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:27.643+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:27.704 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.705 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:27.712 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:27.710+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:27.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:27.813 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:27.810+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:27.873 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.873 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:27.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:27.932 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:27.935+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:27.996 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:27.996 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:28.034 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:01:28.053 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:28.055+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:28.115 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:28.114+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:28.165 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:28.165 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:28.216 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:28.214+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:28.291 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:28.292 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:28.348 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:28.351+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:28.415 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:28.415 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.418 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:28.419+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:28.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:28.518 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:28.519+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:28.580 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:28.581 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:28.637 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:28.639+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:28.720 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:28.718+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:28.760 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:28.760 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:28.821 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:28.823+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:28.892 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:28.893 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:28.906 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:28.950 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:28.950+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:28.989 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:01:29.023 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:29.023+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:29.042 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:29.042 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:29.050 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:29.056 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:29.123 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:29.123+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:29.187 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:29.187 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:29.203 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:29.204 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:29.220 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:29.220 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:29.220 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:29.221 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:29.234 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:29.236 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:29.236 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:29.254 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:29.254 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:29.257 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:29.223+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:29.272 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:29.273 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:29.291 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:29.309 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:29.309 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:29.324 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:29.322+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 68.076366039999996, 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013567132000000001, 2024-04-23T19:01:29.363 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "reached pg", 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 43 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287242+0000", 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287246+0000", 2024-04-23T19:01:29.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287264+0000", 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8057e-05 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287308+0000", 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4305999999999999e-05 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287339+0000", 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0586000000000002e-05 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287542+0000", 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020379600000000001 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.287561+0000", 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8933e-05 2024-04-23T19:01:29.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290847+0000", 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032856209999999999 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.290866+0000", 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9176000000000001e-05 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300494+0000", 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096278960000000004 2024-04-23T19:01:29.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:21.300809+0000", 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031514800000000001 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 66.038926576999998, 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00551514, 2024-04-23T19:01:29.369 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324681+0000", 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324683+0000", 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9e-06 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324699+0000", 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324728+0000", 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9119999999999999e-05 2024-04-23T19:01:29.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324750+0000", 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2512999999999999e-05 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324873+0000", 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012215500000000001 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324917+0000", 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4539999999999997e-05 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330069+0000", 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051520569999999998 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330197+0000", 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012738199999999999 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.373 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.021686017, 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011915968000000001, 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 211 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341922+0000", 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341926+0000", 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1099999999999996e-06 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341945+0000", 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9000000000000001e-05 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.341993+0000", 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7503000000000002e-05 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342018+0000", 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5593e-05 2024-04-23T19:01:29.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342181+0000", 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016242599999999999 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.342191+0000", 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.078e-05 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.349751+0000", 2024-04-23T19:01:29.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075600240000000003 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350006+0000", 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025478499999999999 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.350549+0000", 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054278300000000002 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353220+0000", 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026713230000000002 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353616+0000", 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525699999999999 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353719+0000", 2024-04-23T19:01:29.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102935 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.353838+0000", 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119449 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:282 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'1, mlcod=0'0)", 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:29.380 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 62.910696512999998, 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044810049999999997, 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452912+0000", 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452913+0000", 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.61e-06 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452928+0000", 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4725999999999999e-05 2024-04-23T19:01:29.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452961+0000", 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2987000000000001e-05 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.452980+0000", 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9130000000000001e-05 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453231+0000", 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025115800000000002 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.453282+0000", 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0399999999999999e-05 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457272+0000", 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039908950000000004 2024-04-23T19:01:29.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.457393+0000", 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120099 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:436 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 62.864055016999998, 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044919260000000003, 2024-04-23T19:01:29.385 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 436 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499553+0000", 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499555+0000", 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3070000000000001e-06 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499568+0000", 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2493e-05 2024-04-23T19:01:29.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499602+0000", 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4146999999999997e-05 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499616+0000", 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4523e-05 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499751+0000", 2024-04-23T19:01:29.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013462200000000001 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.499929+0000", 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177982 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.500410+0000", 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00048108299999999999 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.501598+0000", 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011874069999999999 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503787+0000", 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021889470000000001 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.503944+0000", 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157276 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.504045+0000", 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101139 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 62.818440471999999, 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072361279999999997, 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.391 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 513 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545168+0000", 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545170+0000", 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3120000000000001e-06 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545182+0000", 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2411e-05 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545214+0000", 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2217e-05 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545231+0000", 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6773999999999999e-05 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545374+0000", 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014263700000000001 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545518+0000", 2024-04-23T19:01:29.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014400900000000001 2024-04-23T19:01:29.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545965+0000", 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044757100000000001 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549086+0000", 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031200540000000001 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552249+0000", 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031637530000000001 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552336+0000", 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6953000000000006e-05 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.552404+0000", 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7436999999999998e-05 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.399 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1111 3.1a 3:5847a424:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.866186+0000", 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.4974222590000004, 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016766961, 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.400 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1111 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866186+0000", 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866186+0000", 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866189+0000", 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4800000000000001e-06 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.872847+0000", 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066574759999999998 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.872903+0000", 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5998999999999997e-05 2024-04-23T19:01:29.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.872931+0000", 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8296000000000001e-05 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.873049+0000", 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118312 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.873269+0000", 2024-04-23T19:01:29.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021922700000000001 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.873464+0000", 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195811 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.881511+0000", 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080466240000000005 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882831+0000", 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013201459999999999 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882887+0000", 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5847999999999998e-05 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882953+0000", 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5741999999999995e-05 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.405 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1217 4.3d 4:bf1584ff:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337888+0000", 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0257198039999995, 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041428300000000001, 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1217 2024-04-23T19:01:29.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337888+0000", 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337888+0000", 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337889+0000", 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0999999999999997e-07 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337894+0000", 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0429999999999998e-06 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337906+0000", 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.147e-05 2024-04-23T19:01:29.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337914+0000", 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5539999999999998e-06 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338561+0000", 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00064736999999999998 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338709+0000", 2024-04-23T19:01:29.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014705799999999999 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338876+0000", 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016780300000000001 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.339737+0000", 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086046500000000004 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.341975+0000", 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022377899999999999 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.342004+0000", 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9855000000000001e-05 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.342031+0000", 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6611999999999999e-05 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.411 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1345 4.c 4:329c90a2:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256550+0000", 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.107057985, 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045595339999999996, 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.412 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1345 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256550+0000", 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256550+0000", 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256553+0000", 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3629999999999998e-06 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256569+0000", 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5509999999999999e-05 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256606+0000", 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7329999999999997e-05 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256629+0000", 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3088999999999999e-05 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256731+0000", 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101587 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256882+0000", 2024-04-23T19:01:29.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015081599999999999 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257050+0000", 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167935 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257909+0000", 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00085946999999999998 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.261044+0000", 2024-04-23T19:01:29.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031346519999999999 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.261074+0000", 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0602999999999998e-05 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.261110+0000", 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5179000000000003e-05 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1731 4.1a 4:58ba57b6:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.631465+0000", 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.732143153, 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044473270000000001, 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1731 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.418 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631465+0000", 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631465+0000", 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631467+0000", 2024-04-23T19:01:29.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0930000000000001e-06 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631476+0000", 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6500000000000002e-06 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631496+0000", 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0869e-05 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631514+0000", 2024-04-23T19:01:29.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7147e-05 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631752+0000", 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000238507 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632055+0000", 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030290200000000002 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632564+0000", 2024-04-23T19:01:29.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00050908099999999999 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635200+0000", 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026361930000000002 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635680+0000", 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047947099999999998 2024-04-23T19:01:29.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635808+0000", 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127885 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635912+0000", 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104529 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.423 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1737 4.22 4:4775d094:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.631557+0000", 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7320513980000003, 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056345149999999997, 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1737 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631557+0000", 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631557+0000", 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631558+0000", 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.567e-06 2024-04-23T19:01:29.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631566+0000", 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4830000000000002e-06 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631695+0000", 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129185 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631721+0000", 2024-04-23T19:01:29.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6489999999999999e-05 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631904+0000", 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018289399999999999 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632214+0000", 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030974900000000001 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.632598+0000", 2024-04-23T19:01:29.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038404200000000002 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.634708+0000", 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021101340000000001 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.637023+0000", 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00231533 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.637130+0000", 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010656499999999999 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.637191+0000", 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1075999999999996e-05 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1738 4.35 4:af1d171f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.429 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.631800+0000", 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7318083580000003, 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005052773, 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1738 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631800+0000", 2024-04-23T19:01:29.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631800+0000", 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631802+0000", 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631814+0000", 2024-04-23T19:01:29.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2386e-05 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631840+0000", 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5522999999999999e-05 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.631867+0000", 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7257e-05 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.633231+0000", 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001363932 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.633584+0000", 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035364899999999999 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.634044+0000", 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00045957399999999997 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.635965+0000", 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019206259999999999 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.636637+0000", 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00067254800000000003 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.636751+0000", 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114045 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.636852+0000", 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101259 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1822 4.18 4:18db89aa:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839049+0000", 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.52455856, 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051059490000000003, 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.435 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1822 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839049+0000", 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839049+0000", 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839052+0000", 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4499999999999998e-06 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839062+0000", 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9299999999999998e-06 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839095+0000", 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3612999999999998e-05 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839110+0000", 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5036e-05 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839254+0000", 2024-04-23T19:01:29.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143542 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839505+0000", 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025109999999999998 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839781+0000", 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027574300000000001 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842157+0000", 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023764530000000002 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843974+0000", 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018171540000000001 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844055+0000", 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0609e-05 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844155+0000", 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100319 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1830 4.22 4:4775d094:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839244+0000", 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.524364362, 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050084489999999999, 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.441 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1830 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839244+0000", 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839244+0000", 2024-04-23T19:01:29.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839245+0000", 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.283e-06 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839251+0000", 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9630000000000003e-06 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839270+0000", 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9196000000000001e-05 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839286+0000", 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5634e-05 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840344+0000", 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010585659999999999 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840551+0000", 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000206541 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840826+0000", 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027540600000000001 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843068+0000", 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022418490000000002 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844014+0000", 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00094583099999999995 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844161+0000", 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014680800000000001 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844252+0000", 2024-04-23T19:01:29.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1372000000000005e-05 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1938 4.3d 4:bee3c28b:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.146320+0000", 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.2172884609999999, 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040283020000000001, 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.447 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1938 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146320+0000", 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146320+0000", 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146321+0000", 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3260000000000001e-06 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146327+0000", 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3969999999999999e-06 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146350+0000", 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2677e-05 2024-04-23T19:01:29.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146366+0000", 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6266e-05 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146463+0000", 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6595000000000006e-05 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.146711+0000", 2024-04-23T19:01:29.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024831700000000001 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.147030+0000", 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031911899999999998 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.148134+0000", 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001103793 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150090+0000", 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019559120000000002 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150221+0000", 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013099100000000001 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.150348+0000", 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126909 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.452 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1956 4.2e 4:778e757d:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.287091+0000", 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.0765168909999998, 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073127360000000002, 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.453 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1956 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287091+0000", 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287091+0000", 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287092+0000", 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7899999999999998e-07 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287096+0000", 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1880000000000004e-06 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287105+0000", 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0699999999999996e-06 2024-04-23T19:01:29.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287113+0000", 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3569999999999998e-06 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287817+0000", 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00070361800000000004 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287948+0000", 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013047699999999999 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288113+0000", 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000165575 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.289103+0000", 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098941799999999994 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.294267+0000", 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051641389999999999 2024-04-23T19:01:29.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.294344+0000", 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7521999999999994e-05 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.294404+0000", 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9692999999999999e-05 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1957 4.1a 4:58dadc62:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.287144+0000", 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.0764638089999998, 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070545520000000004, 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1957 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.460 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287144+0000", 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287144+0000", 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287145+0000", 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9500000000000002e-07 2024-04-23T19:01:29.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287149+0000", 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6179999999999997e-06 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287157+0000", 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.763e-06 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287164+0000", 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6869999999999997e-06 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287227+0000", 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3466000000000005e-05 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287363+0000", 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013542400000000001 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:29.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287523+0000", 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015981799999999999 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.289077+0000", 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015549120000000001 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.294083+0000", 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050053190000000003 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.294151+0000", 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8551000000000001e-05 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.294199+0000", 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7398999999999998e-05 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2045 4.e 4:726cf53a:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471059+0000", 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.892548965, 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003936157, 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2045 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471059+0000", 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471059+0000", 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471062+0000", 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.497e-06 2024-04-23T19:01:29.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471074+0000", 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2207e-05 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471114+0000", 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0321999999999998e-05 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471139+0000", 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5282999999999998e-05 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471338+0000", 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019831800000000001 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471550+0000", 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021185099999999999 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471824+0000", 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027480199999999999 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.473373+0000", 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001549031 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474796+0000", 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014231020000000001 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474916+0000", 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119295 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474995+0000", 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9449000000000005e-05 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.471 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2049 4.2e 4:778e757d:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471202+0000", 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.892405777, 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065287549999999998, 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2049 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471202+0000", 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471202+0000", 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471204+0000", 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5069999999999999e-06 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471213+0000", 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7770000000000008e-06 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471237+0000", 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4620000000000001e-05 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471254+0000", 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7348999999999999e-05 2024-04-23T19:01:29.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471522+0000", 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026726700000000001 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471749+0000", 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022745999999999999 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.472066+0000", 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031709300000000001 2024-04-23T19:01:29.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474398+0000", 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023317170000000001 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.477591+0000", 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031927399999999999 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.477670+0000", 2024-04-23T19:01:29.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9425000000000006e-05 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.477731+0000", 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0800000000000001e-05 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2050 4.1a 4:58dadc62:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471329+0000", 2024-04-23T19:01:29.477 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.8922786509999998, 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009277235, 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2050 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471329+0000", 2024-04-23T19:01:29.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471329+0000", 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471331+0000", 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4470000000000001e-06 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:29.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471339+0000", 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0390000000000005e-06 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471367+0000", 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7746000000000002e-05 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471385+0000", 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.827e-05 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471506+0000", 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120909 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471752+0000", 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024651000000000002 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.472032+0000", 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027981000000000002 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474427+0000", 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002395126 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.480415+0000", 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059873000000000001 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.480533+0000", 2024-04-23T19:01:29.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118539 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.480607+0000", 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3539000000000002e-05 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:29.483 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:29.485 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:29.485 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:29.482+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:29.586 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:29.586+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:29.653 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:29.653 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:29.653 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:29.653 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:29.668 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:29.714 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:29.714+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:29.788 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:29.785+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:29.839 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:29.840 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:29.840 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:29.840 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:29.840 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:29.853 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:29.902 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:29.901+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:29.990 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:29.989+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 66.692044867999996, 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085602839999999996, 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.023 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 48 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331687+0000", 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331702+0000", 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.486e-05 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331735+0000", 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3272999999999998e-05 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331758+0000", 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2633000000000002e-05 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331922+0000", 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164356 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332211+0000", 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028900799999999999 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332486+0000", 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275044 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.334812+0000", 2024-04-23T19:01:30.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023258720000000001 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340081+0000", 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052694229999999996 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340176+0000", 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4674999999999997e-05 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340244+0000", 2024-04-23T19:01:30.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7726999999999997e-05 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.713407433, 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004746737, 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.029 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 205 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:30.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310325+0000", 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6739999999999999e-06 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310342+0000", 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7062999999999999e-05 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310372+0000", 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0116000000000001e-05 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310395+0000", 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3025999999999999e-05 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310720+0000", 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000325242 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311086+0000", 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036572699999999999 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311891+0000", 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080526000000000003 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.313563+0000", 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001672251 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314820+0000", 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001256783 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314965+0000", 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144699 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.315068+0000", 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102896 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.034 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:344 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.561016649000003, 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040128489999999998, 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.035 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 344 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462715+0000", 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7530000000000002e-06 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462725+0000", 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0334e-05 2024-04-23T19:01:30.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462750+0000", 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4646000000000001e-05 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462779+0000", 2024-04-23T19:01:30.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9886000000000002e-05 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462929+0000", 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014975599999999999 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463152+0000", 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022302499999999999 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463707+0000", 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00055493600000000001 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465489+0000", 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017817460000000001 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466471+0000", 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098237600000000008 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466620+0000", 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878600000000001 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466725+0000", 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010460500000000001 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:378 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:30.041 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.554188078000003, 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045344950000000004, 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 378 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469543+0000", 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3800000000000001e-06 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469558+0000", 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5216e-05 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469592+0000", 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4276999999999997e-05 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469612+0000", 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9973e-05 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469788+0000", 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017606800000000001 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469994+0000", 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020596500000000001 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.470297+0000", 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000303145 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471492+0000", 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011943139999999999 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473878+0000", 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002386371 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473972+0000", 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3603000000000005e-05 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474075+0000", 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103183 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:467 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.504231484000002, 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040446919999999999, 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.047 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 467 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:30.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519499+0000", 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519510+0000", 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1073000000000001e-05 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519539+0000", 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.885e-05 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519553+0000", 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4073000000000001e-05 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519679+0000", 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012514500000000001 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519800+0000", 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121048 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520138+0000", 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033848299999999999 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.521245+0000", 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011068479999999999 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523318+0000", 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020726669999999998 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523451+0000", 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013325300000000001 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523542+0000", 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0811999999999997e-05 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:512 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.479027099, 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046289160000000003, 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.053 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 512 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544703+0000", 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544714+0000", 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1036000000000001e-05 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544743+0000", 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9096000000000001e-05 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544764+0000", 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0273999999999999e-05 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544903+0000", 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139147 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545058+0000", 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015533499999999999 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545435+0000", 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037699499999999998 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546776+0000", 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013404840000000001 2024-04-23T19:01:30.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549119+0000", 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002342939 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549255+0000", 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013645399999999999 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549330+0000", 2024-04-23T19:01:30.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5181999999999999e-05 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:513 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'5, mlcod=32'3)", 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.477574908000001, 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005799584, 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546155+0000", 2024-04-23T19:01:30.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.815e-06 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546169+0000", 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3691e-05 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546201+0000", 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546221+0000", 2024-04-23T19:01:30.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0462000000000002e-05 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546368+0000", 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014708500000000001 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546409+0000", 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0970000000000002e-05 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551835+0000", 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054259850000000004 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551953+0000", 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117716 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1076 4.32 4:4dfd0dc5:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.4987875529999997, 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072734380000000001, 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1076 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.064 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524942+0000", 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4139999999999999e-06 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524950+0000", 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1389999999999995e-06 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524968+0000", 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980999999999999e-05 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524994+0000", 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5633e-05 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525155+0000", 2024-04-23T19:01:30.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016075799999999999 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525403+0000", 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024827699999999998 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525709+0000", 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030619600000000001 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.528078+0000", 2024-04-23T19:01:30.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023689760000000001 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.531940+0000", 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038613710000000002 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532090+0000", 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015073500000000001 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532214+0000", 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012395799999999999 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1083 4.32 4:4e794105:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.4986789999999992, 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080107340000000003, 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.070 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1083 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525050+0000", 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7399999999999991e-07 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525056+0000", 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3399999999999997e-06 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525072+0000", 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6308999999999999e-05 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525081+0000", 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4999999999999999e-06 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526456+0000", 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013756829999999999 2024-04-23T19:01:30.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526821+0000", 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036475100000000002 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527313+0000", 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049206800000000002 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532390+0000", 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050770650000000004 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532903+0000", 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00051322599999999998 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532990+0000", 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7132000000000005e-05 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.533060+0000", 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9685999999999997e-05 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1086 4.25 4:a7d96929:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.4980710439999996, 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.007062975, 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.076 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1086 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:30.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525659+0000", 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2100000000000001e-06 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525670+0000", 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.118e-05 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525684+0000", 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525697+0000", 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2456000000000001e-05 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525779+0000", 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2269999999999997e-05 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525929+0000", 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014989300000000001 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526117+0000", 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018751400000000001 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527644+0000", 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001527612 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532623+0000", 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049787410000000001 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532676+0000", 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3615000000000001e-05 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532720+0000", 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.388e-05 2024-04-23T19:01:30.081 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.1626200480000008, 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.082 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:01:30.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:01:30.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.087 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1113 3.28 3:171e86a1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.1377036940000007, 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019880546999999998, 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.088 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1113 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886026+0000", 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3300000000000001e-07 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889886+0000", 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599490000000001 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889908+0000", 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2824e-05 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889918+0000", 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.893e-06 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890103+0000", 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018468900000000001 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890374+0000", 2024-04-23T19:01:30.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027112300000000001 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.891238+0000", 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086359200000000005 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.902456+0000", 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011218271 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905711+0000", 2024-04-23T19:01:30.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032550919999999998 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905828+0000", 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117365 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905905+0000", 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6915999999999993e-05 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.093 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4646.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796980963920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.0226677310000003, 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045538920000000004, 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.094 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4646", 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001062+0000", 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6729999999999999e-06 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001071+0000", 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4640000000000006e-06 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001110+0000", 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8798999999999999e-05 2024-04-23T19:01:30.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001126+0000", 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6364000000000001e-05 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001227+0000", 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100945 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001380+0000", 2024-04-23T19:01:30.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153361 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001601+0000", 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000220824 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.003537+0000", 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019358120000000001 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005193+0000", 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001655672 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005387+0000", 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000194787 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005615+0000", 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022719099999999999 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901328134912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.4512617849999998, 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048685860000000003, 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572469+0000", 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.869e-06 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572477+0000", 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6940000000000001e-06 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572503+0000", 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5822000000000001e-05 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572519+0000", 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6433999999999999e-05 2024-04-23T19:01:30.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572618+0000", 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8214999999999994e-05 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572731+0000", 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113315 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572931+0000", 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019991599999999999 2024-04-23T19:01:30.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.573759+0000", 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00082765300000000003 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577202+0000", 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034436190000000002 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577256+0000", 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3665000000000002e-05 2024-04-23T19:01:30.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577335+0000", 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9383999999999998e-05 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1246 3.28 3:16f1103d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1839651539999991, 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019343636000000001, 2024-04-23T19:01:30.105 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1246 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839765+0000", 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7740000000000001e-06 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843622+0000", 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038567240000000002 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843645+0000", 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2914000000000001e-05 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843654+0000", 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1609999999999992e-06 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843718+0000", 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4377999999999999e-05 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843848+0000", 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012942100000000001 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.844251+0000", 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403772 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.856774+0000", 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012522995 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.858917+0000", 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021430659999999999 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.859031+0000", 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113486 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.859107+0000", 2024-04-23T19:01:30.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5945000000000006e-05 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363203577120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0757767269999992, 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042896130000000003, 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:30.111 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947953+0000", 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6099999999999999e-07 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947957+0000", 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4580000000000003e-06 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947971+0000", 2024-04-23T19:01:30.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.385e-05 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947980+0000", 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7280000000000001e-06 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948046+0000", 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5995999999999996e-05 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948160+0000", 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114815 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948362+0000", 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020172000000000001 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.949000+0000", 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00063831000000000001 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952086+0000", 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030852050000000002 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952160+0000", 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4568999999999997e-05 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952241+0000", 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100999999999995e-05 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.116 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1348 4.36 4:6f4c9504:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.7670230169999996, 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041593339999999998, 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1348 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.117 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256707+0000", 2024-04-23T19:01:30.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3769999999999999e-06 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256715+0000", 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5529999999999993e-06 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256737+0000", 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1297e-05 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256760+0000", 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3173e-05 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256887+0000", 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012725099999999999 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257082+0000", 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195334 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:30.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257527+0000", 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044436500000000001 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.259546+0000", 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002019074 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260800+0000", 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012539439999999999 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260836+0000", 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6529999999999998e-05 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260865+0000", 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8436e-05 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1825 4.38 4:1f7cfc2f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.122 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1846670899999996, 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005534153, 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1825 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839064+0000", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.283e-06 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839074+0000", 2024-04-23T19:01:30.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.059e-05 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839109+0000", 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5039000000000001e-05 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839131+0000", 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1929999999999998e-05 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839357+0000", 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000226204 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839578+0000", 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022065400000000001 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839841+0000", 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026246 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842547+0000", 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002706539 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844315+0000", 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017682380000000001 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844480+0000", 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164594 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844596+0000", 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115622 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1953 4.36 4:6d01787f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7367023189999999, 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068941840000000002, 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.128 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1953 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287027+0000", 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1489999999999999e-06 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287034+0000", 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6039999999999998e-06 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287053+0000", 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9598000000000001e-05 2024-04-23T19:01:30.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287062+0000", 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7730000000000005e-06 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287194+0000", 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013187100000000001 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287324+0000", 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129527 2024-04-23T19:01:30.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287487+0000", 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016380600000000001 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288505+0000", 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010178979999999999 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293813+0000", 2024-04-23T19:01:30.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005308012 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293875+0000", 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1163999999999999e-05 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293920+0000", 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5782000000000003e-05 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2046 4.36 4:6d01787f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.5526785279999995, 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041496939999999998, 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2046 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471052+0000", 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471062+0000", 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0144e-05 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471104+0000", 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1705999999999997e-05 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471125+0000", 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1588999999999999e-05 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471325+0000", 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019935499999999999 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471531+0000", 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020597700000000001 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471811+0000", 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028025000000000001 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.473852+0000", 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020408269999999998 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475005+0000", 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001153449 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475116+0000", 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110306 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475200+0000", 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3987999999999996e-05 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.139 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:30.141 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:30.141 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:30.137+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:30.241 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:30.237+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:30.308 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:30.309 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:30.309 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:30.309 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:30.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:30.343 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:30.343+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:30.443 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:30.443+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:30.488 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:30.488 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:30.488 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:30.488 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:30.488 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:30.503 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:30.544 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:30.543+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4452.0:36 5.9 e25/24 5:90f831dc:::zone_info.2fe9869b-25a1-4b09-be2c-4e9208a04c5d:head v 25'1, mlcod=0'0)", 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 71.288579815999995, 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038336279999999999, 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.631 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339269+0000", 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339270+0000", 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0900000000000002e-07 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339278+0000", 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1200000000000002e-06 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339294+0000", 2024-04-23T19:01:30.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6725e-05 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339311+0000", 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339445+0000", 2024-04-23T19:01:30.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013386600000000001 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.339497+0000", 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1471999999999998e-05 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343010+0000", 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035131630000000001 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:19.343103+0000", 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3076000000000001e-05 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.316713582999995, 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:30.636 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:30.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:30.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253696271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.296201647999993, 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056192660000000004, 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.643 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:30.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331650+0000", 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.977e-06 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331663+0000", 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2255999999999999e-05 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331694+0000", 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1250000000000001e-05 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331714+0000", 2024-04-23T19:01:30.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9874e-05 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331876+0000", 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016204500000000001 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332107+0000", 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000231072 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:30.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333144+0000", 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001037615 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.335757+0000", 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026121959999999998 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336906+0000", 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001149478 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337056+0000", 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000149722 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337267+0000", 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000210781 2024-04-23T19:01:30.649 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:465 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.110867185000004, 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038716359999999999, 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.650 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516982+0000", 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516983+0000", 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0300000000000001e-06 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.516991+0000", 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1329999999999999e-06 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517005+0000", 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3720000000000001e-05 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517019+0000", 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4773000000000001e-05 2024-04-23T19:01:30.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517142+0000", 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012258200000000001 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.517196+0000", 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3582999999999998e-05 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520763+0000", 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035673900000000001 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520853+0000", 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0425000000000002e-05 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:466 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:30.655 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.107980859999998, 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037160069999999999, 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519868+0000", 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519869+0000", 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.347e-06 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519880+0000", 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0406e-05 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519908+0000", 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7872999999999999e-05 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519921+0000", 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2962999999999999e-05 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520041+0000", 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120579 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520093+0000", 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2231000000000002e-05 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523472+0000", 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00337858 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523584+0000", 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011202800000000001 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'4)", 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.105778997000002, 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041565439999999999, 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.660 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522070+0000", 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522071+0000", 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4640000000000001e-06 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522082+0000", 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0566e-05 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522106+0000", 2024-04-23T19:01:30.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4502999999999999e-05 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522124+0000", 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522233+0000", 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108633 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.522268+0000", 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5200000000000002e-05 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526155+0000", 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038872030000000001 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.526227+0000", 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1248999999999995e-05 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1210 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2900771150000008, 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067467129999999997, 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.665 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1210 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337774+0000", 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.72e-06 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337780+0000", 2024-04-23T19:01:30.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2339999999999999e-06 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337794+0000", 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4217e-05 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337802+0000", 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100000000000003e-06 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337903+0000", 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101047 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338041+0000", 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013782399999999999 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338256+0000", 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215467 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.339632+0000", 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013758970000000001 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344441+0000", 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004809064 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344482+0000", 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0428e-05 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344519+0000", 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6705000000000002e-05 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.671 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1216 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2899558849999995, 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067969930000000003, 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1216 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.672 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337894+0000", 2024-04-23T19:01:30.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8199999999999999e-07 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337898+0000", 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3749999999999996e-06 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337908+0000", 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0292000000000001e-05 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337917+0000", 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2069999999999995e-06 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338539+0000", 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00062252800000000001 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338640+0000", 2024-04-23T19:01:30.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100412 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338785+0000", 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014592899999999999 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.340035+0000", 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001249411 2024-04-23T19:01:30.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344619+0000", 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045837100000000004 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344656+0000", 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7694999999999997e-05 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344690+0000", 2024-04-23T19:01:30.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3751999999999998e-05 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.0506672259999998, 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056182469999999998, 2024-04-23T19:01:30.678 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577183+0000", 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4099999999999997e-07 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577187+0000", 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8959999999999996e-06 2024-04-23T19:01:30.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577198+0000", 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1535000000000001e-05 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577204+0000", 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7729999999999996e-06 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577285+0000", 2024-04-23T19:01:30.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0679999999999993e-05 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577370+0000", 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5883000000000004e-05 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577457+0000", 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6501000000000004e-05 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.578218+0000", 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076112900000000004 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582735+0000", 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045166909999999998 2024-04-23T19:01:30.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582772+0000", 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7514e-05 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582800+0000", 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7704000000000001e-05 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.684 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4715.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94883869179184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.8888203709999996, 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041245029999999998, 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4715", 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/251614066", 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 68 2024-04-23T19:01:30.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739029+0000", 2024-04-23T19:01:30.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739031+0000", 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0269999999999998e-06 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739038+0000", 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6480000000000003e-06 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739060+0000", 2024-04-23T19:01:30.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2041000000000001e-05 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739070+0000", 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2660000000000007e-06 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739168+0000", 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8647000000000006e-05 2024-04-23T19:01:30.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739240+0000", 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2275999999999997e-05 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.739412+0000", 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017175 2024-04-23T19:01:30.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.740367+0000", 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00095455300000000002 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.742977+0000", 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026103229999999999 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.743050+0000", 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3231000000000004e-05 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.743153+0000", 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102741 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.691 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.6759232770000008, 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058651459999999999, 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951927+0000", 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.426e-06 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951932+0000", 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2449999999999998e-06 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951949+0000", 2024-04-23T19:01:30.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6197000000000001e-05 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951960+0000", 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1430000000000001e-05 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952028+0000", 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7764999999999999e-05 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952128+0000", 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9846999999999995e-05 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952275+0000", 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014731799999999999 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.953530+0000", 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012555890000000001 2024-04-23T19:01:30.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957674+0000", 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041432489999999999 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957727+0000", 2024-04-23T19:01:30.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3266999999999997e-05 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957791+0000", 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3812999999999994e-05 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1327 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:30.698 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.5533110229999991, 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041744629999999998, 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1327 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074541+0000", 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8849999999999999e-06 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074547+0000", 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6499999999999999e-06 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074562+0000", 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4673e-05 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074570+0000", 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5410000000000003e-06 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074626+0000", 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.6140999999999997e-05 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074701+0000", 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5227000000000003e-05 2024-04-23T19:01:30.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074805+0000", 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010398 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075985+0000", 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011795760000000001 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078636+0000", 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002651811 2024-04-23T19:01:30.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078680+0000", 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3813999999999998e-05 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078712+0000", 2024-04-23T19:01:30.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2165000000000001e-05 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1333 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.5532157949999998, 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044982269999999996, 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.705 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1333 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074634+0000", 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8400000000000004e-07 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074637+0000", 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.898e-06 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074643+0000", 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7780000000000002e-06 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074649+0000", 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7400000000000001e-06 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074762+0000", 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112959 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074976+0000", 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213687 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:30.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075329+0000", 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000353426 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.076812+0000", 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014828899999999999 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079040+0000", 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022278340000000002 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079093+0000", 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.287e-05 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079131+0000", 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8560999999999999e-05 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.711 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1349 4.3c 4:3d2e0823:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256595+0000", 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.3712536170000007, 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041180310000000003, 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1349 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256595+0000", 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256595+0000", 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256597+0000", 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.75e-06 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256605+0000", 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9519999999999994e-06 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256621+0000", 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6195999999999999e-05 2024-04-23T19:01:30.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256629+0000", 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4919999999999996e-06 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256709+0000", 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0179999999999995e-05 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256907+0000", 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000197868 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257190+0000", 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028284300000000002 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.258158+0000", 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00096825700000000004 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260638+0000", 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002480215 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260680+0000", 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1950999999999999e-05 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260713+0000", 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3327000000000001e-05 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.5211.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.750425+0000", 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.877424403, 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039809090000000004, 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.718 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.5211", 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1763254879", 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750425+0000", 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750425+0000", 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750427+0000", 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1069999999999999e-06 2024-04-23T19:01:30.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750436+0000", 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0459999999999994e-06 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750465+0000", 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8969999999999999e-05 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750479+0000", 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.43e-05 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750601+0000", 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121758 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750727+0000", 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012597899999999999 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.750908+0000", 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018145699999999999 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.752072+0000", 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001163615 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.754216+0000", 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021443230000000001 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.754296+0000", 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9929e-05 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.754405+0000", 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109425 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1828 4.3c 4:3c9611cc:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.7888063599999997, 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043086649999999997, 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1828 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.725 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839044+0000", 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.703e-06 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839054+0000", 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2099999999999999e-06 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839077+0000", 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3544e-05 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839095+0000", 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7856e-05 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839361+0000", 2024-04-23T19:01:30.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000266216 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839575+0000", 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213594 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839864+0000", 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028965000000000002 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842214+0000", 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00235002 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843075+0000", 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086051599999999997 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843282+0000", 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020680399999999999 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843351+0000", 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9552000000000001e-05 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1832 4.5 4:a211101a:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.7887162180000002, 2024-04-23T19:01:30.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044515809999999996, 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1832 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839134+0000", 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.207e-06 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839141+0000", 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9929999999999998e-06 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839172+0000", 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1346000000000001e-05 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839274+0000", 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101822 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839518+0000", 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000244114 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839728+0000", 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020958700000000001 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840016+0000", 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028844999999999999 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842977+0000", 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002960786 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843329+0000", 2024-04-23T19:01:30.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035216199999999999 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843476+0000", 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014658800000000001 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843584+0000", 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108526 2024-04-23T19:01:30.737 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.5232.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.938125+0000", 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.6897241239999996, 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040466770000000003, 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.5232", 2024-04-23T19:01:30.738 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3466563576", 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938125+0000", 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938125+0000", 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938126+0000", 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.119e-06 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938131+0000", 2024-04-23T19:01:30.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7190000000000001e-06 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938145+0000", 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4513e-05 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938153+0000", 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5689999999999999e-06 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938228+0000", 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5335999999999998e-05 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938298+0000", 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9432999999999997e-05 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.938411+0000", 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011367899999999999 2024-04-23T19:01:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.940280+0000", 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00186878 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.942093+0000", 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018125369999999999 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.942133+0000", 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0911000000000002e-05 2024-04-23T19:01:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.942172+0000", 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8080999999999997e-05 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1948 4.20 4:04fe9b97:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3408764419999999, 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043859700000000003, 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1948 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286975+0000", 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0339999999999999e-06 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286982+0000", 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0870000000000001e-06 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287006+0000", 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4607999999999999e-05 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287018+0000", 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1260000000000001e-05 2024-04-23T19:01:30.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287104+0000", 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6796e-05 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287326+0000", 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022200900000000001 2024-04-23T19:01:30.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287568+0000", 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024147 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288970+0000", 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014020219999999999 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291283+0000", 2024-04-23T19:01:30.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023136490000000001 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291327+0000", 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3058e-05 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291358+0000", 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2041 4.20 4:04fe9b97:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471031+0000", 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1568177239999997, 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040386420000000003, 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:30.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2041 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471031+0000", 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471031+0000", 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471034+0000", 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6599999999999999e-06 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471046+0000", 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2176e-05 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471076+0000", 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0107000000000002e-05 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471093+0000", 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7070000000000001e-05 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471279+0000", 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018535000000000001 2024-04-23T19:01:30.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471508+0000", 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022973399999999999 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471806+0000", 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029814000000000002 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.473662+0000", 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001855759 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.474883+0000", 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001220718 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475007+0000", 2024-04-23T19:01:30.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012433499999999999 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475070+0000", 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2593000000000002e-05 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:30.757 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:30.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:30.759 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:30.759+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:30.859 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:30.859+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:30.884 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:30.885 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:30.885 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:30.885 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:30.899 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:30.961 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:30.963+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:31.010 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:01:31.021 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:31.022 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:31.022 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:31.022 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:31.022 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:31.030 INFO:tasks.workunit.client.0.smithi169.stdout:quota enabled for the bucket: buck_2024_03_23_19_01_26 2024-04-23T19:01:31.030 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 2Gb. 2024-04-23T19:01:31.030 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:31.030 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-04-23T19:01:31.030 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:31.030 INFO:tasks.workunit.client.0.smithi169.stdout:delete objects successful 2024-04-23T19:01:31.036 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:31.086 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:31.085+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.155 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.984387491000007, 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:01:31.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.162 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.465201805000007, 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015286536999999999, 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.163 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 36 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690289+0000", 2024-04-23T19:01:31.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690290+0000", 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8000000000000005e-07 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690297+0000", 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8340000000000001e-06 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690307+0000", 2024-04-23T19:01:31.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9729999999999992e-06 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690315+0000", 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8900000000000007e-06 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697421+0000", 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071065379999999999 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697541+0000", 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119973 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.697734+0000", 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019309899999999999 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699272+0000", 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015377310000000001 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705412+0000", 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061400559999999996 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705507+0000", 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4596e-05 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705576+0000", 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9066999999999994e-05 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.465164850999997, 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015476504, 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.169 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 37 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690326+0000", 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690327+0000", 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6000000000000003e-07 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690333+0000", 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2299999999999996e-06 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690343+0000", 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4760000000000004e-06 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.690350+0000", 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7640000000000005e-06 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698339+0000", 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079881740000000007 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698459+0000", 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120216 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.698656+0000", 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019722899999999999 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.699980+0000", 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001324389 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705665+0000", 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00568412 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705744+0000", 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9759999999999995e-05 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.705803+0000", 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8486000000000002e-05 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:01:31.174 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.253303482999996, 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541634, 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 107 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.175 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902188+0000", 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902189+0000", 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7999999999999993e-07 2024-04-23T19:01:31.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902194+0000", 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8429999999999998e-06 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902205+0000", 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0703999999999999e-05 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.902213+0000", 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6229999999999997e-06 2024-04-23T19:01:31.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907404+0000", 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051909859999999999 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907531+0000", 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127136 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.907762+0000", 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023144800000000001 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913252+0000", 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054900720000000004 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913434+0000", 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018157500000000001 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913603+0000", 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016911500000000001 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.913729+0000", 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012615200000000001 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.252483276000007, 2024-04-23T19:01:31.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011579644, 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 109 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903008+0000", 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903009+0000", 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2500000000000001e-06 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903085+0000", 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6149000000000006e-05 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903116+0000", 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.082e-05 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903175+0000", 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8975999999999999e-05 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909768+0000", 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065926159999999999 2024-04-23T19:01:31.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.909990+0000", 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022251199999999999 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.910357+0000", 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036634699999999999 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914187+0000", 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038306870000000002 2024-04-23T19:01:31.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914316+0000", 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012860899999999999 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914469+0000", 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015297600000000001 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914587+0000", 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118702 2024-04-23T19:01:31.185 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.252261680999993, 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01161092, 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 110 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903229+0000", 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903231+0000", 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.333e-06 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903238+0000", 2024-04-23T19:01:31.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5839999999999997e-06 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903259+0000", 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0656e-05 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903269+0000", 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5999999999999996e-06 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912042+0000", 2024-04-23T19:01:31.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087729060000000005 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912257+0000", 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021572099999999999 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.912623+0000", 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036538100000000002 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914697+0000", 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002074144 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914721+0000", 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4283000000000001e-05 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914788+0000", 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6956000000000001e-05 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914840+0000", 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2355999999999998e-05 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.192 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.252204078000005, 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016792776999999998, 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 111 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903287+0000", 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903288+0000", 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0869999999999999e-06 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903298+0000", 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4460000000000007e-06 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903325+0000", 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7903e-05 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903340+0000", 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4416999999999999e-05 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.914941+0000", 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011601034 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915176+0000", 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234818 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.915534+0000", 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035823000000000002 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919638+0000", 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041041519999999998 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919811+0000", 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173062 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919950+0000", 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138832 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920080+0000", 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129796 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.252101089000007, 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.199 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:01:31.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:01:31.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:01:31.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:01:31.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.251931110000001, 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:01:31.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:01:31.213 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.251880544000002, 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:01:31.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:01:31.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.251738204999995, 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:01:31.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:01:31.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:01:31.225 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.226 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.251534903999996, 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.227 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.228 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:01:31.229 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:01:31.230 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:01:31.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:01:31.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.233 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.234 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:31.234 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 87.251495719999994, 2024-04-23T19:01:31.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:01:31.234 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.234 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.234 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.235 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:01:31.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.235 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:01:31.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:01:31.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:01:31.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 86.981897008999994, 2024-04-23T19:01:31.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011508065, 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 137 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173594+0000", 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173595+0000", 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6400000000000002e-07 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173716+0000", 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012079900000000001 2024-04-23T19:01:31.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173730+0000", 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4623999999999999e-05 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173739+0000", 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4470000000000006e-06 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178126+0000", 2024-04-23T19:01:31.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004386849 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178205+0000", 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9653000000000005e-05 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.178326+0000", 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120433 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180954+0000", 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026283019999999999 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185035+0000", 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040809979999999997 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185069+0000", 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4208000000000002e-05 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185102+0000", 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3087999999999999e-05 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 86.981675198000005, 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011476916, 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.253 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 139 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173816+0000", 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173817+0000", 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.54e-07 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173824+0000", 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2860000000000002e-06 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173834+0000", 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8179999999999999e-06 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173841+0000", 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9700000000000002e-06 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179190+0000", 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053495629999999999 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179237+0000", 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6490999999999999e-05 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179314+0000", 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7484000000000006e-05 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180960+0000", 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016456039999999999 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185224+0000", 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042640380000000004 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185260+0000", 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5839e-05 2024-04-23T19:01:31.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185293+0000", 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3068999999999998e-05 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.259 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 86.981637914000004, 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011673032999999999, 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.260 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 140 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173853+0000", 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173854+0000", 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1999999999999999e-07 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173958+0000", 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104038 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173975+0000", 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7472000000000001e-05 2024-04-23T19:01:31.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173984+0000", 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3270000000000001e-06 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179865+0000", 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058815259999999998 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179915+0000", 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0185000000000001e-05 2024-04-23T19:01:31.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.179995+0000", 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0007999999999997e-05 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.182979+0000", 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029830109999999998 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185377+0000", 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023988239999999999 2024-04-23T19:01:31.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185464+0000", 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6388e-05 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185526+0000", 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2533999999999995e-05 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.265 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 86.981491993999995, 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011606877999999999, 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 141 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.173999+0000", 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174000+0000", 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.37e-07 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.267 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174006+0000", 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.156e-06 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174016+0000", 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9660000000000008e-06 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.174024+0000", 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8050000000000007e-06 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180466+0000", 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006442138 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180517+0000", 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0701999999999997e-05 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.180600+0000", 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3046000000000004e-05 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.183367+0000", 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027671900000000001 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185558+0000", 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021912889999999999 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185585+0000", 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7203e-05 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.185606+0000", 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0645999999999999e-05 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:01:31.271 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 86.642624862999995, 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011863655000000001, 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 158 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512866+0000", 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512867+0000", 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8500000000000002e-07 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512932+0000", 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5547000000000001e-05 2024-04-23T19:01:31.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512945+0000", 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2383e-05 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512951+0000", 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3849999999999999e-06 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518504+0000", 2024-04-23T19:01:31.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055528000000000001 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518641+0000", 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013751200000000001 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.518866+0000", 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022416100000000001 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524269+0000", 2024-04-23T19:01:31.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054038189999999998 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524549+0000", 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027922800000000002 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524638+0000", 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9546e-05 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524730+0000", 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1788999999999998e-05 2024-04-23T19:01:31.276 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 86.642530364999999, 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011949143000000001, 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:31.277 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 159 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512961+0000", 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3000000000000001e-07 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512965+0000", 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3950000000000001e-06 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512972+0000", 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3089999999999998e-06 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.512976+0000", 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0230000000000003e-06 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520114+0000", 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071381359999999998 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520251+0000", 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013729599999999999 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.520474+0000", 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000222704 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524417+0000", 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039427969999999996 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524752+0000", 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033490400000000002 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524848+0000", 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5768999999999997e-05 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:04.524910+0000", 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2279999999999993e-05 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:1243 3.2b e52/20 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head v 52'1, mlcod=0'0)", 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.823965+0000", 2024-04-23T19:01:31.282 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.3315262489999995, 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013384854999999999, 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.823965+0000", 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.823965+0000", 2024-04-23T19:01:31.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.823967+0000", 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.829153+0000", 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051854750000000002 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.829190+0000", 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7716000000000003e-05 2024-04-23T19:01:31.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.829208+0000", 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7606999999999999e-05 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.829294+0000", 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6028999999999999e-05 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.829316+0000", 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1645e-05 2024-04-23T19:01:31.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.837295+0000", 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079794740000000003 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.837350+0000", 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4491999999999999e-05 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:31.286 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:31.288 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:31.285+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:31.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:31.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:31.389 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:31.391+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:31.407 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:31.407 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:31.407 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:31.407 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:31.425 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:31.470 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:31.471 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:31.486 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:31.486 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:31.489 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:31.491+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:31.504 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:31.504 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:31.522 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:31.523 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:31.543 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:31.543 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:31.563 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:31.564 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:31.583 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:31.583 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:31.584 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:31.584 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:31.590 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:31.591+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:31.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:31.605 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:31.605 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:31.692 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:31.689+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:31.721 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:31.721 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:31.739 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:31.742 INFO:tasks.workunit.client.0.smithi169.stderr:100+0 records in 2024-04-23T19:01:31.742 INFO:tasks.workunit.client.0.smithi169.stderr:100+0 records out 2024-04-23T19:01:31.742 INFO:tasks.workunit.client.0.smithi169.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.710121 s, 1.5 GB/s 2024-04-23T19:01:31.793 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:31.795+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:31.848 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:31.848 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:31.862 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:31.905 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:31.907+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:31.994 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:31.995+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:32.009 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:01:32.024 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.024 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.038 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:32.095 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:32.093+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:32.195 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.195 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.196 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:32.197+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:32.208 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:32.297 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:32.293+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:32.328 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.328 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:32.398 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:32.397+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:32.468 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.468 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:32.524 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:32.527+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:32.599 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.599 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.600 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:32.597+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:32.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:32.701 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:32.703+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:32.777 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.777 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:32.833 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:32.835+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:32.902 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:32.901+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:32.953 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:32.953 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:32.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:33.003 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:33.001+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:33.104 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:33.101+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:33.127 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:33.127 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:33.147 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:33.204 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:33.201+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:33.279 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:33.279 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:33.293 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:33.338 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:33.337+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:33.407 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:33.405+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:33.461 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:33.461 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:33.475 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:33.518 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:33.517+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:33.609 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:33.611+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:33.627 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:33.639 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:33.639 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:33.653 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:33.710 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:33.711+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:33.780 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:33.780 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:33.788 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:33.788 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:33.797 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:33.810 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:33.810 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:33.811 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:33.811+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:33.828 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:33.829 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:33.846 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:33.846 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:33.868 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:33.868 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:33.895 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:33.895 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:33.911 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:33.911+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:33.917 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:33.917 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:33.943 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:33.943 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:33.946 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:33.946 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:33.947 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:33.947 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:33.947 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:33.965 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:34.012 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:34.015+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:34.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 70.775116456999996, 2024-04-23T19:01:34.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085602839999999996, 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 48 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331684+0000", 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331687+0000", 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331702+0000", 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.486e-05 2024-04-23T19:01:34.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331735+0000", 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3272999999999998e-05 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331758+0000", 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2633000000000002e-05 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331922+0000", 2024-04-23T19:01:34.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164356 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332211+0000", 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028900799999999999 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332486+0000", 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275044 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.334812+0000", 2024-04-23T19:01:34.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023258720000000001 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340081+0000", 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052694229999999996 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340176+0000", 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4674999999999997e-05 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.340244+0000", 2024-04-23T19:01:34.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7726999999999997e-05 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.796479022, 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004746737, 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.113 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 205 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310321+0000", 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310325+0000", 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6739999999999999e-06 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310342+0000", 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7062999999999999e-05 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310372+0000", 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0116000000000001e-05 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310395+0000", 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3025999999999999e-05 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.310720+0000", 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000325242 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311086+0000", 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036572699999999999 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.311891+0000", 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00080526000000000003 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.313563+0000", 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001672251 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314820+0000", 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001256783 2024-04-23T19:01:34.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.314965+0000", 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144699 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.315068+0000", 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102896 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.118 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:344 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.644088237999995, 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040128489999999998, 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 344 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462712+0000", 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462715+0000", 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7530000000000002e-06 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462725+0000", 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0334e-05 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462750+0000", 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4646000000000001e-05 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462779+0000", 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9886000000000002e-05 2024-04-23T19:01:34.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.462929+0000", 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014975599999999999 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463152+0000", 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022302499999999999 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.463707+0000", 2024-04-23T19:01:34.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00055493600000000001 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.465489+0000", 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017817460000000001 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466471+0000", 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00098237600000000008 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466620+0000", 2024-04-23T19:01:34.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878600000000001 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.466725+0000", 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010460500000000001 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:378 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.637259666999995, 2024-04-23T19:01:34.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045344950000000004, 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 378 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469540+0000", 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469543+0000", 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3800000000000001e-06 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469558+0000", 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5216e-05 2024-04-23T19:01:34.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469592+0000", 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4276999999999997e-05 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469612+0000", 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9973e-05 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469788+0000", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017606800000000001 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.469994+0000", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020596500000000001 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.470297+0000", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000303145 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.471492+0000", 2024-04-23T19:01:34.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011943139999999999 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473878+0000", 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002386371 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.473972+0000", 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3603000000000005e-05 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.474075+0000", 2024-04-23T19:01:34.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103183 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:467 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.587303073000001, 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040446919999999999, 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.130 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 467 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519497+0000", 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519499+0000", 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4399999999999999e-06 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519510+0000", 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1073000000000001e-05 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519539+0000", 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.885e-05 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519553+0000", 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4073000000000001e-05 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519679+0000", 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012514500000000001 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.519800+0000", 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121048 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.520138+0000", 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033848299999999999 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.521245+0000", 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011068479999999999 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523318+0000", 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020726669999999998 2024-04-23T19:01:34.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523451+0000", 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013325300000000001 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.523542+0000", 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0811999999999997e-05 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.135 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:512 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.562098688000006, 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046289160000000003, 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 512 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544701+0000", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544703+0000", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9740000000000001e-06 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544714+0000", 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1036000000000001e-05 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544743+0000", 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9096000000000001e-05 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544764+0000", 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0273999999999999e-05 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.544903+0000", 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139147 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545058+0000", 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015533499999999999 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.545435+0000", 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037699499999999998 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546776+0000", 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013404840000000001 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549119+0000", 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002342939 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549255+0000", 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013645399999999999 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.549330+0000", 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5181999999999999e-05 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:513 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'5, mlcod=32'3)", 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 67.560646496999993, 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005799584, 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.141 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546154+0000", 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546155+0000", 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.815e-06 2024-04-23T19:01:34.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546169+0000", 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3691e-05 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546201+0000", 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1860000000000003e-05 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546221+0000", 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0462000000000002e-05 2024-04-23T19:01:34.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546368+0000", 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014708500000000001 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.546409+0000", 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0970000000000002e-05 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551835+0000", 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054259850000000004 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:26.551953+0000", 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117716 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1076 4.32 4:4dfd0dc5:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.581859142000001, 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0072734380000000001, 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.145 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1076 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524941+0000", 2024-04-23T19:01:34.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524942+0000", 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4139999999999999e-06 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524950+0000", 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1389999999999995e-06 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524968+0000", 2024-04-23T19:01:34.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980999999999999e-05 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.524994+0000", 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5633e-05 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525155+0000", 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016075799999999999 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525403+0000", 2024-04-23T19:01:34.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024827699999999998 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525709+0000", 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030619600000000001 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.528078+0000", 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023689760000000001 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.531940+0000", 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038613710000000002 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532090+0000", 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015073500000000001 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532214+0000", 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012395799999999999 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1083 4.32 4:4e794105:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.581750589, 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080107340000000003, 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1083 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525049+0000", 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525050+0000", 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7399999999999991e-07 2024-04-23T19:01:34.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525056+0000", 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3399999999999997e-06 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525072+0000", 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6308999999999999e-05 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525081+0000", 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4999999999999999e-06 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526456+0000", 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013756829999999999 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526821+0000", 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036475100000000002 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527313+0000", 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00049206800000000002 2024-04-23T19:01:34.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532390+0000", 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050770650000000004 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532903+0000", 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00051322599999999998 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532990+0000", 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7132000000000005e-05 2024-04-23T19:01:34.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.533060+0000", 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9685999999999997e-05 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1086 4.25 4:a7d96929:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.581142633000001, 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.007062975, 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.156 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1086 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525657+0000", 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525659+0000", 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2100000000000001e-06 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525670+0000", 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.118e-05 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525684+0000", 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4603999999999999e-05 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525697+0000", 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2456000000000001e-05 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525779+0000", 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2269999999999997e-05 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.525929+0000", 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014989300000000001 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.526117+0000", 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018751400000000001 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.527644+0000", 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001527612 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532623+0000", 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049787410000000001 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532676+0000", 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3615000000000001e-05 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.532720+0000", 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.388e-05 2024-04-23T19:01:34.161 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.245691637, 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.162 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:01:34.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1113 3.28 3:171e86a1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.220775283, 2024-04-23T19:01:34.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019880546999999998, 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1113 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886026+0000", 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3300000000000001e-07 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889886+0000", 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599490000000001 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889908+0000", 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2824e-05 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889918+0000", 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.893e-06 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890103+0000", 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018468900000000001 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890374+0000", 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027112300000000001 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.891238+0000", 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086359200000000005 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.902456+0000", 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011218271 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905711+0000", 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032550919999999998 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905828+0000", 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117365 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905905+0000", 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6915999999999993e-05 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.172 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4646.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796980963920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.10573932, 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045538920000000004, 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4646", 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/1397069288", 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:34.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001061+0000", 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001062+0000", 2024-04-23T19:01:34.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6729999999999999e-06 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001071+0000", 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4640000000000006e-06 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001110+0000", 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8798999999999999e-05 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001126+0000", 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6364000000000001e-05 2024-04-23T19:01:34.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001227+0000", 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100945 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001380+0000", 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000153361 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.001601+0000", 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000220824 2024-04-23T19:01:34.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.003537+0000", 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019358120000000001 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005193+0000", 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001655672 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005387+0000", 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000194787 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.005615+0000", 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022719099999999999 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901328134912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.534333373999999, 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048685860000000003, 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.178 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572467+0000", 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572469+0000", 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.869e-06 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572477+0000", 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6940000000000001e-06 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572503+0000", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5822000000000001e-05 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572519+0000", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6433999999999999e-05 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572618+0000", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8214999999999994e-05 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572731+0000", 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113315 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.572931+0000", 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019991599999999999 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.573759+0000", 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00082765300000000003 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577202+0000", 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034436190000000002 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577256+0000", 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3665000000000002e-05 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577335+0000", 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9383999999999998e-05 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.183 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1246 3.28 3:16f1103d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.267036743, 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019343636000000001, 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1246 2024-04-23T19:01:34.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839763+0000", 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.839765+0000", 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7740000000000001e-06 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843622+0000", 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038567240000000002 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843645+0000", 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2914000000000001e-05 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843654+0000", 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1609999999999992e-06 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843718+0000", 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4377999999999999e-05 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.843848+0000", 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012942100000000001 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.844251+0000", 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403772 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.856774+0000", 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012522995 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.858917+0000", 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021430659999999999 2024-04-23T19:01:34.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.859031+0000", 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113486 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.859107+0000", 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5945000000000006e-05 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363203577120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.158848316, 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042896130000000003, 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947952+0000", 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947953+0000", 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6099999999999999e-07 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947957+0000", 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4580000000000003e-06 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947971+0000", 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.385e-05 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.947980+0000", 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7280000000000001e-06 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948046+0000", 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5995999999999996e-05 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948160+0000", 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114815 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.948362+0000", 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020172000000000001 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.949000+0000", 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00063831000000000001 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952086+0000", 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030852050000000002 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952160+0000", 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4568999999999997e-05 2024-04-23T19:01:34.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952241+0000", 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100999999999995e-05 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1348 4.36 4:6f4c9504:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.3.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.850094606000001, 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041593339999999998, 2024-04-23T19:01:34.195 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1348 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256705+0000", 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256707+0000", 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3769999999999999e-06 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256715+0000", 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5529999999999993e-06 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256737+0000", 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1297e-05 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256760+0000", 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3173e-05 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.256887+0000", 2024-04-23T19:01:34.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012725099999999999 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257082+0000", 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195334 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.257527+0000", 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044436500000000001 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.259546+0000", 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002019074 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260800+0000", 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012539439999999999 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260836+0000", 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6529999999999998e-05 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.260865+0000", 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8436e-05 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1825 4.38 4:1f7cfc2f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2677386790000007, 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005534153, 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.201 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1825 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839061+0000", 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839064+0000", 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.283e-06 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839074+0000", 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.059e-05 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839109+0000", 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5039000000000001e-05 2024-04-23T19:01:34.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839131+0000", 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1929999999999998e-05 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839357+0000", 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000226204 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839578+0000", 2024-04-23T19:01:34.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022065400000000001 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839841+0000", 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026246 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842547+0000", 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002706539 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844315+0000", 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017682380000000001 2024-04-23T19:01:34.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844480+0000", 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000164594 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.844596+0000", 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115622 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.206 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1953 4.36 4:6d01787f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.8197739080000002, 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068941840000000002, 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1953 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287026+0000", 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287027+0000", 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1489999999999999e-06 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287034+0000", 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6039999999999998e-06 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287053+0000", 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9598000000000001e-05 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287062+0000", 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7730000000000005e-06 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287194+0000", 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013187100000000001 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287324+0000", 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129527 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287487+0000", 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016380600000000001 2024-04-23T19:01:34.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288505+0000", 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0010178979999999999 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293813+0000", 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005308012 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293875+0000", 2024-04-23T19:01:34.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1163999999999999e-05 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.293920+0000", 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5782000000000003e-05 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2046 4.36 4:6d01787f:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.6357501170000006, 2024-04-23T19:01:34.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041496939999999998, 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2046 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471050+0000", 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471052+0000", 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471062+0000", 2024-04-23T19:01:34.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0144e-05 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471104+0000", 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1705999999999997e-05 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471125+0000", 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1588999999999999e-05 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471325+0000", 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019935499999999999 2024-04-23T19:01:34.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471531+0000", 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020597700000000001 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.471811+0000", 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028025000000000001 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.473852+0000", 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020408269999999998 2024-04-23T19:01:34.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475005+0000", 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001153449 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475116+0000", 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110306 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.475200+0000", 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3987999999999996e-05 2024-04-23T19:01:34.217 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.218 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.218 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.218 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.218 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.218 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:34.219 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:34.220 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:34.219+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:34.320 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:34.317+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:34.357 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:34.358 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:34.358 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:34.358 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:34.375 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:34.462 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:34.461+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:34.521 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:34.523+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:34.555 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:34.555 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:34.572 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:34.662 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:34.661+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:34.725 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:34.723+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:34.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 71.449949083000007, 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:34.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:34.768 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253696271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 71.429437148000005, 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056192660000000004, 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.769 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 47 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331647+0000", 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331650+0000", 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.977e-06 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331663+0000", 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2255999999999999e-05 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331694+0000", 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1250000000000001e-05 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331714+0000", 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9874e-05 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331876+0000", 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016204500000000001 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.332107+0000", 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000231072 2024-04-23T19:01:34.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.333144+0000", 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001037615 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.335757+0000", 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026121959999999998 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.336906+0000", 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001149478 2024-04-23T19:01:34.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337056+0000", 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000149722 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.337267+0000", 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000210781 2024-04-23T19:01:34.774 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1210 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.423312615, 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067467129999999997, 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.775 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1210 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337772+0000", 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337774+0000", 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.72e-06 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337780+0000", 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2339999999999999e-06 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337794+0000", 2024-04-23T19:01:34.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4217e-05 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337802+0000", 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1100000000000003e-06 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337903+0000", 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101047 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338041+0000", 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013782399999999999 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338256+0000", 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215467 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.339632+0000", 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013758970000000001 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344441+0000", 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004809064 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344482+0000", 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0428e-05 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344519+0000", 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6705000000000002e-05 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1216 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.423191384999999, 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067969930000000003, 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1216 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337893+0000", 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337894+0000", 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8199999999999999e-07 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337898+0000", 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3749999999999996e-06 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337908+0000", 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0292000000000001e-05 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.337917+0000", 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2069999999999995e-06 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338539+0000", 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00062252800000000001 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338640+0000", 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100412 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.338785+0000", 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014592899999999999 2024-04-23T19:01:34.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.340035+0000", 2024-04-23T19:01:34.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001249411 2024-04-23T19:01:34.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344619+0000", 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045837100000000004 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344656+0000", 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7694999999999997e-05 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.344690+0000", 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3751999999999998e-05 2024-04-23T19:01:34.788 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4908.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:34.789 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.183902725999999, 2024-04-23T19:01:34.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056182469999999998, 2024-04-23T19:01:34.790 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.790 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.790 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.790 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.790 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4908", 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3096055682", 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577182+0000", 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577183+0000", 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4099999999999997e-07 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577187+0000", 2024-04-23T19:01:34.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8959999999999996e-06 2024-04-23T19:01:34.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577198+0000", 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1535000000000001e-05 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577204+0000", 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7729999999999996e-06 2024-04-23T19:01:34.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577285+0000", 2024-04-23T19:01:34.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0679999999999993e-05 2024-04-23T19:01:34.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577370+0000", 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5883000000000004e-05 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.577457+0000", 2024-04-23T19:01:34.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6501000000000004e-05 2024-04-23T19:01:34.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.578218+0000", 2024-04-23T19:01:34.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076112900000000004 2024-04-23T19:01:34.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582735+0000", 2024-04-23T19:01:34.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045166909999999998 2024-04-23T19:01:34.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582772+0000", 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7514e-05 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.582800+0000", 2024-04-23T19:01:34.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7704000000000001e-05 2024-04-23T19:01:34.801 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.801 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.801 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.802 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4953.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.802 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:34.802 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.809158777, 2024-04-23T19:01:34.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058651459999999999, 2024-04-23T19:01:34.802 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4953", 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/3475956774", 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 52 2024-04-23T19:01:34.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.804 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:34.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951926+0000", 2024-04-23T19:01:34.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951927+0000", 2024-04-23T19:01:34.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.426e-06 2024-04-23T19:01:34.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951932+0000", 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2449999999999998e-06 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951949+0000", 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6197000000000001e-05 2024-04-23T19:01:34.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.951960+0000", 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1430000000000001e-05 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952028+0000", 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7764999999999999e-05 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952128+0000", 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9846999999999995e-05 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.952275+0000", 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014731799999999999 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.953530+0000", 2024-04-23T19:01:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012555890000000001 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957674+0000", 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041432489999999999 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957727+0000", 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3266999999999997e-05 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:21.957791+0000", 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3812999999999994e-05 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1327 4.a 4:51cf4aca:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:34.812 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.686546523000001, 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041744629999999998, 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1327 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074538+0000", 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074541+0000", 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8849999999999999e-06 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074547+0000", 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6499999999999999e-06 2024-04-23T19:01:34.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074562+0000", 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4673e-05 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074570+0000", 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5410000000000003e-06 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074626+0000", 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.6140999999999997e-05 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074701+0000", 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5227000000000003e-05 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074805+0000", 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010398 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075985+0000", 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011795760000000001 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078636+0000", 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002651811 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078680+0000", 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3813999999999998e-05 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.078712+0000", 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2165000000000001e-05 2024-04-23T19:01:34.817 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1333 4.20 4:061e61e9:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.686451294999999, 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044982269999999996, 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.818 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1333 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074633+0000", 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074634+0000", 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8400000000000004e-07 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074637+0000", 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.898e-06 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074643+0000", 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7780000000000002e-06 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074649+0000", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7400000000000001e-06 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074762+0000", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112959 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.074976+0000", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213687 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:34.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.075329+0000", 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000353426 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.076812+0000", 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014828899999999999 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079040+0000", 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0022278340000000002 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079093+0000", 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.287e-05 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:22.079131+0000", 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8560999999999999e-05 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1828 4.3c 4:3c9611cc:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.9220418600000002, 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043086649999999997, 2024-04-23T19:01:34.823 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1828 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839043+0000", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839044+0000", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.703e-06 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839054+0000", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2099999999999999e-06 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839077+0000", 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3544e-05 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839095+0000", 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7856e-05 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839361+0000", 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000266216 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839575+0000", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000213594 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839864+0000", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028965000000000002 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842214+0000", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00235002 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843075+0000", 2024-04-23T19:01:34.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086051599999999997 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843282+0000", 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020680399999999999 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843351+0000", 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9552000000000001e-05 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1832 4.5 4:a211101a:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.9219517180000008, 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044515809999999996, 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1832 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839133+0000", 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839134+0000", 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.207e-06 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839141+0000", 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9929999999999998e-06 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839172+0000", 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1346000000000001e-05 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839274+0000", 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101822 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839518+0000", 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000244114 2024-04-23T19:01:34.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.839728+0000", 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020958700000000001 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:34.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.840016+0000", 2024-04-23T19:01:34.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028844999999999999 2024-04-23T19:01:34.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.842977+0000", 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002960786 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843329+0000", 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035216199999999999 2024-04-23T19:01:34.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843476+0000", 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014658800000000001 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:24.843584+0000", 2024-04-23T19:01:34.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108526 2024-04-23T19:01:34.837 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.837 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.837 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.838 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1948 4.20 4:04fe9b97:::.dir.2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.8.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-23T19:01:34.838 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:34.838 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.4741119420000004, 2024-04-23T19:01:34.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043859700000000003, 2024-04-23T19:01:34.838 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1948 2024-04-23T19:01:34.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286973+0000", 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286975+0000", 2024-04-23T19:01:34.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0339999999999999e-06 2024-04-23T19:01:34.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.286982+0000", 2024-04-23T19:01:34.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0870000000000001e-06 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287006+0000", 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4607999999999999e-05 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287018+0000", 2024-04-23T19:01:34.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1260000000000001e-05 2024-04-23T19:01:34.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287104+0000", 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6796e-05 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287326+0000", 2024-04-23T19:01:34.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022200900000000001 2024-04-23T19:01:34.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:34.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.287568+0000", 2024-04-23T19:01:34.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024147 2024-04-23T19:01:34.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.288970+0000", 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014020219999999999 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291283+0000", 2024-04-23T19:01:34.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023136490000000001 2024-04-23T19:01:34.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291327+0000", 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3058e-05 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:25.291358+0000", 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1977000000000002e-05 2024-04-23T19:01:34.849 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.850 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.850 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.850 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2122 3.35 3:ac268df4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:34.850 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:34.851 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.82837098399999998, 2024-04-23T19:01:34.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018444747000000001, 2024-04-23T19:01:34.851 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.851 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.851 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.851 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2122 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932716+0000", 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.159e-06 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937085+0000", 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043697329999999998 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937119+0000", 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3586e-05 2024-04-23T19:01:34.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937134+0000", 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4995e-05 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937228+0000", 2024-04-23T19:01:34.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4450000000000005e-05 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937404+0000", 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000175959 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937565+0000", 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016108999999999999 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.950657+0000", 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013091139999999999 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951001+0000", 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000344271 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951087+0000", 2024-04-23T19:01:34.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6594000000000005e-05 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951158+0000", 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0770000000000002e-05 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.860 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2124 3.20 3:06396830:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.953423+0000", 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.80766169300000001, 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015961718, 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2124 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.953423+0000", 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.953423+0000", 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.953425+0000", 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.957507+0000", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040820869999999999 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.957548+0000", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1424999999999997e-05 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.957567+0000", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8734000000000001e-05 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.957700+0000", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013283699999999999 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.957869+0000", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016942199999999999 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.958009+0000", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139992 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.967196+0000", 2024-04-23T19:01:34.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0091866980000000001 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969263+0000", 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0020672899999999998 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969321+0000", 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7983999999999999e-05 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969384+0000", 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3046000000000006e-05 2024-04-23T19:01:34.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2135 3.26 3:66cd9a47:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.69130004300000003, 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016955900999999999, 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.866 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2135 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069787+0000", 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.694e-06 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.073999+0000", 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042116469999999998 2024-04-23T19:01:34.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074024+0000", 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5264000000000001e-05 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074036+0000", 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1773000000000001e-05 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074110+0000", 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4214999999999993e-05 2024-04-23T19:01:34.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074253+0000", 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014303100000000001 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074360+0000", 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107318 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086400+0000", 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012039574000000001 2024-04-23T19:01:34.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086656+0000", 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256469 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086702+0000", 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5985000000000001e-05 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086740+0000", 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7931e-05 2024-04-23T19:01:34.871 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2137 3.34 e56/20 3:2fdd6a5a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_36:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.094957+0000", 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.66612754399999996, 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011506994, 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094957+0000", 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094957+0000", 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094959+0000", 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.08e-06 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.098470+0000", 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035110089999999998 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.098504+0000", 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3816000000000003e-05 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.098520+0000", 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6614000000000001e-05 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.098599+0000", 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8545000000000001e-05 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.098639+0000", 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0485000000000003e-05 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106400+0000", 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077605599999999997 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106464+0000", 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3885000000000002e-05 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.876 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2142 3.26 3:6505eb65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.62080099399999999, 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016460737, 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2142 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140287+0000", 2024-04-23T19:01:34.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144147+0000", 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599770000000001 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144168+0000", 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1328999999999999e-05 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144177+0000", 2024-04-23T19:01:34.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1749999999999994e-06 2024-04-23T19:01:34.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144257+0000", 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9913000000000006e-05 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144408+0000", 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000151056 2024-04-23T19:01:34.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:34.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144539+0000", 2024-04-23T19:01:34.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013111899999999999 2024-04-23T19:01:34.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.153118+0000", 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085787459999999999 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156562+0000", 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034444940000000002 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156663+0000", 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010056399999999999 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156744+0000", 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1148000000000003e-05 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.884 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2149 3.34 e56/20 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head v 56'3, mlcod=56'1)", 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.217748+0000", 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.54333613000000003, 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015904349000000002, 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217748+0000", 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217748+0000", 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217751+0000", 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4499999999999998e-06 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.219944+0000", 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0021933289999999999 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.219984+0000", 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9530000000000003e-05 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.220002+0000", 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8433000000000001e-05 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.220139+0000", 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013724200000000001 2024-04-23T19:01:34.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.220183+0000", 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3409999999999999e-05 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233470+0000", 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013287471 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233653+0000", 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018248400000000001 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.888 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2157 3.10 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.46761940099999999, 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019824521000000001, 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2157 2024-04-23T19:01:34.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293467+0000", 2024-04-23T19:01:34.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3089999999999998e-06 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297404+0000", 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039368550000000004 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297432+0000", 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7931000000000001e-05 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297444+0000", 2024-04-23T19:01:34.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1508000000000001e-05 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297536+0000", 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2513e-05 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297733+0000", 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019660000000000001 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297970+0000", 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023758399999999999 2024-04-23T19:01:34.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.305333+0000", 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073631290000000004 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313164+0000", 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078300209999999995 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313231+0000", 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7168000000000005e-05 2024-04-23T19:01:34.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313290+0000", 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8903000000000002e-05 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2165 3.33 e56/20 3:cf8f2e43:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_64:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.390122+0000", 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.37096195999999998, 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010703913000000001, 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.894 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.390122+0000", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.390122+0000", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.390125+0000", 2024-04-23T19:01:34.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3590000000000002e-06 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.394750+0000", 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046247620000000001 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.394768+0000", 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8206000000000002e-05 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.394775+0000", 2024-04-23T19:01:34.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6159999999999996e-06 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.394837+0000", 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1345000000000003e-05 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.394854+0000", 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7374999999999999e-05 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.400761+0000", 2024-04-23T19:01:34.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059065309999999996 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.400826+0000", 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.5718999999999999e-05 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2168 3.3f e56/20 3:fc75b714:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_67:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.422585+0000", 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.33849902399999998, 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012836904, 2024-04-23T19:01:34.898 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422585+0000", 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422585+0000", 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:34.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422587+0000", 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8050000000000001e-06 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.424919+0000", 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0023314249999999998 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.424946+0000", 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7497000000000001e-05 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:34.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.424961+0000", 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5301000000000001e-05 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.425076+0000", 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114063 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.425126+0000", 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0274e-05 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:34.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.435367+0000", 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010241358000000001 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.435422+0000", 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5180999999999999e-05 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:34.902 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:34.904 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:34.904 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:34.903+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:35.004 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:35.007+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:35.025 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.018808192000000001, 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018863710999999998, 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "waiting for sub ops", 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.099 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:01:35.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:01:35.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: ], 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 1 2024-04-23T19:01:35.103 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:35.104 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:35.107+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:35.121 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:35.206 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:35.205+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:35.261 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:35.262 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:35.282 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:35.326 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:35.325+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:35.407 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:35.405+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:35.463 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 92.293207737000003, 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.464 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:01:35.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:01:35.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.560921335000003, 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.470 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:01:35.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:35.475 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.560751355999997, 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:35.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:01:35.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:01:35.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:01:35.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:01:35.480 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.560700789999999, 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:01:35.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:01:35.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:01:35.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.560558451000006, 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.486 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:35.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:01:35.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:01:35.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:01:35.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.560355150000007, 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.560315966000005, 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:35.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2146 3.37 3:ede80064:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.180142+0000", 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.2841692, 2024-04-23T19:01:35.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018058694, 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2146 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.180142+0000", 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.180142+0000", 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.180144+0000", 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3140000000000002e-06 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.184120+0000", 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039758909999999996 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.184148+0000", 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7569999999999999e-05 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.184161+0000", 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2649999999999999e-05 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.184249+0000", 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.8876999999999996e-05 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.184402+0000", 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0001526 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.184541+0000", 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138641 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.193457+0000", 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0089158640000000008 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.197911+0000", 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044544770000000001 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.198073+0000", 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000161471 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.198201+0000", 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012833899999999999 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.507 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2155 3.e 3:7394e207:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.192180214, 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019575268999999999, 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2155 2024-04-23T19:01:35.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272134+0000", 2024-04-23T19:01:35.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.514e-06 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.275986+0000", 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038527090000000002 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276009+0000", 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2949e-05 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276020+0000", 2024-04-23T19:01:35.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0893000000000001e-05 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276096+0000", 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5844000000000001e-05 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276285+0000", 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000189073 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276427+0000", 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014148700000000001 2024-04-23T19:01:35.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291495+0000", 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015068152 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291548+0000", 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3384999999999998e-05 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291660+0000", 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111712 2024-04-23T19:01:35.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291706+0000", 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6551000000000002e-05 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2168 3.3f 3:fc75b714:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.418419+0000", 2024-04-23T19:01:35.513 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.0458928700000001, 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017473645999999999, 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2168 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.418419+0000", 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.418419+0000", 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.418421+0000", 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.323e-06 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422097+0000", 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036759509999999998 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422117+0000", 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0670999999999999e-05 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422126+0000", 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6270000000000006e-06 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422190+0000", 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4411000000000004e-05 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422334+0000", 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014399200000000001 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.422456+0000", 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012171999999999999 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.434495+0000", 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012038371000000001 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.435710+0000", 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0012158220000000001 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.435814+0000", 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103755 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.435892+0000", 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8003000000000005e-05 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.518 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2189 3.e 3:71423415:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.543525+0000", 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.92078652100000002, 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019538560999999999, 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2189 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.543525+0000", 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.543525+0000", 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.543529+0000", 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0500000000000002e-06 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.547538+0000", 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040092399999999999 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.547578+0000", 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9993000000000001e-05 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.547598+0000", 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9599999999999999e-05 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.547742+0000", 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014432799999999999 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.547984+0000", 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000242375 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.548211+0000", 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000226677 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.561487+0000", 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013275861 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.562878+0000", 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0013909020000000001 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.562984+0000", 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000106399 2024-04-23T19:01:35.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.563063+0000", 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9135999999999996e-05 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2198 3.2d 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.79001006500000004, 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019840345999999998, 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.524 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2198 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674304+0000", 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678249+0000", 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039455699999999998 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678275+0000", 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6322e-05 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678287+0000", 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1533e-05 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678382+0000", 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5379999999999998e-05 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678559+0000", 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000176787 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678678+0000", 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011892000000000001 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.685235+0000", 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065573610000000003 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.693941+0000", 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087059919999999992 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694056+0000", 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011435200000000001 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694142+0000", 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5915000000000007e-05 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.529 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2202 3.3f 3:fcdbdc32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.71832701099999996, 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019991346, 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.530 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2202 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745987+0000", 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.305e-06 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749881+0000", 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038945059999999998 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749910+0000", 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9164000000000001e-05 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749925+0000", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4443999999999999e-05 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750113+0000", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018781700000000001 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750360+0000", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024755000000000003 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750598+0000", 2024-04-23T19:01:35.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237498 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.763676+0000", 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01307818 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765795+0000", 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002119297 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765897+0000", 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101619 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765976+0000", 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8966000000000003e-05 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2205 3.2d 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.66589282900000002, 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021534458999999999, 2024-04-23T19:01:35.535 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2205 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798421+0000", 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4370000000000001e-06 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802242+0000", 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038212939999999998 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802263+0000", 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0543e-05 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802273+0000", 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0248000000000001e-05 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802427+0000", 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015376100000000001 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802688+0000", 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026095699999999998 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802960+0000", 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027196700000000002 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.814078+0000", 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011118031 2024-04-23T19:01:35.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819767+0000", 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056894629999999996 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819878+0000", 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011114499999999999 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819953+0000", 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4612999999999999e-05 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.540 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.38168487200000001, 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021578863, 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:01:35.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:01:35.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:01:35.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103605+0000", 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012893465999999999 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103925+0000", 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032048599999999998 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104067+0000", 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014224100000000001 2024-04-23T19:01:35.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104205+0000", 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013803200000000001 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.34752924200000002, 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.546 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:01:35.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:01:35.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2231 3.3f 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.236492124, 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021281242999999998, 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.550 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2231 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227821+0000", 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499999999999999e-06 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231570+0000", 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037486009999999998 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231593+0000", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3295999999999999e-05 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231602+0000", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9330000000000007e-06 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231729+0000", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012735200000000001 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232086+0000", 2024-04-23T19:01:35.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000356635 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232429+0000", 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034333600000000002 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.245402+0000", 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012972450999999999 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249012+0000", 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036096840000000002 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249058+0000", 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6462999999999999e-05 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249100+0000", 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2441999999999998e-05 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2234 3.2d 3:b47af76e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.257222+0000", 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.207089419, 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017843827, 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2234 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.257222+0000", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.257222+0000", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.257236+0000", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4450999999999999e-05 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.261589+0000", 2024-04-23T19:01:35.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043523570000000003 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.261621+0000", 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2243000000000003e-05 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.261636+0000", 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5461999999999999e-05 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.261717+0000", 2024-04-23T19:01:35.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0310999999999997e-05 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.261825+0000", 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107953 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.261917+0000", 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2627000000000006e-05 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.269838+0000", 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079208560000000004 2024-04-23T19:01:35.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.274945+0000", 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051072699999999997 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.275015+0000", 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9017999999999995e-05 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.275066+0000", 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1279000000000002e-05 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.560 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2235 3.e 3:702f84cd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.267693+0000", 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.19661838800000001, 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018266072000000001, 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2235 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.561 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.267693+0000", 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.267693+0000", 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.267696+0000", 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0879999999999999e-06 2024-04-23T19:01:35.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.272100+0000", 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004403957 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.272128+0000", 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8068e-05 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.272145+0000", 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:01:35.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.272220+0000", 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4517000000000005e-05 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.272398+0000", 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000177899 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.272560+0000", 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016276299999999999 2024-04-23T19:01:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.283967+0000", 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011406904000000001 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.285886+0000", 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019183469999999999 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.285924+0000", 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8173000000000002e-05 2024-04-23T19:01:35.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.285959+0000", 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5216000000000003e-05 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2239 3.15 3:aae2b85a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.318375+0000", 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.14593650799999999, 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017427037999999999, 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:35.566 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2239 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.318375+0000", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.318375+0000", 2024-04-23T19:01:35.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.318377+0000", 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5500000000000001e-06 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.322124+0000", 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037465340000000001 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.322144+0000", 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0341999999999999e-05 2024-04-23T19:01:35.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.322153+0000", 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2199999999999992e-06 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.322222+0000", 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9010999999999994e-05 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:35.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.322390+0000", 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168507 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.322513+0000", 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012336700000000001 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.328760+0000", 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0062469930000000002 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:35.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.335699+0000", 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069383839999999997 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.335738+0000", 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9190000000000003e-05 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.335802+0000", 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3940000000000001e-05 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.571 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:35.572 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:35.572 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:35.573 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:35.569+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:35.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:35.674 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:35.673+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:35.715 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:35.715 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:35.715 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:35.715 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:35.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:35.785 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:35.787+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:35.872 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:35.872 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:35.872 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:35.872 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:35.872 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:35.876 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:35.875+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:35.893 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:35.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:35.989 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:35.991+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:36.077 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:36.079+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1243 3.2b 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:36.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.278378077999999, 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016938254999999999, 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1243 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821419+0000", 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9289999999999998e-06 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824120+0000", 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027012009999999999 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824153+0000", 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2663999999999998e-05 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824168+0000", 2024-04-23T19:01:36.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5747999999999999e-05 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824249+0000", 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0492000000000001e-05 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824367+0000", 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117768 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824480+0000", 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011374699999999999 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.836387+0000", 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011906699999999999 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838288+0000", 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900606 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838322+0000", 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4363000000000003e-05 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838354+0000", 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2036999999999998e-05 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.273943418, 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:36.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2114 3.1 3:8002664d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.2448051790000001, 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017114279, 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2114 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854992+0000", 2024-04-23T19:01:36.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5080000000000001e-06 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856342+0000", 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001349299 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856377+0000", 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5281000000000003e-05 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856392+0000", 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4739999999999999e-05 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856485+0000", 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3214999999999994e-05 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856617+0000", 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013243099999999999 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856748+0000", 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013113799999999999 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.862501+0000", 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057523319999999998 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871755+0000", 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092546959999999998 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871911+0000", 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015593700000000001 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.872103+0000", 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191702 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2117 3.12 3:4a6ac759:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.117 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.2152669839999999, 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013830090999999999, 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2117 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884530+0000", 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9040000000000001e-06 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886120+0000", 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001589823 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886143+0000", 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159999999999998e-05 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886152+0000", 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3409999999999992e-06 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886218+0000", 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6157999999999999e-05 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886341+0000", 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245100000000001 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886461+0000", 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120381 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.892686+0000", 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062244099999999997 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898130+0000", 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054443349999999998 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898186+0000", 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6199999999999997e-05 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898357+0000", 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017092799999999999 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2121 3.12 3:4ab0d216:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.1771690480000001, 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015267064, 2024-04-23T19:01:36.123 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2121 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922628+0000", 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6639999999999998e-06 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924374+0000", 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017465239999999999 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924405+0000", 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1035999999999999e-05 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924420+0000", 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4552000000000001e-05 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924517+0000", 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6953999999999994e-05 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924704+0000", 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187073 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924878+0000", 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017427299999999999 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.933464+0000", 2024-04-23T19:01:36.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085861029999999994 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937770+0000", 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043062389999999999 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937839+0000", 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8887999999999995e-05 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937892+0000", 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2757999999999999e-05 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2127 3.12 3:49e657d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.1138421090000001, 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014820902, 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.129 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2127 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985954+0000", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987681+0000", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726265 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987709+0000", 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8496e-05 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987723+0000", 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4433000000000001e-05 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987794+0000", 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0783000000000003e-05 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987915+0000", 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120518 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.988028+0000", 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113268 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.994241+0000", 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062126689999999997 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000685+0000", 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064444890000000003 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000731+0000", 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5562999999999997e-05 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000773+0000", 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2001e-05 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.134 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2131 3.1 3:82b86334:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.026640+0000", 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.0731537950000001, 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013388440999999999, 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2131 2024-04-23T19:01:36.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.026640+0000", 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.026640+0000", 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.026643+0000", 2024-04-23T19:01:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4049999999999998e-06 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.028148+0000", 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001505555 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.028170+0000", 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1758000000000001e-05 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.028184+0000", 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4504e-05 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.028276+0000", 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1927000000000003e-05 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.028441+0000", 2024-04-23T19:01:36.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016507699999999999 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.028562+0000", 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121107 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.036376+0000", 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078135930000000006 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.039947+0000", 2024-04-23T19:01:36.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035707830000000001 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.039992+0000", 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5321999999999997e-05 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.040029+0000", 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6409999999999999e-05 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2143 3.1 3:818c3cf4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.9497131219999999, 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014844245000000001, 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2143 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.141 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150084+0000", 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2600000000000001e-06 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151570+0000", 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014861189999999999 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151604+0000", 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151621+0000", 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6144e-05 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151697+0000", 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6377000000000004e-05 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151869+0000", 2024-04-23T19:01:36.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017231000000000001 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151968+0000", 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8455999999999994e-05 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.159112+0000", 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071439989999999998 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164808+0000", 2024-04-23T19:01:36.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005696301 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164872+0000", 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3615999999999995e-05 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164925+0000", 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3439000000000001e-05 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2144 3.1 3:822f1bc9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.939726329, 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01381895, 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2144 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160069+0000", 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8679999999999999e-06 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161620+0000", 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015505709999999999 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161644+0000", 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4269000000000001e-05 2024-04-23T19:01:36.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161655+0000", 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161722+0000", 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7409000000000005e-05 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161859+0000", 2024-04-23T19:01:36.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013668099999999999 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161961+0000", 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102273 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.168267+0000", 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063061339999999997 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173766+0000", 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054986849999999997 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173835+0000", 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9140999999999994e-05 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173887+0000", 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1480999999999997e-05 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2157 3.10 e56/20 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.800993793, 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014718479, 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298802+0000", 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.869e-06 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302934+0000", 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041324459999999997 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302962+0000", 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7302000000000001e-05 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302975+0000", 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3349999999999999e-05 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303059+0000", 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3782999999999994e-05 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303086+0000", 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7436999999999998e-05 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313460+0000", 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010373408000000001 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313519+0000", 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8884000000000001e-05 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2161 3.12 3:4ba64ee9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.7594076869999999, 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016255067000000002, 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.157 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2161 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:36.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340390+0000", 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.455e-06 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342958+0000", 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025682109999999999 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342988+0000", 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0199999999999999e-05 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343002+0000", 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3769e-05 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343083+0000", 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0687999999999997e-05 2024-04-23T19:01:36.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343237+0000", 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015475600000000001 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343340+0000", 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102834 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.349457+0000", 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061166229999999999 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356502+0000", 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070452609999999997 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356576+0000", 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3526e-05 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356641+0000", 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5743999999999999e-05 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2199 3.3a e56/20 3:5e791802:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_88:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.696415+0000", 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.4033792359999999, 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013149269999999999, 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.165 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.696415+0000", 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.696415+0000", 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.696417+0000", 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4439999999999998e-06 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.701394+0000", 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049769039999999999 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.701442+0000", 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7942999999999998e-05 2024-04-23T19:01:36.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.701468+0000", 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5632000000000001e-05 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.701563+0000", 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5649999999999994e-05 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.701591+0000", 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7889e-05 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.709431+0000", 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078398949999999995 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.709564+0000", 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013291299999999999 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.169 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.185042234, 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2215 3.b e56/20 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.0897348120000001, 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015142766, 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010061+0000", 2024-04-23T19:01:36.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2520000000000002e-06 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013225+0000", 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003163622 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013274+0000", 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9471000000000001e-05 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013298+0000", 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3628000000000001e-05 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013434+0000", 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013560699999999999 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013475+0000", 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0938e-05 2024-04-23T19:01:36.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025068+0000", 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011593440999999999 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025202+0000", 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133807 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.178 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.0548794050000001, 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:01:36.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:01:36.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:01:36.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2233 3.3a e57/20 3:5c6ef8e1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_122:head v 57'3, mlcod=53'1)", 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.84780218200000002, 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014404780000000001, 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.185 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251994+0000", 2024-04-23T19:01:36.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.784e-06 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255871+0000", 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00387762 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255901+0000", 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9901000000000001e-05 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255914+0000", 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.328e-05 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256041+0000", 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012621299999999999 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256080+0000", 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9245000000000001e-05 2024-04-23T19:01:36.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266324+0000", 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010244659999999999 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266397+0000", 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2076999999999994e-05 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2236 3.12 3:48057a70:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.288528+0000", 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.81126605100000004, 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013551532999999999, 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2236 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.288528+0000", 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.288528+0000", 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.288531+0000", 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.61e-06 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.290373+0000", 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001842345 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.290408+0000", 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4802000000000003e-05 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.290430+0000", 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2367000000000001e-05 2024-04-23T19:01:36.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.290564+0000", 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013439800000000001 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.290872+0000", 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030728199999999998 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.291228+0000", 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00035635000000000002 2024-04-23T19:01:36.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299942+0000", 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087138749999999994 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.301826+0000", 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001884022 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.301968+0000", 2024-04-23T19:01:36.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014187 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302079+0000", 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111612 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.71737085, 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:01:36.195 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:01:36.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.199 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2251 3.32 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.63313245500000004, 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015905636000000001, 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2251 2024-04-23T19:01:36.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466664+0000", 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469135+0000", 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002470164 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469164+0000", 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9115000000000002e-05 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469182+0000", 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8726999999999999e-05 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469306+0000", 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012313600000000001 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469497+0000", 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019168399999999999 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469679+0000", 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018196600000000001 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.476311+0000", 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066314629999999998 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482438+0000", 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061275449999999999 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482508+0000", 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9795999999999994e-05 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482567+0000", 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9166999999999998e-05 2024-04-23T19:01:36.205 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2265 3.32 3:4d8b1756:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.43467179299999997, 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013967738, 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:36.206 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2265 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665125+0000", 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1769999999999998e-06 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667169+0000", 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020441040000000001 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667217+0000", 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7262000000000003e-05 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667245+0000", 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7888000000000001e-05 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667343+0000", 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8782000000000004e-05 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667487+0000", 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143597 2024-04-23T19:01:36.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667644+0000", 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697700000000001 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678434+0000", 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010789801 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678995+0000", 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000560802 2024-04-23T19:01:36.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679045+0000", 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0868000000000002e-05 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679090+0000", 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4480000000000001e-05 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:36.211 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:36.214 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:36.214 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:36.215 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:36.215 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:36.215 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:36.215 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:36.209+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:36.227 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:36.227 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:36.249 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:36.249 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:36.289 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:36.290 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:36.314 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:36.313+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:36.323 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:36.323 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:36.352 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:36.353 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:36.381 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:36.381 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:36.382 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:36.382 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:36.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:36.457 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:36.459+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:36.516 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:36.515+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:36.606 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:36.606 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:36.616 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:36.613+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:36.627 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:36.717 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:36.713+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:36.791 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:36.792 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:36.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:36.818 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:36.817+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:36.829 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 1Gb. 2024-04-23T19:01:36.829 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:01:36.829 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:36.829 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-04-23T19:01:36.830 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:01:36.919 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:36.917+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:36.928 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:36.987 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:36.989 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:37.032 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:37.035+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:37.062 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:01:37.113 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:01:37.113 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:01:37.121 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:37.121+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:37.162 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:37.162 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:37.178 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:37.222 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:37.223+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:37.323 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:37.321+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:37.340 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:37.340 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:37.356 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:37.424 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:37.421+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:37.477 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:37.477 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:37.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:37.525 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:37.521+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:37.614 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:37.615 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:37.626 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:37.625+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:37.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:37.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T19:01:37.680 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-23T19:01:37.728 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:37.731+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:37.753 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:37.753 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:37.770 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:37.828 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:37.825+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:37.904 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:37.904 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:37.919 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:37.929 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:37.931+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:38.030 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:38.029+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:38.063 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:01:38.064 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.0 to 1 (10000) 2024-04-23T19:01:38.095 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:38.095 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:38.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-23T19:01:38.109 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:38.154 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:38.153+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:38.232 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:38.229+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:38.274 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:38.274 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:38.288 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:38.333 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:38.335+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:38.414 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:38.433 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:38.429+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:38.455 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:38.455 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:38.469 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:38.534 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:38.535+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:38.556 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:38.556 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:38.573 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:38.574 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:38.590 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:38.590 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:38.606 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:38.607 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:38.625 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:38.626 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:38.635 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:38.635+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:38.640 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:38.640 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:38.646 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:38.646 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:38.655 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:38.664 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:38.665 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:38.683 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:38.683 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:38.744 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:38.747+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:38.782 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.920558485000001, 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.783 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:01:38.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1113 3.28 3:171e86a1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.895642130999999, 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019880546999999998, 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.789 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1113 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886025+0000", 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.886026+0000", 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3300000000000001e-07 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889886+0000", 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599490000000001 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889908+0000", 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2824e-05 2024-04-23T19:01:38.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.889918+0000", 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.893e-06 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890103+0000", 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018468900000000001 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.890374+0000", 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027112300000000001 2024-04-23T19:01:38.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.891238+0000", 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00086359200000000005 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.902456+0000", 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011218271 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905711+0000", 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032550919999999998 2024-04-23T19:01:38.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905828+0000", 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117365 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.905905+0000", 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6915999999999993e-05 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.794 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2132 3.28 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7453293439999999, 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021363914000000001, 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2132 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.795 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036340+0000", 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040181+0000", 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038414909999999998 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040205+0000", 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3711e-05 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040217+0000", 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1467e-05 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040291+0000", 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4610000000000006e-05 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040422+0000", 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131297 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040539+0000", 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011694899999999999 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.047401+0000", 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068619040000000003 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057538+0000", 2024-04-23T19:01:38.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010136915999999999 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057634+0000", 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5923999999999998e-05 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057701+0000", 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7291000000000003e-05 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.5590372380000002, 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:01:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.806 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2206 3.28 3:157eedf5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.816017+0000", 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.9656494860000002, 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020417179000000001, 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2206 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.816017+0000", 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.816017+0000", 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.816021+0000", 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1640000000000001e-06 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.820034+0000", 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040134330000000003 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.820071+0000", 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7353e-05 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.820087+0000", 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5855999999999999e-05 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.820162+0000", 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4499999999999995e-05 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.820268+0000", 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010652 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.820364+0000", 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5891999999999996e-05 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.824853+0000", 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004489046 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.836358+0000", 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011505339999999999 2024-04-23T19:01:38.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.836400+0000", 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1241e-05 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.836435+0000", 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4833999999999999e-05 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.8946848200000002, 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:01:38.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:01:38.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:01:38.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:01:38.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.87252631, 2024-04-23T19:01:38.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.7246021950000001, 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:01:38.824 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:01:38.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:01:38.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.6736611249999997, 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:01:38.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.6697979260000002, 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.835 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:01:38.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:01:38.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.1597752990000001, 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.841 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.1402508450000002, 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.845 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:01:38.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:01:38.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.083717541, 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.851 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:01:38.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:01:38.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0080901450000002, 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2275 3.16 3:6ac76e5a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.793337+0000", 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.988330097, 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020143692000000001, 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2275 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.863 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.793337+0000", 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.793337+0000", 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.793340+0000", 2024-04-23T19:01:38.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2880000000000001e-06 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.798758+0000", 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005417982 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.798794+0000", 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6205000000000003e-05 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.798817+0000", 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2829000000000001e-05 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.798950+0000", 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013334499999999999 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.799180+0000", 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022993699999999999 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.799405+0000", 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224491 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809211+0000", 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098063460000000005 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.813157+0000", 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039462569999999999 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.813344+0000", 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186584 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.813480+0000", 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013642799999999999 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.8070020100000002, 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:01:38.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:01:38.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.598109929, 2024-04-23T19:01:38.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:01:38.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.880 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2312 3.30 3:0df37fa5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.244835+0000", 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.5368320440000001, 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020997056, 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2312 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.244835+0000", 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.244835+0000", 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.244840+0000", 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1070000000000004e-06 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.249216+0000", 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043761829999999996 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.249257+0000", 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0880000000000002e-05 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.249276+0000", 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9403e-05 2024-04-23T19:01:38.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.249408+0000", 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013125499999999999 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.249682+0000", 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027465699999999998 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:38.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.249973+0000", 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029029700000000002 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.262744+0000", 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012771006999999999 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.265657+0000", 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002913742 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.265751+0000", 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3726000000000004e-05 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.265832+0000", 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0798999999999997e-05 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2313 3.c 3:30fd00ab:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.254511+0000", 2024-04-23T19:01:38.886 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.5271555970000001, 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021192193000000002, 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2313 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254511+0000", 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254511+0000", 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254515+0000", 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6629999999999999e-06 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261256+0000", 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067410450000000002 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261289+0000", 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3266000000000003e-05 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261306+0000", 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261435+0000", 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012880199999999999 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261706+0000", 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027071000000000002 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261943+0000", 2024-04-23T19:01:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023696399999999999 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.270710+0000", 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087674829999999995 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.275361+0000", 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00465081 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.275566+0000", 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000204778 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.275703+0000", 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137532 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2316 3.38 e57/20 3:1e1defce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_205:head v 57'5, mlcod=57'3)", 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.290090+0000", 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.4915766590000001, 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020203974, 2024-04-23T19:01:38.892 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.290090+0000", 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.290090+0000", 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:38.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.290093+0000", 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.317e-06 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298732+0000", 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086391409999999995 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298764+0000", 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2716000000000003e-05 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298781+0000", 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6387000000000001e-05 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298929+0000", 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014793200000000001 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.299022+0000", 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3444999999999997e-05 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.310190+0000", 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011167797 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.310294+0000", 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104239 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:38.896 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:38.898 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:38.898 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:38.897+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:38.998 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:38.997+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:39.069 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:39.069 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:39.069 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:39.070 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:39.074 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.1 to 1 (10000) 2024-04-23T19:01:39.091 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:39.099 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:39.099+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:39.111 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-23T19:01:39.200 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:39.197+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:39.258 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:39.258 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:39.258 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:39.258 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:39.258 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:39.273 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:39.301 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:39.303+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:39.401 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:39.403+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:39.442 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 76.130183936999998, 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:39.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2122 3.35 3:ac268df4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:39.449 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.5086058380000003, 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018444747000000001, 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2122 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:39.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932716+0000", 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.159e-06 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937085+0000", 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043697329999999998 2024-04-23T19:01:39.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937119+0000", 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3586e-05 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937134+0000", 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4995e-05 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937228+0000", 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4450000000000005e-05 2024-04-23T19:01:39.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937404+0000", 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000175959 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937565+0000", 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016108999999999999 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.950657+0000", 2024-04-23T19:01:39.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013091139999999999 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951001+0000", 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000344271 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951087+0000", 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6594000000000005e-05 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951158+0000", 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0770000000000002e-05 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2135 3.26 3:66cd9a47:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3715348970000001, 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016955900999999999, 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.455 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2135 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069787+0000", 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.694e-06 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.073999+0000", 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042116469999999998 2024-04-23T19:01:39.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074024+0000", 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5264000000000001e-05 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074036+0000", 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1773000000000001e-05 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074110+0000", 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4214999999999993e-05 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074253+0000", 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014303100000000001 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074360+0000", 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107318 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086400+0000", 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012039574000000001 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086656+0000", 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256469 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086702+0000", 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5985000000000001e-05 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086740+0000", 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7931e-05 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2142 3.26 3:6505eb65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3010358479999997, 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016460737, 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2142 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140287+0000", 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144147+0000", 2024-04-23T19:01:39.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599770000000001 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144168+0000", 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1328999999999999e-05 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144177+0000", 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1749999999999994e-06 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144257+0000", 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9913000000000006e-05 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144408+0000", 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000151056 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144539+0000", 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013111899999999999 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.153118+0000", 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085787459999999999 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156562+0000", 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034444940000000002 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156663+0000", 2024-04-23T19:01:39.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010056399999999999 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156744+0000", 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1148000000000003e-05 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2157 3.10 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1478542550000004, 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019824521000000001, 2024-04-23T19:01:39.467 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2157 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293467+0000", 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3089999999999998e-06 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297404+0000", 2024-04-23T19:01:39.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039368550000000004 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297432+0000", 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7931000000000001e-05 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297444+0000", 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1508000000000001e-05 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297536+0000", 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2513e-05 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297733+0000", 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019660000000000001 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297970+0000", 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023758399999999999 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.305333+0000", 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073631290000000004 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313164+0000", 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078300209999999995 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313231+0000", 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7168000000000005e-05 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313290+0000", 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8903000000000002e-05 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2190 3.1e e56/20 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.8814835299999997, 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015976137000000001, 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.473 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559838+0000", 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564659+0000", 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048211950000000003 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564700+0000", 2024-04-23T19:01:39.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1159999999999999e-05 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564717+0000", 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6543000000000001e-05 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564880+0000", 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163272 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564935+0000", 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4632000000000001e-05 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.575758+0000", 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010822915000000001 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.575812+0000", 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4237000000000003e-05 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.477 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2201 3.a 3:531f5619:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7167817129999996, 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017986076, 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.478 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2201 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724541+0000", 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0139999999999999e-06 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728829+0000", 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004288877 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728873+0000", 2024-04-23T19:01:39.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3457000000000001e-05 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728891+0000", 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8122999999999999e-05 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728990+0000", 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9127000000000001e-05 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.729175+0000", 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018525799999999999 2024-04-23T19:01:39.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.729338+0000", 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016262000000000001 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.736796+0000", 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074580870000000004 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742396+0000", 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055994080000000002 2024-04-23T19:01:39.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742464+0000", 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8662000000000001e-05 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742524+0000", 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9443e-05 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3451977189999997, 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.484 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:01:39.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2231 3.3f e57/20 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:39.490 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.2086169360000003, 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016114270999999999, 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232703+0000", 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0800000000000004e-07 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235193+0000", 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024894169999999998 2024-04-23T19:01:39.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235226+0000", 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3810999999999999e-05 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235242+0000", 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.558e-05 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235334+0000", 2024-04-23T19:01:39.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1736000000000004e-05 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235355+0000", 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1691e-05 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.248745+0000", 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01338981 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.248817+0000", 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1518000000000002e-05 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2242 3.a 3:509848d5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.0836064959999998, 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016205213999999999, 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.495 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2242 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357715+0000", 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3709999999999998e-06 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361530+0000", 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038150910000000001 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361551+0000", 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0514999999999999e-05 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361562+0000", 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1445e-05 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361630+0000", 2024-04-23T19:01:39.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8101000000000004e-05 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361736+0000", 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010526000000000001 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361841+0000", 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105863 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373149+0000", 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307661 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373842+0000", 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00069307099999999996 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373879+0000", 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6792999999999998e-05 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373918+0000", 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9042999999999999e-05 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2249 3.35 3:ae24b40c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.0044968709999997, 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685019999999999, 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.501 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2249 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436826+0000", 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.507e-06 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440809+0000", 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039834889999999998 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440848+0000", 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8189999999999999e-05 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440873+0000", 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5313e-05 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440998+0000", 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012463700000000001 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.441213+0000", 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215183 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.441385+0000", 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017184500000000001 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.448887+0000", 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075019520000000001 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454385+0000", 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054989130000000002 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454452+0000", 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6635000000000002e-05 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454507+0000", 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5356000000000003e-05 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2252 3.35 3:adca29dd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.9573159110000002, 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016301998000000002, 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.507 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2252 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484006+0000", 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0000000000000001e-06 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487732+0000", 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037260729999999999 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487756+0000", 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3226000000000001e-05 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487770+0000", 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4714e-05 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487923+0000", 2024-04-23T19:01:39.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015277800000000001 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.488177+0000", 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025382699999999998 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.488427+0000", 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025014699999999999 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.498240+0000", 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009812856 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500143+0000", 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019034360000000001 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500222+0000", 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8545000000000001e-05 2024-04-23T19:01:39.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500305+0000", 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3395999999999999e-05 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2262 3.20 3:05df02c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.8106523619999999, 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019440939000000001, 2024-04-23T19:01:39.513 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2262 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630669+0000", 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.542e-06 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634459+0000", 2024-04-23T19:01:39.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037898820000000001 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634487+0000", 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7691999999999998e-05 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634499+0000", 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2413e-05 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634632+0000", 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132051 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634896+0000", 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026448999999999998 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.635126+0000", 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023023100000000001 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.649368+0000", 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014241517 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.649913+0000", 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054570599999999997 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.650001+0000", 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7293000000000006e-05 2024-04-23T19:01:39.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.650108+0000", 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107122 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.754097529, 2024-04-23T19:01:39.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:01:39.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:01:39.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2271 3.20 3:04eeff99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.6988452729999999, 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019123983000000001, 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.525 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2271 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742479+0000", 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5600000000000004e-06 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746899+0000", 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044202349999999998 2024-04-23T19:01:39.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746938+0000", 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9002999999999999e-05 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746957+0000", 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9242999999999999e-05 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747141+0000", 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018355499999999999 2024-04-23T19:01:39.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747511+0000", 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037069199999999999 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747786+0000", 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027515699999999999 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.757116+0000", 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093292600000000007 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761429+0000", 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131599999999999 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761520+0000", 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0891999999999996e-05 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761598+0000", 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8226000000000006e-05 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.6578190429999999, 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:01:39.531 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:01:39.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:01:39.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.3941430220000002, 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:01:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:39.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:01:39.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:39.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.543 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.2890284759999999, 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:39.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:01:39.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2305 3.2e e57/20 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.2654194739999998, 2024-04-23T19:01:39.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016943086999999999, 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5730000000000002e-06 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180626+0000", 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047234290000000003 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180652+0000", 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6233000000000001e-05 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180667+0000", 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4514e-05 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180779+0000", 2024-04-23T19:01:39.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112868 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180819+0000", 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0015999999999998e-05 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.192748+0000", 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928068999999999 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.192843+0000", 2024-04-23T19:01:39.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5384999999999996e-05 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.1424552929999998, 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:39.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:39.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:39.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:01:39.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.560 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.560 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.560 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:39.560 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:39.560 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:39.562 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:39.562 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:39.557+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:39.662 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:39.663+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:39.732 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:39.732 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:39.732 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:39.732 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:39.746 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:39.790 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:39.789+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:39.865 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:39.865 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:39.865 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:39.865 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:39.865 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:39.865 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:39.861+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:39.878 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:39.965 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:39.967+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:40.050 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.878366468999999, 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.051 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.052 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.053 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:01:40.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:01:40.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:01:40.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:01:40.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:01:40.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:01:40.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:01:40.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:01:40.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.146080067, 2024-04-23T19:01:40.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:01:40.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.145910087999994, 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.070 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:40.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:01:40.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.076 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.145859521999995, 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.077 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:01:40.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.145717183000002, 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.083 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:40.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:01:40.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.145513882000003, 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.089 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.094 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 96.145474698000001, 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:01:40.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.100 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2155 3.e 3:7394e207:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.7773389460000004, 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019575268999999999, 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2155 2024-04-23T19:01:40.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272134+0000", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.514e-06 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.275986+0000", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038527090000000002 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276009+0000", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2949e-05 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276020+0000", 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0893000000000001e-05 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276096+0000", 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5844000000000001e-05 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276285+0000", 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000189073 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276427+0000", 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014148700000000001 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291495+0000", 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015068152 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291548+0000", 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3384999999999998e-05 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291660+0000", 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111712 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291706+0000", 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6551000000000002e-05 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2198 3.2d 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:40.106 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3751687969999997, 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019840345999999998, 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2198 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.107 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674304+0000", 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678249+0000", 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039455699999999998 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678275+0000", 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6322e-05 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678287+0000", 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1533e-05 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678382+0000", 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5379999999999998e-05 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678559+0000", 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000176787 2024-04-23T19:01:40.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678678+0000", 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011892000000000001 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.685235+0000", 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065573610000000003 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.693941+0000", 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087059919999999992 2024-04-23T19:01:40.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694056+0000", 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011435200000000001 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694142+0000", 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5915000000000007e-05 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.112 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2202 3.3f 3:fcdbdc32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.113 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:40.113 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3034857429999995, 2024-04-23T19:01:40.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019991346, 2024-04-23T19:01:40.113 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.113 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.113 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2202 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745987+0000", 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.305e-06 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749881+0000", 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038945059999999998 2024-04-23T19:01:40.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749910+0000", 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9164000000000001e-05 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749925+0000", 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4443999999999999e-05 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750113+0000", 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018781700000000001 2024-04-23T19:01:40.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750360+0000", 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024755000000000003 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750598+0000", 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237498 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.763676+0000", 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01307818 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765795+0000", 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002119297 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765897+0000", 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101619 2024-04-23T19:01:40.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765976+0000", 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8966000000000003e-05 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2205 3.2d 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.2510515609999997, 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021534458999999999, 2024-04-23T19:01:40.119 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2205 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798421+0000", 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4370000000000001e-06 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802242+0000", 2024-04-23T19:01:40.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038212939999999998 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802263+0000", 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0543e-05 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802273+0000", 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0248000000000001e-05 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802427+0000", 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015376100000000001 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802688+0000", 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026095699999999998 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802960+0000", 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027196700000000002 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.814078+0000", 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011118031 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819767+0000", 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056894629999999996 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819878+0000", 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011114499999999999 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819953+0000", 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4612999999999999e-05 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.125 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.9668436040000001, 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021578863, 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:01:40.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:01:40.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103605+0000", 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012893465999999999 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103925+0000", 2024-04-23T19:01:40.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032048599999999998 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104067+0000", 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014224100000000001 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104205+0000", 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013803200000000001 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.9326879740000003, 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:01:40.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:01:40.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:01:40.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2231 3.3f 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.8216508559999998, 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021281242999999998, 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2231 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227821+0000", 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499999999999999e-06 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231570+0000", 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037486009999999998 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231593+0000", 2024-04-23T19:01:40.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3295999999999999e-05 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231602+0000", 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9330000000000007e-06 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231729+0000", 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012735200000000001 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232086+0000", 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000356635 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232429+0000", 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034333600000000002 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.245402+0000", 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012972450999999999 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249012+0000", 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036096840000000002 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249058+0000", 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6462999999999999e-05 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249100+0000", 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2441999999999998e-05 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2246 3.d 3:b0736148:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.6487527809999998, 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019541955999999999, 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2246 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400720+0000", 2024-04-23T19:01:40.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3020000000000002e-06 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404442+0000", 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037224620000000002 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404474+0000", 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1953999999999999e-05 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404486+0000", 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1562999999999999e-05 2024-04-23T19:01:40.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404588+0000", 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010257 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404852+0000", 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026406599999999998 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.405237+0000", 2024-04-23T19:01:40.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000384612 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.419338+0000", 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014101058 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420099+0000", 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076121100000000003 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420189+0000", 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9458999999999998e-05 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420259+0000", 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0698999999999995e-05 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3571024270000001, 2024-04-23T19:01:40.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.152 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.284942129, 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:01:40.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2295 3.12 e57/20 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head v 57'8, mlcod=56'6)", 2024-04-23T19:01:40.158 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.9775243109999998, 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020893219000000001, 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071949+0000", 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5559999999999999e-06 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077385+0000", 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054361019999999999 2024-04-23T19:01:40.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077829+0000", 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044398899999999999 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.078932+0000", 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011023750000000001 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081607+0000", 2024-04-23T19:01:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026748969999999999 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081654+0000", 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7644e-05 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092752+0000", 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011097164 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092839+0000", 2024-04-23T19:01:40.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7491999999999995e-05 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2299 3.f 3:f2287333:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.9352566979999999, 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023125123000000001, 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.163 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2299 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114216+0000", 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5100000000000001e-06 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119361+0000", 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051446879999999997 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119396+0000", 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5812999999999997e-05 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119414+0000", 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7269999999999999e-05 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119583+0000", 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016943199999999999 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119990+0000", 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040668900000000001 2024-04-23T19:01:40.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.120394+0000", 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403755 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.129091+0000", 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086969969999999997 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137017+0000", 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079263489999999992 2024-04-23T19:01:40.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137206+0000", 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018926500000000001 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137339+0000", 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013235499999999999 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.168 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2311 3.d 3:b2884c89:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.8144137730000001, 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022499029, 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2311 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235060+0000", 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7759999999999999e-06 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238950+0000", 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038900689999999999 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238993+0000", 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3303000000000002e-05 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239013+0000", 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9879999999999999e-05 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239210+0000", 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019640400000000001 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239612+0000", 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040218900000000001 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.240031+0000", 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041938899999999999 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254300+0000", 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014269097 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257380+0000", 2024-04-23T19:01:40.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003079104 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257481+0000", 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101325 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257555+0000", 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4493000000000007e-05 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:40.174 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:40.175 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:40.175 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:01:40.177 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.2 to 1 (10000) 2024-04-23T19:01:40.178 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-23T19:01:40.178 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:40.175+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:40.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:40.277 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:40.273+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:40.345 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:40.345 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:40.345 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:40.345 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:40.363 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:40.413 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:40.415+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:40.476 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:40.477 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:40.477 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:40.478 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:40.477+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:40.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:40.579 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:40.577+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:40.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1243 3.2b 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.832459541999999, 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016938254999999999, 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1243 2024-04-23T19:01:40.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821419+0000", 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9289999999999998e-06 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824120+0000", 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027012009999999999 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824153+0000", 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2663999999999998e-05 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824168+0000", 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5747999999999999e-05 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824249+0000", 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0492000000000001e-05 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824367+0000", 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117768 2024-04-23T19:01:40.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824480+0000", 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011374699999999999 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.836387+0000", 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011906699999999999 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838288+0000", 2024-04-23T19:01:40.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900606 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838322+0000", 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4363000000000003e-05 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838354+0000", 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2036999999999998e-05 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.660 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.8280248820000002, 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.661 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:01:40.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:01:40.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:01:40.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2114 3.1 3:8002664d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.666 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.7988866430000003, 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017114279, 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2114 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854992+0000", 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5080000000000001e-06 2024-04-23T19:01:40.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856342+0000", 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001349299 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856377+0000", 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5281000000000003e-05 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856392+0000", 2024-04-23T19:01:40.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4739999999999999e-05 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856485+0000", 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3214999999999994e-05 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856617+0000", 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013243099999999999 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:40.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856748+0000", 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013113799999999999 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.862501+0000", 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057523319999999998 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871755+0000", 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092546959999999998 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871911+0000", 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015593700000000001 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.872103+0000", 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191702 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2117 3.12 3:4a6ac759:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:40.672 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.7693484479999997, 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013830090999999999, 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2117 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:40.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884530+0000", 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9040000000000001e-06 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886120+0000", 2024-04-23T19:01:40.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001589823 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886143+0000", 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159999999999998e-05 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886152+0000", 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3409999999999992e-06 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886218+0000", 2024-04-23T19:01:40.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6157999999999999e-05 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886341+0000", 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245100000000001 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886461+0000", 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120381 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.892686+0000", 2024-04-23T19:01:40.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062244099999999997 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898130+0000", 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054443349999999998 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898186+0000", 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6199999999999997e-05 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898357+0000", 2024-04-23T19:01:40.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017092799999999999 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2121 3.12 3:4ab0d216:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.7312505119999999, 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015267064, 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.678 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2121 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922628+0000", 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6639999999999998e-06 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924374+0000", 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017465239999999999 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924405+0000", 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1035999999999999e-05 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924420+0000", 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4552000000000001e-05 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924517+0000", 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6953999999999994e-05 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924704+0000", 2024-04-23T19:01:40.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187073 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924878+0000", 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017427299999999999 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.933464+0000", 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085861029999999994 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937770+0000", 2024-04-23T19:01:40.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043062389999999999 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937839+0000", 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8887999999999995e-05 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937892+0000", 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2757999999999999e-05 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.683 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2127 3.12 3:49e657d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.6679235730000004, 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014820902, 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2127 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.684 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985954+0000", 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:40.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987681+0000", 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726265 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987709+0000", 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8496e-05 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987723+0000", 2024-04-23T19:01:40.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4433000000000001e-05 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987794+0000", 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0783000000000003e-05 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987915+0000", 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120518 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.988028+0000", 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113268 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.994241+0000", 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062126689999999997 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000685+0000", 2024-04-23T19:01:40.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064444890000000003 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000731+0000", 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5562999999999997e-05 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000773+0000", 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2001e-05 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2143 3.1 3:818c3cf4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.5037945859999997, 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014844245000000001, 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2143 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150084+0000", 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2600000000000001e-06 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151570+0000", 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014861189999999999 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151604+0000", 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151621+0000", 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6144e-05 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151697+0000", 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6377000000000004e-05 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151869+0000", 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017231000000000001 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151968+0000", 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8455999999999994e-05 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.159112+0000", 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071439989999999998 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164808+0000", 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005696301 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164872+0000", 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3615999999999995e-05 2024-04-23T19:01:40.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164925+0000", 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3439000000000001e-05 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2144 3.1 3:822f1bc9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.4938077930000002, 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01381895, 2024-04-23T19:01:40.695 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2144 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160069+0000", 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8679999999999999e-06 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161620+0000", 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015505709999999999 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161644+0000", 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4269000000000001e-05 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161655+0000", 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161722+0000", 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7409000000000005e-05 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161859+0000", 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013668099999999999 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161961+0000", 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102273 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.168267+0000", 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063061339999999997 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173766+0000", 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054986849999999997 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173835+0000", 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9140999999999994e-05 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173887+0000", 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1480999999999997e-05 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2157 3.10 e56/20 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.3550752570000002, 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014718479, 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298802+0000", 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.869e-06 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302934+0000", 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041324459999999997 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302962+0000", 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7302000000000001e-05 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302975+0000", 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3349999999999999e-05 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303059+0000", 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3782999999999994e-05 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303086+0000", 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7436999999999998e-05 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313460+0000", 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010373408000000001 2024-04-23T19:01:40.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313519+0000", 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8884000000000001e-05 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2161 3.12 3:4ba64ee9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.3134891509999997, 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016255067000000002, 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.705 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2161 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340390+0000", 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.455e-06 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342958+0000", 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025682109999999999 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342988+0000", 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0199999999999999e-05 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343002+0000", 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3769e-05 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343083+0000", 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0687999999999997e-05 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343237+0000", 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015475600000000001 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343340+0000", 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102834 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.349457+0000", 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061166229999999999 2024-04-23T19:01:40.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356502+0000", 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070452609999999997 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356576+0000", 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3526e-05 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356641+0000", 2024-04-23T19:01:40.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5743999999999999e-05 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.7391236980000002, 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.711 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:01:40.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2215 3.b e56/20 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6438162759999999, 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015142766, 2024-04-23T19:01:40.715 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010061+0000", 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2520000000000002e-06 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013225+0000", 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003163622 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013274+0000", 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9471000000000001e-05 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013298+0000", 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3628000000000001e-05 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013434+0000", 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013560699999999999 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013475+0000", 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0938e-05 2024-04-23T19:01:40.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025068+0000", 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011593440999999999 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025202+0000", 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133807 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.6089608689999997, 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:01:40.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:01:40.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:01:40.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2233 3.3a e57/20 3:5c6ef8e1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_122:head v 57'3, mlcod=53'1)", 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.4018836459999999, 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014404780000000001, 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251994+0000", 2024-04-23T19:01:40.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.784e-06 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255871+0000", 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00387762 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255901+0000", 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9901000000000001e-05 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255914+0000", 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.328e-05 2024-04-23T19:01:40.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256041+0000", 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012621299999999999 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256080+0000", 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9245000000000001e-05 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266324+0000", 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010244659999999999 2024-04-23T19:01:40.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266397+0000", 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2076999999999994e-05 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2714523140000002, 2024-04-23T19:01:40.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.734 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2251 3.32 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.1872139190000004, 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015905636000000001, 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2251 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466664+0000", 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469135+0000", 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002470164 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469164+0000", 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9115000000000002e-05 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469182+0000", 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8726999999999999e-05 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469306+0000", 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012313600000000001 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469497+0000", 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019168399999999999 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469679+0000", 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018196600000000001 2024-04-23T19:01:40.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.476311+0000", 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066314629999999998 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482438+0000", 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061275449999999999 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482508+0000", 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9795999999999994e-05 2024-04-23T19:01:40.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482567+0000", 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9166999999999998e-05 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2265 3.32 3:4d8b1756:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.9887532569999999, 2024-04-23T19:01:40.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013967738, 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2265 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665125+0000", 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1769999999999998e-06 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667169+0000", 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020441040000000001 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667217+0000", 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7262000000000003e-05 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667245+0000", 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7888000000000001e-05 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667343+0000", 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8782000000000004e-05 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667487+0000", 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143597 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667644+0000", 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697700000000001 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678434+0000", 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010789801 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678995+0000", 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000560802 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679045+0000", 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0868000000000002e-05 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679090+0000", 2024-04-23T19:01:40.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4480000000000001e-05 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5843293450000004, 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:01:40.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.751 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2298 3.3e e57/20 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5530581220000004, 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015216608, 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:40.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100819+0000", 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.672e-06 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102788+0000", 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019685979999999998 2024-04-23T19:01:40.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102812+0000", 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4012e-05 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102825+0000", 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3288999999999999e-05 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102919+0000", 2024-04-23T19:01:40.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4561000000000005e-05 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102950+0000", 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0434e-05 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.115979+0000", 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013028889 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116034+0000", 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5152999999999999e-05 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2304 3.12 3:4b60d7e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4910821930000004, 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014756422, 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:40.756 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2304 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162794+0000", 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2449999999999999e-06 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164305+0000", 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015100770000000001 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164334+0000", 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9132000000000002e-05 2024-04-23T19:01:40.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164348+0000", 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4378e-05 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164439+0000", 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0886999999999999e-05 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164635+0000", 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019567799999999999 2024-04-23T19:01:40.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164810+0000", 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175448 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.171513+0000", 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067025660000000001 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177452+0000", 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059398400000000001 2024-04-23T19:01:40.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177497+0000", 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4282000000000001e-05 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177550+0000", 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2889000000000001e-05 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:40.761 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:40.762 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:40.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:40.764 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:40.763+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:40.864 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:40.863+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:40.935 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:40.936 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:40.936 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:40.936 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:40.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:40.958 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:40.959 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:40.965 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:40.965+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:40.975 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:40.975 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:40.992 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:40.992 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:41.008 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:41.009 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:41.029 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:41.029 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:41.049 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:41.050 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:41.065 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:41.067+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:41.067 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:41.067 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:41.070 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:41.070 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:41.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:41.091 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:41.091 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:01:41.091 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:41.097 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.3 to 1 (10000) 2024-04-23T19:01:41.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-23T19:01:41.166 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:41.165+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:41.204 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:41.204 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:41.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:41.267 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:41.265+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:41.368 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:41.367+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:41.378 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:41.378 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:41.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:41.482 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:41.483+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:41.547 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:41.548 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:41.560 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:41.605 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:41.607+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:41.671 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:41.669+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:41.718 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:41.718 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:41.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:41.777 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:41.779+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:41.847 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:41.847 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:41.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:41.901 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:41.903+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:41.973 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:41.975+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:42.016 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.017 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.030 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:42.075 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:42.077+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.4 to 1 (10000) 2024-04-23T19:01:42.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-23T19:01:42.175 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:42.177+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:42.214 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.215 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.229 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:42.276 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:42.275+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:42.361 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.361 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.375 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:42.377 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:42.379+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:42.477 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:42.473+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:42.498 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.498 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.512 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:42.578 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:42.579+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:42.677 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.677 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.678 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:42.679+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:42.692 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:42.779 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:42.779+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:42.814 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.814 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.828 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:42.880 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:42.877+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:42.952 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:42.952 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:42.967 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:43.010 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:43.009+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:43.083 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:43.081+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:43.116 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.5 to 1 (10000) 2024-04-23T19:01:43.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:01:43.127 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:43.135 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:43.135 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:43.150 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:43.151 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-23T19:01:43.194 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:43.193+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:43.272 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:43.284 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:43.281+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:43.289 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:43.289 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:43.305 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:43.305 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:43.316 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:43.316 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:43.327 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:43.332 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:43.346 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:43.346 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:43.365 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:43.366 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:43.384 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:43.384 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:43.385 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:43.387+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:43.402 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:43.402 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:43.486 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:43.485+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:43.498 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:43.512 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:43.587 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:43.587+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:43.678 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 80.366131269999997, 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:43.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:43.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2122 3.35 3:ac268df4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.7445531709999997, 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018444747000000001, 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2122 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.685 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932716+0000", 2024-04-23T19:01:43.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.159e-06 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937085+0000", 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043697329999999998 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937119+0000", 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3586e-05 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937134+0000", 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4995e-05 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937228+0000", 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4450000000000005e-05 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937404+0000", 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000175959 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937565+0000", 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016108999999999999 2024-04-23T19:01:43.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.950657+0000", 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013091139999999999 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951001+0000", 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000344271 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951087+0000", 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6594000000000005e-05 2024-04-23T19:01:43.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951158+0000", 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0770000000000002e-05 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2135 3.26 3:66cd9a47:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.6074822300000005, 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016955900999999999, 2024-04-23T19:01:43.690 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2135 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069787+0000", 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.694e-06 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.073999+0000", 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042116469999999998 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074024+0000", 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5264000000000001e-05 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074036+0000", 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1773000000000001e-05 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074110+0000", 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4214999999999993e-05 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074253+0000", 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014303100000000001 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074360+0000", 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107318 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086400+0000", 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012039574000000001 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086656+0000", 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256469 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086702+0000", 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5985000000000001e-05 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086740+0000", 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7931e-05 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.695 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2142 3.26 3:6505eb65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.5369831810000001, 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016460737, 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.696 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2142 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140287+0000", 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144147+0000", 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599770000000001 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144168+0000", 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1328999999999999e-05 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144177+0000", 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1749999999999994e-06 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144257+0000", 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9913000000000006e-05 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144408+0000", 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000151056 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144539+0000", 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013111899999999999 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.153118+0000", 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085787459999999999 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156562+0000", 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034444940000000002 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156663+0000", 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010056399999999999 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156744+0000", 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1148000000000003e-05 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2157 3.10 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:43.701 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.3838015880000007, 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019824521000000001, 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2157 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293467+0000", 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3089999999999998e-06 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297404+0000", 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039368550000000004 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297432+0000", 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7931000000000001e-05 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297444+0000", 2024-04-23T19:01:43.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1508000000000001e-05 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297536+0000", 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2513e-05 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297733+0000", 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019660000000000001 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297970+0000", 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023758399999999999 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.305333+0000", 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073631290000000004 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313164+0000", 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078300209999999995 2024-04-23T19:01:43.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313231+0000", 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7168000000000005e-05 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313290+0000", 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8903000000000002e-05 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2190 3.1e e56/20 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.1174308629999992, 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015976137000000001, 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559838+0000", 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564659+0000", 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048211950000000003 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564700+0000", 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1159999999999999e-05 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564717+0000", 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6543000000000001e-05 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564880+0000", 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163272 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564935+0000", 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4632000000000001e-05 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.575758+0000", 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010822915000000001 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.575812+0000", 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4237000000000003e-05 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2201 3.a 3:531f5619:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.952729046, 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017986076, 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2201 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724541+0000", 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0139999999999999e-06 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728829+0000", 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004288877 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728873+0000", 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3457000000000001e-05 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728891+0000", 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8122999999999999e-05 2024-04-23T19:01:43.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728990+0000", 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9127000000000001e-05 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.729175+0000", 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018525799999999999 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.729338+0000", 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016262000000000001 2024-04-23T19:01:43.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.736796+0000", 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074580870000000004 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742396+0000", 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055994080000000002 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742464+0000", 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8662000000000001e-05 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742524+0000", 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9443e-05 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.5811450520000001, 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.717 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:01:43.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:01:43.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2231 3.3f e57/20 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:43.723 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.4445642690000007, 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016114270999999999, 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232703+0000", 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0800000000000004e-07 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235193+0000", 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024894169999999998 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235226+0000", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3810999999999999e-05 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235242+0000", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.558e-05 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235334+0000", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1736000000000004e-05 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235355+0000", 2024-04-23T19:01:43.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1691e-05 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.248745+0000", 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01338981 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.248817+0000", 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1518000000000002e-05 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2242 3.a 3:509848d5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.3195538290000002, 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016205213999999999, 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2242 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357715+0000", 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3709999999999998e-06 2024-04-23T19:01:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361530+0000", 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038150910000000001 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361551+0000", 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0514999999999999e-05 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361562+0000", 2024-04-23T19:01:43.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1445e-05 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361630+0000", 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8101000000000004e-05 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361736+0000", 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010526000000000001 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361841+0000", 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105863 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373149+0000", 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307661 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373842+0000", 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00069307099999999996 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373879+0000", 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6792999999999998e-05 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373918+0000", 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9042999999999999e-05 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2249 3.35 3:ae24b40c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.733 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.2404442039999992, 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685019999999999, 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2249 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.734 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436826+0000", 2024-04-23T19:01:43.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.507e-06 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440809+0000", 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039834889999999998 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440848+0000", 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8189999999999999e-05 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440873+0000", 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5313e-05 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440998+0000", 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012463700000000001 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.441213+0000", 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215183 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.441385+0000", 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017184500000000001 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.448887+0000", 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075019520000000001 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454385+0000", 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054989130000000002 2024-04-23T19:01:43.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454452+0000", 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6635000000000002e-05 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454507+0000", 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5356000000000003e-05 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2252 3.35 3:adca29dd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1932632440000006, 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016301998000000002, 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2252 2024-04-23T19:01:43.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484006+0000", 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0000000000000001e-06 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487732+0000", 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037260729999999999 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487756+0000", 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3226000000000001e-05 2024-04-23T19:01:43.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487770+0000", 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4714e-05 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487923+0000", 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015277800000000001 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.488177+0000", 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025382699999999998 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.488427+0000", 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025014699999999999 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.498240+0000", 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009812856 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500143+0000", 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019034360000000001 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500222+0000", 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8545000000000001e-05 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500305+0000", 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3395999999999999e-05 2024-04-23T19:01:43.745 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2262 3.20 3:05df02c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0465996949999994, 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019440939000000001, 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.746 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2262 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:43.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630669+0000", 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.542e-06 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634459+0000", 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037898820000000001 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634487+0000", 2024-04-23T19:01:43.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7691999999999998e-05 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634499+0000", 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2413e-05 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634632+0000", 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132051 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634896+0000", 2024-04-23T19:01:43.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026448999999999998 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.635126+0000", 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023023100000000001 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.649368+0000", 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014241517 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.649913+0000", 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054570599999999997 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.650001+0000", 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7293000000000006e-05 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.650108+0000", 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107122 2024-04-23T19:01:43.751 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.9900448619999995, 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.752 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:43.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:01:43.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:01:43.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2271 3.20 3:04eeff99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.9347926060000002, 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019123983000000001, 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.758 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2271 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742479+0000", 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5600000000000004e-06 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746899+0000", 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044202349999999998 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746938+0000", 2024-04-23T19:01:43.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9002999999999999e-05 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746957+0000", 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9242999999999999e-05 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747141+0000", 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018355499999999999 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747511+0000", 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037069199999999999 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747786+0000", 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027515699999999999 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.757116+0000", 2024-04-23T19:01:43.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093292600000000007 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761429+0000", 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131599999999999 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761520+0000", 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0891999999999996e-05 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761598+0000", 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8226000000000006e-05 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.8937663760000003, 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.764 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:01:43.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:01:43.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:01:43.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.6300903550000001, 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.770 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:01:43.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:01:43.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.5249758089999998, 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:01:43.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:43.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.781 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2305 3.2e e57/20 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.5013668070000001, 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016943086999999999, 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5730000000000002e-06 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180626+0000", 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047234290000000003 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180652+0000", 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6233000000000001e-05 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180667+0000", 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4514e-05 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180779+0000", 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112868 2024-04-23T19:01:43.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180819+0000", 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0015999999999998e-05 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.192748+0000", 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928068999999999 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.192843+0000", 2024-04-23T19:01:43.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5384999999999996e-05 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.3784026259999997, 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:43.786 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:43.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:01:43.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:01:43.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:43.791 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:43.793 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:43.793 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:43.789+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:43.893 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:43.889+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:43.959 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:43.960 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:43.960 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:43.960 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:43.974 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:43.995 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:43.995+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:44.096 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:44.095+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:44.130 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:01:44.138 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.6 to 1 (10000) 2024-04-23T19:01:44.145 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:44.145 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:44.145 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:44.145 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:44.145 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:44.160 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:44.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-23T19:01:44.204 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:44.207+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:44.285 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:44.285 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:44.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 101.113596574, 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.286 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:01:44.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 100.381310172, 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:01:44.292 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:01:44.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.298 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 100.38114019299999, 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 100.38108962699999, 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:01:44.304 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:01:44.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:44.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 100.380947288, 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:01:44.310 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:01:44.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:01:44.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 100.380743987, 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.316 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:01:44.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:01:44.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 100.380704803, 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.322 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:01:44.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:01:44.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2155 3.e 3:7394e207:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.012569051, 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019575268999999999, 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2155 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:44.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272134+0000", 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.514e-06 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.275986+0000", 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038527090000000002 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276009+0000", 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2949e-05 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276020+0000", 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0893000000000001e-05 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276096+0000", 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5844000000000001e-05 2024-04-23T19:01:44.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276285+0000", 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000189073 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276427+0000", 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014148700000000001 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291495+0000", 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015068152 2024-04-23T19:01:44.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291548+0000", 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3384999999999998e-05 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291660+0000", 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111712 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291706+0000", 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6551000000000002e-05 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2198 3.2d 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.610398902, 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019840345999999998, 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.334 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2198 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674304+0000", 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678249+0000", 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039455699999999998 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678275+0000", 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6322e-05 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678287+0000", 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1533e-05 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678382+0000", 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5379999999999998e-05 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678559+0000", 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000176787 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678678+0000", 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011892000000000001 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.685235+0000", 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065573610000000003 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.693941+0000", 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087059919999999992 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694056+0000", 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011435200000000001 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694142+0000", 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5915000000000007e-05 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.339 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2202 3.3f 3:fcdbdc32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.5387158480000007, 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019991346, 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2202 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745987+0000", 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.305e-06 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749881+0000", 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038945059999999998 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749910+0000", 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9164000000000001e-05 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749925+0000", 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4443999999999999e-05 2024-04-23T19:01:44.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750113+0000", 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018781700000000001 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750360+0000", 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024755000000000003 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750598+0000", 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237498 2024-04-23T19:01:44.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.763676+0000", 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01307818 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765795+0000", 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002119297 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765897+0000", 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101619 2024-04-23T19:01:44.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765976+0000", 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8966000000000003e-05 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2205 3.2d 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.486281666, 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021534458999999999, 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.345 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2205 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798421+0000", 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4370000000000001e-06 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802242+0000", 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038212939999999998 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802263+0000", 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0543e-05 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802273+0000", 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0248000000000001e-05 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802427+0000", 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015376100000000001 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802688+0000", 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026095699999999998 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802960+0000", 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027196700000000002 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.814078+0000", 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011118031 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819767+0000", 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056894629999999996 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819878+0000", 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011114499999999999 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819953+0000", 2024-04-23T19:01:44.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4612999999999999e-05 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2020737090000004, 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021578863, 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.351 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103605+0000", 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012893465999999999 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103925+0000", 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032048599999999998 2024-04-23T19:01:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104067+0000", 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014224100000000001 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104205+0000", 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013803200000000001 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.1679180789999997, 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:01:44.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:01:44.361 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2231 3.3f 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.0568809609999992, 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021281242999999998, 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.362 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2231 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227821+0000", 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499999999999999e-06 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231570+0000", 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037486009999999998 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231593+0000", 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3295999999999999e-05 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231602+0000", 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9330000000000007e-06 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231729+0000", 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012735200000000001 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232086+0000", 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000356635 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232429+0000", 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034333600000000002 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.245402+0000", 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012972450999999999 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249012+0000", 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036096840000000002 2024-04-23T19:01:44.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249058+0000", 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6462999999999999e-05 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249100+0000", 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2441999999999998e-05 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.367 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2246 3.d 3:b0736148:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.8839828860000001, 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019541955999999999, 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2246 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400720+0000", 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3020000000000002e-06 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404442+0000", 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037224620000000002 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404474+0000", 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1953999999999999e-05 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404486+0000", 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1562999999999999e-05 2024-04-23T19:01:44.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404588+0000", 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010257 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404852+0000", 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026406599999999998 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.405237+0000", 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000384612 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.419338+0000", 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014101058 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420099+0000", 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076121100000000003 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420189+0000", 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9458999999999998e-05 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420259+0000", 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0698999999999995e-05 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.373 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.5923325320000004, 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:01:44.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:01:44.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.5201722340000003, 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.378 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:44.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.383 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2295 3.12 e57/20 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head v 57'8, mlcod=56'6)", 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.2127544159999992, 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020893219000000001, 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071949+0000", 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5559999999999999e-06 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077385+0000", 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054361019999999999 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077829+0000", 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044398899999999999 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.078932+0000", 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011023750000000001 2024-04-23T19:01:44.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081607+0000", 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026748969999999999 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081654+0000", 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7644e-05 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092752+0000", 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011097164 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092839+0000", 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7491999999999995e-05 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2299 3.f 3:f2287333:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1704868029999993, 2024-04-23T19:01:44.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023125123000000001, 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2299 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114216+0000", 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5100000000000001e-06 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119361+0000", 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051446879999999997 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119396+0000", 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5812999999999997e-05 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119414+0000", 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7269999999999999e-05 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119583+0000", 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016943199999999999 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119990+0000", 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040668900000000001 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.120394+0000", 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403755 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.129091+0000", 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086969969999999997 2024-04-23T19:01:44.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137017+0000", 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079263489999999992 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137206+0000", 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018926500000000001 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137339+0000", 2024-04-23T19:01:44.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013235499999999999 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2311 3.d 3:b2884c89:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0496438779999995, 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022499029, 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:44.394 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2311 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235060+0000", 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7759999999999999e-06 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238950+0000", 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038900689999999999 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238993+0000", 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3303000000000002e-05 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239013+0000", 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9879999999999999e-05 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239210+0000", 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019640400000000001 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239612+0000", 2024-04-23T19:01:44.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040218900000000001 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.240031+0000", 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041938899999999999 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254300+0000", 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014269097 2024-04-23T19:01:44.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257380+0000", 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003079104 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257481+0000", 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101325 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:44.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257555+0000", 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4493000000000007e-05 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:44.400 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:44.402 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:44.402 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:44.403+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:44.502 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:44.501+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:44.520 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:44.520 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:44.520 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:44.520 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:44.533 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:44.604 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:44.603+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:44.657 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:44.657 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:44.657 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:44.657 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:44.657 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:44.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:44.704 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:44.701+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:44.805 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:44.807+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1243 3.2b 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:44.835 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.013521164, 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016938254999999999, 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1243 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821419+0000", 2024-04-23T19:01:44.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9289999999999998e-06 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824120+0000", 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027012009999999999 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824153+0000", 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2663999999999998e-05 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824168+0000", 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5747999999999999e-05 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824249+0000", 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0492000000000001e-05 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824367+0000", 2024-04-23T19:01:44.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117768 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824480+0000", 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011374699999999999 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.836387+0000", 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011906699999999999 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838288+0000", 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900606 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838322+0000", 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4363000000000003e-05 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838354+0000", 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2036999999999998e-05 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.841 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.009086504000001, 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.842 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:44.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2114 3.1 3:8002664d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.979948265000001, 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017114279, 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.848 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2114 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854992+0000", 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5080000000000001e-06 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856342+0000", 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001349299 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856377+0000", 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5281000000000003e-05 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856392+0000", 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4739999999999999e-05 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856485+0000", 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3214999999999994e-05 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856617+0000", 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013243099999999999 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856748+0000", 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013113799999999999 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.862501+0000", 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057523319999999998 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871755+0000", 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092546959999999998 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871911+0000", 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015593700000000001 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.872103+0000", 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191702 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.853 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2117 3.12 3:4a6ac759:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.95041007, 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013830090999999999, 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.854 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2117 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884530+0000", 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9040000000000001e-06 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886120+0000", 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001589823 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886143+0000", 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159999999999998e-05 2024-04-23T19:01:44.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886152+0000", 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3409999999999992e-06 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886218+0000", 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6157999999999999e-05 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886341+0000", 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245100000000001 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886461+0000", 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120381 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.892686+0000", 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062244099999999997 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898130+0000", 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054443349999999998 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898186+0000", 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6199999999999997e-05 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898357+0000", 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017092799999999999 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.859 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2121 3.12 3:4ab0d216:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.912312134, 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015267064, 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2121 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.860 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922628+0000", 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6639999999999998e-06 2024-04-23T19:01:44.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924374+0000", 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017465239999999999 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924405+0000", 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1035999999999999e-05 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924420+0000", 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4552000000000001e-05 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924517+0000", 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6953999999999994e-05 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924704+0000", 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187073 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924878+0000", 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017427299999999999 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.933464+0000", 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085861029999999994 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937770+0000", 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043062389999999999 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937839+0000", 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8887999999999995e-05 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937892+0000", 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2757999999999999e-05 2024-04-23T19:01:44.865 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2127 3.12 3:49e657d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.848985195000001, 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014820902, 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.866 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2127 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985954+0000", 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987681+0000", 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726265 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987709+0000", 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8496e-05 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987723+0000", 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4433000000000001e-05 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987794+0000", 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0783000000000003e-05 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987915+0000", 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120518 2024-04-23T19:01:44.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.988028+0000", 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113268 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.994241+0000", 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062126689999999997 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000685+0000", 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064444890000000003 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000731+0000", 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5562999999999997e-05 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000773+0000", 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2001e-05 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.871 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2143 3.1 3:818c3cf4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.684856207999999, 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014844245000000001, 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2143 2024-04-23T19:01:44.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150084+0000", 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2600000000000001e-06 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151570+0000", 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014861189999999999 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.874 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151604+0000", 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151621+0000", 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6144e-05 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151697+0000", 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6377000000000004e-05 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151869+0000", 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017231000000000001 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151968+0000", 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8455999999999994e-05 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.159112+0000", 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071439989999999998 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164808+0000", 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005696301 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164872+0000", 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3615999999999995e-05 2024-04-23T19:01:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164925+0000", 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3439000000000001e-05 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2144 3.1 3:822f1bc9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.674869415, 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01381895, 2024-04-23T19:01:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2144 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160069+0000", 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8679999999999999e-06 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161620+0000", 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015505709999999999 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161644+0000", 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4269000000000001e-05 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161655+0000", 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161722+0000", 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7409000000000005e-05 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161859+0000", 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013668099999999999 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161961+0000", 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102273 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.168267+0000", 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063061339999999997 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173766+0000", 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054986849999999997 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173835+0000", 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9140999999999994e-05 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173887+0000", 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1480999999999997e-05 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2157 3.10 e56/20 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.536136879000001, 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014718479, 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298802+0000", 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.869e-06 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302934+0000", 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041324459999999997 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302962+0000", 2024-04-23T19:01:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7302000000000001e-05 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302975+0000", 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3349999999999999e-05 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303059+0000", 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3782999999999994e-05 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303086+0000", 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7436999999999998e-05 2024-04-23T19:01:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313460+0000", 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010373408000000001 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313519+0000", 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8884000000000001e-05 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2161 3.12 3:4ba64ee9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.494550773, 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016255067000000002, 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2161 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340390+0000", 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.455e-06 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342958+0000", 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025682109999999999 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342988+0000", 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0199999999999999e-05 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343002+0000", 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3769e-05 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343083+0000", 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0687999999999997e-05 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343237+0000", 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015475600000000001 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343340+0000", 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102834 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.349457+0000", 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061166229999999999 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356502+0000", 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070452609999999997 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356576+0000", 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3526e-05 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356641+0000", 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5743999999999999e-05 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.894 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9201853199999999, 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.895 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.896 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:01:44.898 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2215 3.b e56/20 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.8248778980000004, 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015142766, 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.899 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.900 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010061+0000", 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2520000000000002e-06 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013225+0000", 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003163622 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013274+0000", 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9471000000000001e-05 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.901 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013298+0000", 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3628000000000001e-05 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013434+0000", 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013560699999999999 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013475+0000", 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0938e-05 2024-04-23T19:01:44.902 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025068+0000", 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011593440999999999 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025202+0000", 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133807 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.903 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.7900224910000002, 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.904 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.905 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.906 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:01:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:44.908 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2233 3.3a e57/20 3:5c6ef8e1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_122:head v 57'3, mlcod=53'1)", 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:44.910 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5829452679999996, 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014404780000000001, 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251994+0000", 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.784e-06 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255871+0000", 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00387762 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255901+0000", 2024-04-23T19:01:44.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9901000000000001e-05 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255914+0000", 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.328e-05 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256041+0000", 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012621299999999999 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256080+0000", 2024-04-23T19:01:44.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9245000000000001e-05 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266324+0000", 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010244659999999999 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266397+0000", 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2076999999999994e-05 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.4525139360000008, 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:01:44.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:01:44.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2251 3.32 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.919 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.3682755409999992, 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015905636000000001, 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2251 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:44.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466664+0000", 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469135+0000", 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002470164 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469164+0000", 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9115000000000002e-05 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469182+0000", 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8726999999999999e-05 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469306+0000", 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012313600000000001 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469497+0000", 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019168399999999999 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469679+0000", 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018196600000000001 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.476311+0000", 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066314629999999998 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482438+0000", 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061275449999999999 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482508+0000", 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9795999999999994e-05 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482567+0000", 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9166999999999998e-05 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2265 3.32 3:4d8b1756:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.1698148790000005, 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013967738, 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.925 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2265 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665125+0000", 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1769999999999998e-06 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667169+0000", 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020441040000000001 2024-04-23T19:01:44.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667217+0000", 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7262000000000003e-05 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667245+0000", 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7888000000000001e-05 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667343+0000", 2024-04-23T19:01:44.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8782000000000004e-05 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667487+0000", 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143597 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667644+0000", 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697700000000001 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678434+0000", 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010789801 2024-04-23T19:01:44.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678995+0000", 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000560802 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679045+0000", 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0868000000000002e-05 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679090+0000", 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4480000000000001e-05 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.7653909670000001, 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.931 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:01:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2298 3.3e e57/20 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.7341197440000009, 2024-04-23T19:01:44.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015216608, 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:44.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:44.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100819+0000", 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.672e-06 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102788+0000", 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019685979999999998 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102812+0000", 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4012e-05 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102825+0000", 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3288999999999999e-05 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102919+0000", 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4561000000000005e-05 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102950+0000", 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0434e-05 2024-04-23T19:01:44.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.115979+0000", 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013028889 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116034+0000", 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5152999999999999e-05 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2304 3.12 3:4b60d7e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:44.945 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.6721438150000001, 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014756422, 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:44.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2304 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162794+0000", 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2449999999999999e-06 2024-04-23T19:01:44.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164305+0000", 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015100770000000001 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164334+0000", 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9132000000000002e-05 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164348+0000", 2024-04-23T19:01:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4378e-05 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164439+0000", 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0886999999999999e-05 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164635+0000", 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019567799999999999 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:44.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164810+0000", 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175448 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.171513+0000", 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067025660000000001 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177452+0000", 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059398400000000001 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:44.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177497+0000", 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4282000000000001e-05 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177550+0000", 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2889000000000001e-05 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:44.952 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:44.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:44.954 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:44.955+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:45.054 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:45.055+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:45.120 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:45.120 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:45.120 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:45.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:45.147 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.7 to 1 (10000) 2024-04-23T19:01:45.155 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:45.153+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:45.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-23T19:01:45.171 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:01:45.257 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:45.259+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:45.266 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:45.266 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:45.266 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:45.281 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:45.372 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:45.375+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:45.423 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 86.155769814999999, 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.444 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:45.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:45.449 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2123 3.0 3:0261d0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.502567315, 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015185707999999999, 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2123 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942998+0000", 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8210000000000002e-06 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944838+0000", 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018401769999999999 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944863+0000", 2024-04-23T19:01:45.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4899999999999999e-05 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944874+0000", 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0926e-05 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944942+0000", 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7428999999999994e-05 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945070+0000", 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012833899999999999 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945175+0000", 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010466100000000001 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.957371+0000", 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012196864 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958106+0000", 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00073463499999999998 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958147+0000", 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0506000000000001e-05 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958181+0000", 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4449999999999997e-05 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.455 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.193168124, 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.456 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:01:45.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:01:45.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:01:45.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2162 3.25 3:a68bdb79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:45.463 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.095319772, 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014496184, 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2162 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350245+0000", 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6249999999999999e-06 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351950+0000", 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001704721 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351984+0000", 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352000+0000", 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5662e-05 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352094+0000", 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3715999999999995e-05 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352285+0000", 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019128799999999999 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352456+0000", 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017101200000000001 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364058+0000", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011602128 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364650+0000", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059187900000000002 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364688+0000", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7515999999999998e-05 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364739+0000", 2024-04-23T19:01:45.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1412999999999997e-05 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2171 3.31 3:8c201035:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.99006906, 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015626368000000002, 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2171 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455496+0000", 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8949999999999998e-06 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457275+0000", 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017788330000000001 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457301+0000", 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6024999999999999e-05 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457313+0000", 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1877e-05 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457386+0000", 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3109999999999996e-05 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457527+0000", 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014033399999999999 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457656+0000", 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129789 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.464144+0000", 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064880069999999996 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471010+0000", 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068660070000000004 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471056+0000", 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5943999999999999e-05 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471120+0000", 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3547000000000007e-05 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2187 3.1f 3:fb7660b3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.474 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.922182558999999, 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014170726, 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2187 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:45.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523384+0000", 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8530000000000002e-06 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525403+0000", 2024-04-23T19:01:45.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020189000000000001 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525440+0000", 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6979e-05 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525453+0000", 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3005e-05 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525563+0000", 2024-04-23T19:01:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109985 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525789+0000", 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022658800000000001 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525988+0000", 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000198409 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536623+0000", 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010635109 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537400+0000", 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077722900000000005 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537466+0000", 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5518999999999994e-05 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537551+0000", 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5149999999999996e-05 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.878555458999999, 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:01:45.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:01:45.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:01:45.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2200 3.1a e56/20 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head v 56'3, mlcod=52'1)", 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.737308049999999, 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016149459000000001, 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708257+0000", 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.666e-06 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712912+0000", 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004654661 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712947+0000", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5612999999999999e-05 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712965+0000", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-05 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713105+0000", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140264 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713170+0000", 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4974999999999994e-05 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724310+0000", 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011139935 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724404+0000", 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4005000000000005e-05 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.586942774000001, 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.509994001999999, 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.494 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:01:45.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2229 3.31 3:8ced272b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:45.499 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.241301118999999, 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012661527000000001, 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2229 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204264+0000", 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6649999999999999e-06 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205798+0000", 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001534349 2024-04-23T19:01:45.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205838+0000", 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9258000000000003e-05 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205855+0000", 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7532000000000001e-05 2024-04-23T19:01:45.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205962+0000", 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010679 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206143+0000", 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000180559 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206304+0000", 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016126500000000001 2024-04-23T19:01:45.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.213214+0000", 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069100849999999998 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216772+0000", 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035580210000000002 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216855+0000", 2024-04-23T19:01:45.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2996000000000003e-05 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216923+0000", 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8007000000000001e-05 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2243 3.25 3:a47da34a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.077695738999999, 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016498994999999999, 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.505 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2243 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367870+0000", 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4479999999999999e-06 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370547+0000", 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026765270000000002 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370583+0000", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5710999999999997e-05 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370598+0000", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5726000000000002e-05 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370683+0000", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4819000000000002e-05 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370832+0000", 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014911899999999999 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370992+0000", 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159815 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381097+0000", 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010105042999999999 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384082+0000", 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029852009999999998 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384244+0000", 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016155999999999999 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384366+0000", 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122026 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.510 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2245 3.0 3:03deb7e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.055561461, 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015195145, 2024-04-23T19:01:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2245 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390004+0000", 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9679999999999998e-06 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392079+0000", 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020753759999999999 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392103+0000", 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3479e-05 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392116+0000", 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2761e-05 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392224+0000", 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107904 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392428+0000", 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000204186 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392635+0000", 2024-04-23T19:01:45.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020687200000000001 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404314+0000", 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011679144000000001 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405073+0000", 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075964499999999998 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405143+0000", 2024-04-23T19:01:45.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9394999999999995e-05 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405196+0000", 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3415000000000003e-05 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2251 3.32 e57/20 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head v 57'2, mlcod=0'0)", 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9757178470000003, 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012365898, 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.44e-07 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471716+0000", 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018707960000000001 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471751+0000", 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622999999999997e-05 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471769+0000", 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8508e-05 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471919+0000", 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149853 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471968+0000", 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9066000000000001e-05 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482090+0000", 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122160999999999 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482211+0000", 2024-04-23T19:01:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120347 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2254 3.1a e57/20 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head v 57'5, mlcod=56'3)", 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9254097160000008, 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016447765, 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520156+0000", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6429999999999999e-06 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524703+0000", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045476930000000002 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524732+0000", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8551000000000002e-05 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524745+0000", 2024-04-23T19:01:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3124e-05 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524844+0000", 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8721999999999994e-05 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524878+0000", 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4839000000000003e-05 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536495+0000", 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011616912 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536601+0000", 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105281 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2278 3.8 e57/20 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5927357579999999, 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016293365000000001, 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852829+0000", 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9549999999999999e-06 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855964+0000", 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003135035 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855993+0000", 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9369999999999998e-05 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856007+0000", 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3696999999999999e-05 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856132+0000", 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125313 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856188+0000", 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6164e-05 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.868860+0000", 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012671319 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869120+0000", 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026051200000000002 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5843080609999998, 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:01:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:01:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2280 3.25 3:a4e9d83c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5687133680000009, 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014342169, 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2280 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876852+0000", 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.305e-06 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878784+0000", 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001932465 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878822+0000", 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7654999999999998e-05 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878844+0000", 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2124999999999999e-05 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878935+0000", 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1154000000000002e-05 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879107+0000", 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172199 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879257+0000", 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015013200000000001 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.889696+0000", 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010438523999999999 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891118+0000", 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014217640000000001 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891156+0000", 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8597000000000003e-05 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891191+0000", 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5249000000000001e-05 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.3470231669999997, 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:01:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:01:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:01:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:01:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2300 3.25 3:a433329a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.3225238360000002, 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012342531, 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2300 2024-04-23T19:01:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123042+0000", 2024-04-23T19:01:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2289999999999999e-06 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125053+0000", 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020108349999999999 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125088+0000", 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5472000000000002e-05 2024-04-23T19:01:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125106+0000", 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7207e-05 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125188+0000", 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2473999999999997e-05 2024-04-23T19:01:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125327+0000", 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013878299999999999 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125436+0000", 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010893200000000001 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.134793+0000", 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0093574209999999994 2024-04-23T19:01:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135267+0000", 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047370000000000002 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135330+0000", 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135381+0000", 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1567000000000003e-05 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:45.558 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:45.560 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:45.565 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:01:45.569 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:01:45.571 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:45.557+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:45.575 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:45.575 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:45.577 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-04-23T19:01:45.148049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070223414,"num_objects":455,"num_object_clones":0,"num_object_copies":910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":2605,"num_read_kb":2309,"num_write":1375,"num_write_kb":1067576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2057,"ondisk_log_size":2057,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2345564,"kb_used_data":2096072,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752629156,"statfs":{"total":773094113280,"available":770692255744,"internally_reserved":0,"allocated":2146377728,"data_stored":2143426856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4133263,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":139,"num_read_kb":136,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":81789038,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052214"},"pg_stats":[{"pgid":"3.3f","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592948+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:01:41.592948+0000","last_peered":"2024-04-23T19:01:41.592948+0000","last_clean":"2024-04-23T19:01:41.592948+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:01:41.592948+0000","last_undegraded":"2024-04-23T19:01:41.592948+0000","last_fullsized":"2024-04-23T19:01:41.592948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099136+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:01:41.099136+0000","last_peered":"2024-04-23T19:01:41.099136+0000","last_clean":"2024-04-23T19:01:41.099136+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:01:41.099136+0000","last_undegraded":"2024-04-23T19:01:41.099136+0000","last_fullsized":"2024-04-23T19:01:41.099136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591089+0000","last_change":"2024-04-23T19:00:15.257176+0000","last_active":"2024-04-23T19:01:41.591089+0000","last_peered":"2024-04-23T19:01:41.591089+0000","last_clean":"2024-04-23T19:01:41.591089+0000","last_became_active":"2024-04-23T19:00:15.256794+0000","last_became_peered":"2024-04-23T19:00:15.256794+0000","last_unstale":"2024-04-23T19:01:41.591089+0000","last_undegraded":"2024-04-23T19:01:41.591089+0000","last_fullsized":"2024-04-23T19:01:41.591089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591908+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:01:41.591908+0000","last_peered":"2024-04-23T19:01:41.591908+0000","last_clean":"2024-04-23T19:01:41.591908+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:01:41.591908+0000","last_undegraded":"2024-04-23T19:01:41.591908+0000","last_fullsized":"2024-04-23T19:01:41.591908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382098+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:01:41.382098+0000","last_peered":"2024-04-23T19:01:41.382098+0000","last_clean":"2024-04-23T19:01:41.382098+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:01:41.382098+0000","last_undegraded":"2024-04-23T19:01:41.382098+0000","last_fullsized":"2024-04-23T19:01:41.382098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591137+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:01:41.591137+0000","last_peered":"2024-04-23T19:01:41.591137+0000","last_clean":"2024-04-23T19:01:41.591137+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:01:41.591137+0000","last_undegraded":"2024-04-23T19:01:41.591137+0000","last_fullsized":"2024-04-23T19:01:41.591137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100553+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:01:41.100553+0000","last_peered":"2024-04-23T19:01:41.100553+0000","last_clean":"2024-04-23T19:01:41.100553+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:01:41.100553+0000","last_undegraded":"2024-04-23T19:01:41.100553+0000","last_fullsized":"2024-04-23T19:01:41.100553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381771+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:01:41.381771+0000","last_peered":"2024-04-23T19:01:41.381771+0000","last_clean":"2024-04-23T19:01:41.381771+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:01:41.381771+0000","last_undegraded":"2024-04-23T19:01:41.381771+0000","last_fullsized":"2024-04-23T19:01:41.381771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"57'5","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592103+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:01:41.592103+0000","last_peered":"2024-04-23T19:01:41.592103+0000","last_clean":"2024-04-23T19:01:41.592103+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:01:41.592103+0000","last_undegraded":"2024-04-23T19:01:41.592103+0000","last_fullsized":"2024-04-23T19:01:41.592103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":121,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557249+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:01:41.557249+0000","last_peered":"2024-04-23T19:01:41.557249+0000","last_clean":"2024-04-23T19:01:41.557249+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:01:41.557249+0000","last_undegraded":"2024-04-23T19:01:41.557249+0000","last_fullsized":"2024-04-23T19:01:41.557249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099776+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:01:41.099776+0000","last_peered":"2024-04-23T19:01:41.099776+0000","last_clean":"2024-04-23T19:01:41.099776+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:01:41.099776+0000","last_undegraded":"2024-04-23T19:01:41.099776+0000","last_fullsized":"2024-04-23T19:01:41.099776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'8","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593252+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:01:41.593252+0000","last_peered":"2024-04-23T19:01:41.593252+0000","last_clean":"2024-04-23T19:01:41.593252+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:01:41.593252+0000","last_undegraded":"2024-04-23T19:01:41.593252+0000","last_fullsized":"2024-04-23T19:01:41.593252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592892+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:01:41.592892+0000","last_peered":"2024-04-23T19:01:41.592892+0000","last_clean":"2024-04-23T19:01:41.592892+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:01:41.592892+0000","last_undegraded":"2024-04-23T19:01:41.592892+0000","last_fullsized":"2024-04-23T19:01:41.592892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101729+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:01:41.101729+0000","last_peered":"2024-04-23T19:01:41.101729+0000","last_clean":"2024-04-23T19:01:41.101729+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:01:41.101729+0000","last_undegraded":"2024-04-23T19:01:41.101729+0000","last_fullsized":"2024-04-23T19:01:41.101729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103357+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:01:41.103357+0000","last_peered":"2024-04-23T19:01:41.103357+0000","last_clean":"2024-04-23T19:01:41.103357+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:01:41.103357+0000","last_undegraded":"2024-04-23T19:01:41.103357+0000","last_fullsized":"2024-04-23T19:01:41.103357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"53'6","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100887+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:01:41.100887+0000","last_peered":"2024-04-23T19:01:41.100887+0000","last_clean":"2024-04-23T19:01:41.100887+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:01:41.100887+0000","last_undegraded":"2024-04-23T19:01:41.100887+0000","last_fullsized":"2024-04-23T19:01:41.100887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590335+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:01:41.590335+0000","last_peered":"2024-04-23T19:01:41.590335+0000","last_clean":"2024-04-23T19:01:41.590335+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:01:41.590335+0000","last_undegraded":"2024-04-23T19:01:41.590335+0000","last_fullsized":"2024-04-23T19:01:41.590335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"56'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594220+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:01:41.594220+0000","last_peered":"2024-04-23T19:01:41.594220+0000","last_clean":"2024-04-23T19:01:41.594220+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:01:41.594220+0000","last_undegraded":"2024-04-23T19:01:41.594220+0000","last_fullsized":"2024-04-23T19:01:41.594220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592154+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:01:41.592154+0000","last_peered":"2024-04-23T19:01:41.592154+0000","last_clean":"2024-04-23T19:01:41.592154+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:01:41.592154+0000","last_undegraded":"2024-04-23T19:01:41.592154+0000","last_fullsized":"2024-04-23T19:01:41.592154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557936+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:01:41.557936+0000","last_peered":"2024-04-23T19:01:41.557936+0000","last_clean":"2024-04-23T19:01:41.557936+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:01:41.557936+0000","last_undegraded":"2024-04-23T19:01:41.557936+0000","last_fullsized":"2024-04-23T19:01:41.557936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":133,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100261+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:01:41.100261+0000","last_peered":"2024-04-23T19:01:41.100261+0000","last_clean":"2024-04-23T19:01:41.100261+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:01:41.100261+0000","last_undegraded":"2024-04-23T19:01:41.100261+0000","last_fullsized":"2024-04-23T19:01:41.100261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558075+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:01:41.558075+0000","last_peered":"2024-04-23T19:01:41.558075+0000","last_clean":"2024-04-23T19:01:41.558075+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:01:41.558075+0000","last_undegraded":"2024-04-23T19:01:41.558075+0000","last_fullsized":"2024-04-23T19:01:41.558075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098029+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:01:41.098029+0000","last_peered":"2024-04-23T19:01:41.098029+0000","last_clean":"2024-04-23T19:01:41.098029+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:01:41.098029+0000","last_undegraded":"2024-04-23T19:01:41.098029+0000","last_fullsized":"2024-04-23T19:01:41.098029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593253+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:01:41.593253+0000","last_peered":"2024-04-23T19:01:41.593253+0000","last_clean":"2024-04-23T19:01:41.593253+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:01:41.593253+0000","last_undegraded":"2024-04-23T19:01:41.593253+0000","last_fullsized":"2024-04-23T19:01:41.593253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":121,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100604+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:01:41.100604+0000","last_peered":"2024-04-23T19:01:41.100604+0000","last_clean":"2024-04-23T19:01:41.100604+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:01:41.100604+0000","last_undegraded":"2024-04-23T19:01:41.100604+0000","last_fullsized":"2024-04-23T19:01:41.100604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"56'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098813+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:01:41.098813+0000","last_peered":"2024-04-23T19:01:41.098813+0000","last_clean":"2024-04-23T19:01:41.098813+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:01:41.098813+0000","last_undegraded":"2024-04-23T19:01:41.098813+0000","last_fullsized":"2024-04-23T19:01:41.098813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593353+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:01:41.593353+0000","last_peered":"2024-04-23T19:01:41.593353+0000","last_clean":"2024-04-23T19:01:41.593353+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:01:41.593353+0000","last_undegraded":"2024-04-23T19:01:41.593353+0000","last_fullsized":"2024-04-23T19:01:41.593353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"57'5","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381794+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:01:41.381794+0000","last_peered":"2024-04-23T19:01:41.381794+0000","last_clean":"2024-04-23T19:01:41.381794+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:01:41.381794+0000","last_undegraded":"2024-04-23T19:01:41.381794+0000","last_fullsized":"2024-04-23T19:01:41.381794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590025+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:01:41.590025+0000","last_peered":"2024-04-23T19:01:41.590025+0000","last_clean":"2024-04-23T19:01:41.590025+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:01:41.590025+0000","last_undegraded":"2024-04-23T19:01:41.590025+0000","last_fullsized":"2024-04-23T19:01:41.590025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100085+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:01:41.100085+0000","last_peered":"2024-04-23T19:01:41.100085+0000","last_clean":"2024-04-23T19:01:41.100085+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:01:41.100085+0000","last_undegraded":"2024-04-23T19:01:41.100085+0000","last_fullsized":"2024-04-23T19:01:41.100085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"57'5","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097936+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:01:41.097936+0000","last_peered":"2024-04-23T19:01:41.097936+0000","last_clean":"2024-04-23T19:01:41.097936+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:01:41.097936+0000","last_undegraded":"2024-04-23T19:01:41.097936+0000","last_fullsized":"2024-04-23T19:01:41.097936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100243+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:01:41.100243+0000","last_peered":"2024-04-23T19:01:41.100243+0000","last_clean":"2024-04-23T19:01:41.100243+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:01:41.100243+0000","last_undegraded":"2024-04-23T19:01:41.100243+0000","last_fullsized":"2024-04-23T19:01:41.100243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"57'16","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381791+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:01:41.381791+0000","last_peered":"2024-04-23T19:01:41.381791+0000","last_clean":"2024-04-23T19:01:41.381791+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:01:41.381791+0000","last_undegraded":"2024-04-23T19:01:41.381791+0000","last_fullsized":"2024-04-23T19:01:41.381791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594572+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:01:41.594572+0000","last_peered":"2024-04-23T19:01:41.594572+0000","last_clean":"2024-04-23T19:01:41.594572+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:01:41.594572+0000","last_undegraded":"2024-04-23T19:01:41.594572+0000","last_fullsized":"2024-04-23T19:01:41.594572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"57'36","reported_seq":119,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098956+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:01:41.098956+0000","last_peered":"2024-04-23T19:01:41.098956+0000","last_clean":"2024-04-23T19:01:41.098956+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:01:41.098956+0000","last_undegraded":"2024-04-23T19:01:41.098956+0000","last_fullsized":"2024-04-23T19:01:41.098956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101438+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:01:41.101438+0000","last_peered":"2024-04-23T19:01:41.101438+0000","last_clean":"2024-04-23T19:01:41.101438+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:01:41.101438+0000","last_undegraded":"2024-04-23T19:01:41.101438+0000","last_fullsized":"2024-04-23T19:01:41.101438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"57'9","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381511+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:01:41.381511+0000","last_peered":"2024-04-23T19:01:41.381511+0000","last_clean":"2024-04-23T19:01:41.381511+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:01:41.381511+0000","last_undegraded":"2024-04-23T19:01:41.381511+0000","last_fullsized":"2024-04-23T19:01:41.381511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099953+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:01:41.099953+0000","last_peered":"2024-04-23T19:01:41.099953+0000","last_clean":"2024-04-23T19:01:41.099953+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:01:41.099953+0000","last_undegraded":"2024-04-23T19:01:41.099953+0000","last_fullsized":"2024-04-23T19:01:41.099953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589865+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:01:41.589865+0000","last_peered":"2024-04-23T19:01:41.589865+0000","last_clean":"2024-04-23T19:01:41.589865+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:01:41.589865+0000","last_undegraded":"2024-04-23T19:01:41.589865+0000","last_fullsized":"2024-04-23T19:01:41.589865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593361+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:01:41.593361+0000","last_peered":"2024-04-23T19:01:41.593361+0000","last_clean":"2024-04-23T19:01:41.593361+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:01:41.593361+0000","last_undegraded":"2024-04-23T19:01:41.593361+0000","last_fullsized":"2024-04-23T19:01:41.593361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381242+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:01:41.381242+0000","last_peered":"2024-04-23T19:01:41.381242+0000","last_clean":"2024-04-23T19:01:41.381242+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:01:41.381242+0000","last_undegraded":"2024-04-23T19:01:41.381242+0000","last_fullsized":"2024-04-23T19:01:41.381242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382839+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:01:41.382839+0000","last_peered":"2024-04-23T19:01:41.382839+0000","last_clean":"2024-04-23T19:01:41.382839+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:01:41.382839+0000","last_undegraded":"2024-04-23T19:01:41.382839+0000","last_fullsized":"2024-04-23T19:01:41.382839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"56'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592659+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:01:41.592659+0000","last_peered":"2024-04-23T19:01:41.592659+0000","last_clean":"2024-04-23T19:01:41.592659+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:01:41.592659+0000","last_undegraded":"2024-04-23T19:01:41.592659+0000","last_fullsized":"2024-04-23T19:01:41.592659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102746+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:01:41.102746+0000","last_peered":"2024-04-23T19:01:41.102746+0000","last_clean":"2024-04-23T19:01:41.102746+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:01:41.102746+0000","last_undegraded":"2024-04-23T19:01:41.102746+0000","last_fullsized":"2024-04-23T19:01:41.102746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098426+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:01:41.098426+0000","last_peered":"2024-04-23T19:01:41.098426+0000","last_clean":"2024-04-23T19:01:41.098426+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:01:41.098426+0000","last_undegraded":"2024-04-23T19:01:41.098426+0000","last_fullsized":"2024-04-23T19:01:41.098426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593178+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:01:41.593178+0000","last_peered":"2024-04-23T19:01:41.593178+0000","last_clean":"2024-04-23T19:01:41.593178+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:01:41.593178+0000","last_undegraded":"2024-04-23T19:01:41.593178+0000","last_fullsized":"2024-04-23T19:01:41.593178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"57'2","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590564+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:01:41.590564+0000","last_peered":"2024-04-23T19:01:41.590564+0000","last_clean":"2024-04-23T19:01:41.590564+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:01:41.590564+0000","last_undegraded":"2024-04-23T19:01:41.590564+0000","last_fullsized":"2024-04-23T19:01:41.590564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102211+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:01:41.102211+0000","last_peered":"2024-04-23T19:01:41.102211+0000","last_clean":"2024-04-23T19:01:41.102211+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:01:41.102211+0000","last_undegraded":"2024-04-23T19:01:41.102211+0000","last_fullsized":"2024-04-23T19:01:41.102211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556545+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:01:41.556545+0000","last_peered":"2024-04-23T19:01:41.556545+0000","last_clean":"2024-04-23T19:01:41.556545+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:01:41.556545+0000","last_undegraded":"2024-04-23T19:01:41.556545+0000","last_fullsized":"2024-04-23T19:01:41.556545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101501+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:01:41.101501+0000","last_peered":"2024-04-23T19:01:41.101501+0000","last_clean":"2024-04-23T19:01:41.101501+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:01:41.101501+0000","last_undegraded":"2024-04-23T19:01:41.101501+0000","last_fullsized":"2024-04-23T19:01:41.101501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"57'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593447+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:01:41.593447+0000","last_peered":"2024-04-23T19:01:41.593447+0000","last_clean":"2024-04-23T19:01:41.593447+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:01:41.593447+0000","last_undegraded":"2024-04-23T19:01:41.593447+0000","last_fullsized":"2024-04-23T19:01:41.593447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099687+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:01:41.099687+0000","last_peered":"2024-04-23T19:01:41.099687+0000","last_clean":"2024-04-23T19:01:41.099687+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:01:41.099687+0000","last_undegraded":"2024-04-23T19:01:41.099687+0000","last_fullsized":"2024-04-23T19:01:41.099687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099661+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:01:41.099661+0000","last_peered":"2024-04-23T19:01:41.099661+0000","last_clean":"2024-04-23T19:01:41.099661+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:01:41.099661+0000","last_undegraded":"2024-04-23T19:01:41.099661+0000","last_fullsized":"2024-04-23T19:01:41.099661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594545+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:01:41.594545+0000","last_peered":"2024-04-23T19:01:41.594545+0000","last_clean":"2024-04-23T19:01:41.594545+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:01:41.594545+0000","last_undegraded":"2024-04-23T19:01:41.594545+0000","last_fullsized":"2024-04-23T19:01:41.594545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":144,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591206+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:01:41.591206+0000","last_peered":"2024-04-23T19:01:41.591206+0000","last_clean":"2024-04-23T19:01:41.591206+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:01:41.591206+0000","last_undegraded":"2024-04-23T19:01:41.591206+0000","last_fullsized":"2024-04-23T19:01:41.591206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"57'24","reported_seq":114,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099115+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:01:41.099115+0000","last_peered":"2024-04-23T19:01:41.099115+0000","last_clean":"2024-04-23T19:01:41.099115+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:01:41.099115+0000","last_undegraded":"2024-04-23T19:01:41.099115+0000","last_fullsized":"2024-04-23T19:01:41.099115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589926+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:01:41.589926+0000","last_peered":"2024-04-23T19:01:41.589926+0000","last_clean":"2024-04-23T19:01:41.589926+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:01:41.589926+0000","last_undegraded":"2024-04-23T19:01:41.589926+0000","last_fullsized":"2024-04-23T19:01:41.589926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":79,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099968+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:01:41.099968+0000","last_peered":"2024-04-23T19:01:41.099968+0000","last_clean":"2024-04-23T19:01:41.099968+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:01:41.099968+0000","last_undegraded":"2024-04-23T19:01:41.099968+0000","last_fullsized":"2024-04-23T19:01:41.099968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591565+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:01:41.591565+0000","last_peered":"2024-04-23T19:01:41.591565+0000","last_clean":"2024-04-23T19:01:41.591565+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:01:41.591565+0000","last_undegraded":"2024-04-23T19:01:41.591565+0000","last_fullsized":"2024-04-23T19:01:41.591565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592083+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:01:41.592083+0000","last_peered":"2024-04-23T19:01:41.592083+0000","last_clean":"2024-04-23T19:01:41.592083+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:01:41.592083+0000","last_undegraded":"2024-04-23T19:01:41.592083+0000","last_fullsized":"2024-04-23T19:01:41.592083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097470+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:01:41.097470+0000","last_peered":"2024-04-23T19:01:41.097470+0000","last_clean":"2024-04-23T19:01:41.097470+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:01:41.097470+0000","last_undegraded":"2024-04-23T19:01:41.097470+0000","last_fullsized":"2024-04-23T19:01:41.097470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"57'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099204+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:01:41.099204+0000","last_peered":"2024-04-23T19:01:41.099204+0000","last_clean":"2024-04-23T19:01:41.099204+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:01:41.099204+0000","last_undegraded":"2024-04-23T19:01:41.099204+0000","last_fullsized":"2024-04-23T19:01:41.099204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098365+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:01:41.098365+0000","last_peered":"2024-04-23T19:01:41.098365+0000","last_clean":"2024-04-23T19:01:41.098365+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:01:41.098365+0000","last_undegraded":"2024-04-23T19:01:41.098365+0000","last_fullsized":"2024-04-23T19:01:41.098365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557295+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:01:41.557295+0000","last_peered":"2024-04-23T19:01:41.557295+0000","last_clean":"2024-04-23T19:01:41.557295+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:01:41.557295+0000","last_undegraded":"2024-04-23T19:01:41.557295+0000","last_fullsized":"2024-04-23T19:01:41.557295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557228+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:01:41.557228+0000","last_peered":"2024-04-23T19:01:41.557228+0000","last_clean":"2024-04-23T19:01:41.557228+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:01:41.557228+0000","last_undegraded":"2024-04-23T19:01:41.557228+0000","last_fullsized":"2024-04-23T19:01:41.557228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594078+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:01:41.594078+0000","last_peered":"2024-04-23T19:01:41.594078+0000","last_clean":"2024-04-23T19:01:41.594078+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:01:41.594078+0000","last_undegraded":"2024-04-23T19:01:41.594078+0000","last_fullsized":"2024-04-23T19:01:41.594078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098263+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:01:41.098263+0000","last_peered":"2024-04-23T19:01:41.098263+0000","last_clean":"2024-04-23T19:01:41.098263+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:01:41.098263+0000","last_undegraded":"2024-04-23T19:01:41.098263+0000","last_fullsized":"2024-04-23T19:01:41.098263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"57'20","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591046+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:01:41.591046+0000","last_peered":"2024-04-23T19:01:41.591046+0000","last_clean":"2024-04-23T19:01:41.591046+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:01:41.591046+0000","last_undegraded":"2024-04-23T19:01:41.591046+0000","last_fullsized":"2024-04-23T19:01:41.591046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"57'92","reported_seq":185,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380742+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:01:41.380742+0000","last_peered":"2024-04-23T19:01:41.380742+0000","last_clean":"2024-04-23T19:01:41.380742+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:01:41.380742+0000","last_undegraded":"2024-04-23T19:01:41.380742+0000","last_fullsized":"2024-04-23T19:01:41.380742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"53'5","reported_seq":78,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381944+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:01:41.381944+0000","last_peered":"2024-04-23T19:01:41.381944+0000","last_clean":"2024-04-23T19:01:41.381944+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:01:41.381944+0000","last_undegraded":"2024-04-23T19:01:41.381944+0000","last_fullsized":"2024-04-23T19:01:41.381944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"53'4","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382392+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:01:41.382392+0000","last_peered":"2024-04-23T19:01:41.382392+0000","last_clean":"2024-04-23T19:01:41.382392+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:01:41.382392+0000","last_undegraded":"2024-04-23T19:01:41.382392+0000","last_fullsized":"2024-04-23T19:01:41.382392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101059+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:01:41.101059+0000","last_peered":"2024-04-23T19:01:41.101059+0000","last_clean":"2024-04-23T19:01:41.101059+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:01:41.101059+0000","last_undegraded":"2024-04-23T19:01:41.101059+0000","last_fullsized":"2024-04-23T19:01:41.101059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098099+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:01:41.098099+0000","last_peered":"2024-04-23T19:01:41.098099+0000","last_clean":"2024-04-23T19:01:41.098099+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:01:41.098099+0000","last_undegraded":"2024-04-23T19:01:41.098099+0000","last_fullsized":"2024-04-23T19:01:41.098099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"57'23","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380931+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:01:41.380931+0000","last_peered":"2024-04-23T19:01:41.380931+0000","last_clean":"2024-04-23T19:01:41.380931+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:01:41.380931+0000","last_undegraded":"2024-04-23T19:01:41.380931+0000","last_fullsized":"2024-04-23T19:01:41.380931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097324+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:01:41.097324+0000","last_peered":"2024-04-23T19:01:41.097324+0000","last_clean":"2024-04-23T19:01:41.097324+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:01:41.097324+0000","last_undegraded":"2024-04-23T19:01:41.097324+0000","last_fullsized":"2024-04-23T19:01:41.097324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"53'6","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590960+0000","last_change":"2024-04-23T19:00:25.352691+0000","last_active":"2024-04-23T19:01:41.590960+0000","last_peered":"2024-04-23T19:01:41.590960+0000","last_clean":"2024-04-23T19:01:41.590960+0000","last_became_active":"2024-04-23T19:00:25.351805+0000","last_became_peered":"2024-04-23T19:00:25.351805+0000","last_unstale":"2024-04-23T19:01:41.590960+0000","last_undegraded":"2024-04-23T19:01:41.590960+0000","last_fullsized":"2024-04-23T19:01:41.590960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:41.939230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":53,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593731+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:01:41.593731+0000","last_peered":"2024-04-23T19:01:41.593731+0000","last_clean":"2024-04-23T19:01:41.593731+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:01:41.593731+0000","last_undegraded":"2024-04-23T19:01:41.593731+0000","last_fullsized":"2024-04-23T19:01:41.593731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098631+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:01:41.098631+0000","last_peered":"2024-04-23T19:01:41.098631+0000","last_clean":"2024-04-23T19:01:41.098631+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:01:41.098631+0000","last_undegraded":"2024-04-23T19:01:41.098631+0000","last_fullsized":"2024-04-23T19:01:41.098631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098470+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:01:41.098470+0000","last_peered":"2024-04-23T19:01:41.098470+0000","last_clean":"2024-04-23T19:01:41.098470+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:01:41.098470+0000","last_undegraded":"2024-04-23T19:01:41.098470+0000","last_fullsized":"2024-04-23T19:01:41.098470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"57'16","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593639+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:01:41.593639+0000","last_peered":"2024-04-23T19:01:41.593639+0000","last_clean":"2024-04-23T19:01:41.593639+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:01:41.593639+0000","last_undegraded":"2024-04-23T19:01:41.593639+0000","last_fullsized":"2024-04-23T19:01:41.593639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382360+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:01:41.382360+0000","last_peered":"2024-04-23T19:01:41.382360+0000","last_clean":"2024-04-23T19:01:41.382360+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:01:41.382360+0000","last_undegraded":"2024-04-23T19:01:41.382360+0000","last_fullsized":"2024-04-23T19:01:41.382360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103072+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:01:41.103072+0000","last_peered":"2024-04-23T19:01:41.103072+0000","last_clean":"2024-04-23T19:01:41.103072+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:01:41.103072+0000","last_undegraded":"2024-04-23T19:01:41.103072+0000","last_fullsized":"2024-04-23T19:01:41.103072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593538+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:01:41.593538+0000","last_peered":"2024-04-23T19:01:41.593538+0000","last_clean":"2024-04-23T19:01:41.593538+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:01:41.593538+0000","last_undegraded":"2024-04-23T19:01:41.593538+0000","last_fullsized":"2024-04-23T19:01:41.593538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557525+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:01:41.557525+0000","last_peered":"2024-04-23T19:01:41.557525+0000","last_clean":"2024-04-23T19:01:41.557525+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:01:41.557525+0000","last_undegraded":"2024-04-23T19:01:41.557525+0000","last_fullsized":"2024-04-23T19:01:41.557525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590026+0000","last_change":"2024-04-23T19:00:19.306483+0000","last_active":"2024-04-23T19:01:41.590026+0000","last_peered":"2024-04-23T19:01:41.590026+0000","last_clean":"2024-04-23T19:01:41.590026+0000","last_became_active":"2024-04-23T19:00:19.305544+0000","last_became_peered":"2024-04-23T19:00:19.305544+0000","last_unstale":"2024-04-23T19:01:41.590026+0000","last_undegraded":"2024-04-23T19:01:41.590026+0000","last_fullsized":"2024-04-23T19:01:41.590026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:57.250293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"57'22","reported_seq":110,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100772+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:01:41.100772+0000","last_peered":"2024-04-23T19:01:41.100772+0000","last_clean":"2024-04-23T19:01:41.100772+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:01:41.100772+0000","last_undegraded":"2024-04-23T19:01:41.100772+0000","last_fullsized":"2024-04-23T19:01:41.100772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"57'92","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098725+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:01:41.098725+0000","last_peered":"2024-04-23T19:01:41.098725+0000","last_clean":"2024-04-23T19:01:41.098725+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:01:41.098725+0000","last_undegraded":"2024-04-23T19:01:41.098725+0000","last_fullsized":"2024-04-23T19:01:41.098725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589664+0000","last_change":"2024-04-23T19:00:25.341628+0000","last_active":"2024-04-23T19:01:41.589664+0000","last_peered":"2024-04-23T19:01:41.589664+0000","last_clean":"2024-04-23T19:01:41.589664+0000","last_became_active":"2024-04-23T19:00:25.341011+0000","last_became_peered":"2024-04-23T19:00:25.341011+0000","last_unstale":"2024-04-23T19:01:41.589664+0000","last_undegraded":"2024-04-23T19:01:41.589664+0000","last_fullsized":"2024-04-23T19:01:41.589664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:34.837079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594673+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:01:41.594673+0000","last_peered":"2024-04-23T19:01:41.594673+0000","last_clean":"2024-04-23T19:01:41.594673+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:01:41.594673+0000","last_undegraded":"2024-04-23T19:01:41.594673+0000","last_fullsized":"2024-04-23T19:01:41.594673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592510+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:01:41.592510+0000","last_peered":"2024-04-23T19:01:41.592510+0000","last_clean":"2024-04-23T19:01:41.592510+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:01:41.592510+0000","last_undegraded":"2024-04-23T19:01:41.592510+0000","last_fullsized":"2024-04-23T19:01:41.592510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":206,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101348+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:01:41.101348+0000","last_peered":"2024-04-23T19:01:41.101348+0000","last_clean":"2024-04-23T19:01:41.101348+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:01:41.101348+0000","last_undegraded":"2024-04-23T19:01:41.101348+0000","last_fullsized":"2024-04-23T19:01:41.101348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"52'11","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099775+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:01:41.099775+0000","last_peered":"2024-04-23T19:01:41.099775+0000","last_clean":"2024-04-23T19:01:41.099775+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:01:41.099775+0000","last_undegraded":"2024-04-23T19:01:41.099775+0000","last_fullsized":"2024-04-23T19:01:41.099775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"57'92","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557525+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:01:41.557525+0000","last_peered":"2024-04-23T19:01:41.557525+0000","last_clean":"2024-04-23T19:01:41.557525+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:01:41.557525+0000","last_undegraded":"2024-04-23T19:01:41.557525+0000","last_fullsized":"2024-04-23T19:01:41.557525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590866+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:01:41.590866+0000","last_peered":"2024-04-23T19:01:41.590866+0000","last_clean":"2024-04-23T19:01:41.590866+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:01:41.590866+0000","last_undegraded":"2024-04-23T19:01:41.590866+0000","last_fullsized":"2024-04-23T19:01:41.590866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591140+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:01:41.591140+0000","last_peered":"2024-04-23T19:01:41.591140+0000","last_clean":"2024-04-23T19:01:41.591140+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:01:41.591140+0000","last_undegraded":"2024-04-23T19:01:41.591140+0000","last_fullsized":"2024-04-23T19:01:41.591140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103453+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:01:41.103453+0000","last_peered":"2024-04-23T19:01:41.103453+0000","last_clean":"2024-04-23T19:01:41.103453+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:01:41.103453+0000","last_undegraded":"2024-04-23T19:01:41.103453+0000","last_fullsized":"2024-04-23T19:01:41.103453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594165+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:01:41.594165+0000","last_peered":"2024-04-23T19:01:41.594165+0000","last_clean":"2024-04-23T19:01:41.594165+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:01:41.594165+0000","last_undegraded":"2024-04-23T19:01:41.594165+0000","last_fullsized":"2024-04-23T19:01:41.594165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"57'23","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100131+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:01:41.100131+0000","last_peered":"2024-04-23T19:01:41.100131+0000","last_clean":"2024-04-23T19:01:41.100131+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:01:41.100131+0000","last_undegraded":"2024-04-23T19:01:41.100131+0000","last_fullsized":"2024-04-23T19:01:41.100131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556975+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:01:41.556975+0000","last_peered":"2024-04-23T19:01:41.556975+0000","last_clean":"2024-04-23T19:01:41.556975+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:01:41.556975+0000","last_undegraded":"2024-04-23T19:01:41.556975+0000","last_fullsized":"2024-04-23T19:01:41.556975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589852+0000","last_change":"2024-04-23T19:00:25.337128+0000","last_active":"2024-04-23T19:01:41.589852+0000","last_peered":"2024-04-23T19:01:41.589852+0000","last_clean":"2024-04-23T19:01:41.589852+0000","last_became_active":"2024-04-23T19:00:25.336132+0000","last_became_peered":"2024-04-23T19:00:25.336132+0000","last_unstale":"2024-04-23T19:01:41.589852+0000","last_undegraded":"2024-04-23T19:01:41.589852+0000","last_fullsized":"2024-04-23T19:01:41.589852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:40.547819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557811+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:01:41.557811+0000","last_peered":"2024-04-23T19:01:41.557811+0000","last_clean":"2024-04-23T19:01:41.557811+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:01:41.557811+0000","last_undegraded":"2024-04-23T19:01:41.557811+0000","last_fullsized":"2024-04-23T19:01:41.557811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":252,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594550+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:01:41.594550+0000","last_peered":"2024-04-23T19:01:41.594550+0000","last_clean":"2024-04-23T19:01:41.594550+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:01:41.594550+0000","last_undegraded":"2024-04-23T19:01:41.594550+0000","last_fullsized":"2024-04-23T19:01:41.594550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100259+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:01:41.100259+0000","last_peered":"2024-04-23T19:01:41.100259+0000","last_clean":"2024-04-23T19:01:41.100259+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:01:41.100259+0000","last_undegraded":"2024-04-23T19:01:41.100259+0000","last_fullsized":"2024-04-23T19:01:41.100259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"57'8","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098754+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:01:41.098754+0000","last_peered":"2024-04-23T19:01:41.098754+0000","last_clean":"2024-04-23T19:01:41.098754+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:01:41.098754+0000","last_undegraded":"2024-04-23T19:01:41.098754+0000","last_fullsized":"2024-04-23T19:01:41.098754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591638+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:01:41.591638+0000","last_peered":"2024-04-23T19:01:41.591638+0000","last_clean":"2024-04-23T19:01:41.591638+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:01:41.591638+0000","last_undegraded":"2024-04-23T19:01:41.591638+0000","last_fullsized":"2024-04-23T19:01:41.591638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"57'28","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101892+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:01:41.101892+0000","last_peered":"2024-04-23T19:01:41.101892+0000","last_clean":"2024-04-23T19:01:41.101892+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:01:41.101892+0000","last_undegraded":"2024-04-23T19:01:41.101892+0000","last_fullsized":"2024-04-23T19:01:41.101892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382056+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:01:41.382056+0000","last_peered":"2024-04-23T19:01:41.382056+0000","last_clean":"2024-04-23T19:01:41.382056+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:01:41.382056+0000","last_undegraded":"2024-04-23T19:01:41.382056+0000","last_fullsized":"2024-04-23T19:01:41.382056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556108+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:01:41.556108+0000","last_peered":"2024-04-23T19:01:41.556108+0000","last_clean":"2024-04-23T19:01:41.556108+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:01:41.556108+0000","last_undegraded":"2024-04-23T19:01:41.556108+0000","last_fullsized":"2024-04-23T19:01:41.556108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382718+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:01:41.382718+0000","last_peered":"2024-04-23T19:01:41.382718+0000","last_clean":"2024-04-23T19:01:41.382718+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:01:41.382718+0000","last_undegraded":"2024-04-23T19:01:41.382718+0000","last_fullsized":"2024-04-23T19:01:41.382718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594194+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:01:41.594194+0000","last_peered":"2024-04-23T19:01:41.594194+0000","last_clean":"2024-04-23T19:01:41.594194+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:01:41.594194+0000","last_undegraded":"2024-04-23T19:01:41.594194+0000","last_fullsized":"2024-04-23T19:01:41.594194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"57'7","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380940+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:01:41.380940+0000","last_peered":"2024-04-23T19:01:41.380940+0000","last_clean":"2024-04-23T19:01:41.380940+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:01:41.380940+0000","last_undegraded":"2024-04-23T19:01:41.380940+0000","last_fullsized":"2024-04-23T19:01:41.380940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102428+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:01:41.102428+0000","last_peered":"2024-04-23T19:01:41.102428+0000","last_clean":"2024-04-23T19:01:41.102428+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:01:41.102428+0000","last_undegraded":"2024-04-23T19:01:41.102428+0000","last_fullsized":"2024-04-23T19:01:41.102428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"57'98","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589107+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:01:41.589107+0000","last_peered":"2024-04-23T19:01:41.589107+0000","last_clean":"2024-04-23T19:01:41.589107+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:01:41.589107+0000","last_undegraded":"2024-04-23T19:01:41.589107+0000","last_fullsized":"2024-04-23T19:01:41.589107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593400+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:01:41.593400+0000","last_peered":"2024-04-23T19:01:41.593400+0000","last_clean":"2024-04-23T19:01:41.593400+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:01:41.593400+0000","last_undegraded":"2024-04-23T19:01:41.593400+0000","last_fullsized":"2024-04-23T19:01:41.593400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589588+0000","last_change":"2024-04-23T19:00:25.337116+0000","last_active":"2024-04-23T19:01:41.589588+0000","last_peered":"2024-04-23T19:01:41.589588+0000","last_clean":"2024-04-23T19:01:41.589588+0000","last_became_active":"2024-04-23T19:00:25.336196+0000","last_became_peered":"2024-04-23T19:00:25.336196+0000","last_unstale":"2024-04-23T19:01:41.589588+0000","last_undegraded":"2024-04-23T19:01:41.589588+0000","last_fullsized":"2024-04-23T19:01:41.589588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:14.525312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"53'6","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591218+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:01:41.591218+0000","last_peered":"2024-04-23T19:01:41.591218+0000","last_clean":"2024-04-23T19:01:41.591218+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:01:41.591218+0000","last_undegraded":"2024-04-23T19:01:41.591218+0000","last_fullsized":"2024-04-23T19:01:41.591218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097834+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:01:41.097834+0000","last_peered":"2024-04-23T19:01:41.097834+0000","last_clean":"2024-04-23T19:01:41.097834+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:01:41.097834+0000","last_undegraded":"2024-04-23T19:01:41.097834+0000","last_fullsized":"2024-04-23T19:01:41.097834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589431+0000","last_change":"2024-04-23T19:00:15.254230+0000","last_active":"2024-04-23T19:01:41.589431+0000","last_peered":"2024-04-23T19:01:41.589431+0000","last_clean":"2024-04-23T19:01:41.589431+0000","last_became_active":"2024-04-23T19:00:15.253857+0000","last_became_peered":"2024-04-23T19:00:15.253857+0000","last_unstale":"2024-04-23T19:01:41.589431+0000","last_undegraded":"2024-04-23T19:01:41.589431+0000","last_fullsized":"2024-04-23T19:01:41.589431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098870+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:01:41.098870+0000","last_peered":"2024-04-23T19:01:41.098870+0000","last_clean":"2024-04-23T19:01:41.098870+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:01:41.098870+0000","last_undegraded":"2024-04-23T19:01:41.098870+0000","last_fullsized":"2024-04-23T19:01:41.098870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'16","reported_seq":116,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593690+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:01:41.593690+0000","last_peered":"2024-04-23T19:01:41.593690+0000","last_clean":"2024-04-23T19:01:41.593690+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:01:41.593690+0000","last_undegraded":"2024-04-23T19:01:41.593690+0000","last_fullsized":"2024-04-23T19:01:41.593690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382081+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:01:41.382081+0000","last_peered":"2024-04-23T19:01:41.382081+0000","last_clean":"2024-04-23T19:01:41.382081+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:01:41.382081+0000","last_undegraded":"2024-04-23T19:01:41.382081+0000","last_fullsized":"2024-04-23T19:01:41.382081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098970+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:01:41.098970+0000","last_peered":"2024-04-23T19:01:41.098970+0000","last_clean":"2024-04-23T19:01:41.098970+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:01:41.098970+0000","last_undegraded":"2024-04-23T19:01:41.098970+0000","last_fullsized":"2024-04-23T19:01:41.098970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590179+0000","last_change":"2024-04-23T19:00:17.298132+0000","last_active":"2024-04-23T19:01:41.590179+0000","last_peered":"2024-04-23T19:01:41.590179+0000","last_clean":"2024-04-23T19:01:41.590179+0000","last_became_active":"2024-04-23T19:00:17.297866+0000","last_became_peered":"2024-04-23T19:00:17.297866+0000","last_unstale":"2024-04-23T19:01:41.590179+0000","last_undegraded":"2024-04-23T19:01:41.590179+0000","last_fullsized":"2024-04-23T19:01:41.590179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100858+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:01:41.100858+0000","last_peered":"2024-04-23T19:01:41.100858+0000","last_clean":"2024-04-23T19:01:41.100858+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:01:41.100858+0000","last_undegraded":"2024-04-23T19:01:41.100858+0000","last_fullsized":"2024-04-23T19:01:41.100858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591513+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:01:41.591513+0000","last_peered":"2024-04-23T19:01:41.591513+0000","last_clean":"2024-04-23T19:01:41.591513+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:01:41.591513+0000","last_undegraded":"2024-04-23T19:01:41.591513+0000","last_fullsized":"2024-04-23T19:01:41.591513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":144,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381772+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:01:41.381772+0000","last_peered":"2024-04-23T19:01:41.381772+0000","last_clean":"2024-04-23T19:01:41.381772+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:01:41.381772+0000","last_undegraded":"2024-04-23T19:01:41.381772+0000","last_fullsized":"2024-04-23T19:01:41.381772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102143+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:01:41.102143+0000","last_peered":"2024-04-23T19:01:41.102143+0000","last_clean":"2024-04-23T19:01:41.102143+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:01:41.102143+0000","last_undegraded":"2024-04-23T19:01:41.102143+0000","last_fullsized":"2024-04-23T19:01:41.102143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558082+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:01:41.558082+0000","last_peered":"2024-04-23T19:01:41.558082+0000","last_clean":"2024-04-23T19:01:41.558082+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:01:41.558082+0000","last_undegraded":"2024-04-23T19:01:41.558082+0000","last_fullsized":"2024-04-23T19:01:41.558082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"57'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098750+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:01:41.098750+0000","last_peered":"2024-04-23T19:01:41.098750+0000","last_clean":"2024-04-23T19:01:41.098750+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:01:41.098750+0000","last_undegraded":"2024-04-23T19:01:41.098750+0000","last_fullsized":"2024-04-23T19:01:41.098750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589934+0000","last_change":"2024-04-23T19:00:17.323700+0000","last_active":"2024-04-23T19:01:41.589934+0000","last_peered":"2024-04-23T19:01:41.589934+0000","last_clean":"2024-04-23T19:01:41.589934+0000","last_became_active":"2024-04-23T19:00:17.323443+0000","last_became_peered":"2024-04-23T19:00:17.323443+0000","last_unstale":"2024-04-23T19:01:41.589934+0000","last_undegraded":"2024-04-23T19:01:41.589934+0000","last_fullsized":"2024-04-23T19:01:41.589934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101581+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:01:41.101581+0000","last_peered":"2024-04-23T19:01:41.101581+0000","last_clean":"2024-04-23T19:01:41.101581+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:01:41.101581+0000","last_undegraded":"2024-04-23T19:01:41.101581+0000","last_fullsized":"2024-04-23T19:01:41.101581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590365+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:01:41.590365+0000","last_peered":"2024-04-23T19:01:41.590365+0000","last_clean":"2024-04-23T19:01:41.590365+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:01:41.590365+0000","last_undegraded":"2024-04-23T19:01:41.590365+0000","last_fullsized":"2024-04-23T19:01:41.590365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381866+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:01:41.381866+0000","last_peered":"2024-04-23T19:01:41.381866+0000","last_clean":"2024-04-23T19:01:41.381866+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:01:41.381866+0000","last_undegraded":"2024-04-23T19:01:41.381866+0000","last_fullsized":"2024-04-23T19:01:41.381866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"57'28","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380303+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:01:41.380303+0000","last_peered":"2024-04-23T19:01:41.380303+0000","last_clean":"2024-04-23T19:01:41.380303+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:01:41.380303+0000","last_undegraded":"2024-04-23T19:01:41.380303+0000","last_fullsized":"2024-04-23T19:01:41.380303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590762+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:01:41.590762+0000","last_peered":"2024-04-23T19:01:41.590762+0000","last_clean":"2024-04-23T19:01:41.590762+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:01:41.590762+0000","last_undegraded":"2024-04-23T19:01:41.590762+0000","last_fullsized":"2024-04-23T19:01:41.590762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":78,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381846+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:01:41.381846+0000","last_peered":"2024-04-23T19:01:41.381846+0000","last_clean":"2024-04-23T19:01:41.381846+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:01:41.381846+0000","last_undegraded":"2024-04-23T19:01:41.381846+0000","last_fullsized":"2024-04-23T19:01:41.381846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382286+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:01:41.382286+0000","last_peered":"2024-04-23T19:01:41.382286+0000","last_clean":"2024-04-23T19:01:41.382286+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:01:41.382286+0000","last_undegraded":"2024-04-23T19:01:41.382286+0000","last_fullsized":"2024-04-23T19:01:41.382286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"56'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590290+0000","last_change":"2024-04-23T19:00:15.252825+0000","last_active":"2024-04-23T19:01:41.590290+0000","last_peered":"2024-04-23T19:01:41.590290+0000","last_clean":"2024-04-23T19:01:41.590290+0000","last_became_active":"2024-04-23T19:00:15.247413+0000","last_became_peered":"2024-04-23T19:00:15.247413+0000","last_unstale":"2024-04-23T19:01:41.590290+0000","last_undegraded":"2024-04-23T19:01:41.590290+0000","last_fullsized":"2024-04-23T19:01:41.590290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594379+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:01:41.594379+0000","last_peered":"2024-04-23T19:01:41.594379+0000","last_clean":"2024-04-23T19:01:41.594379+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:01:41.594379+0000","last_undegraded":"2024-04-23T19:01:41.594379+0000","last_fullsized":"2024-04-23T19:01:41.594379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556860+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:01:41.556860+0000","last_peered":"2024-04-23T19:01:41.556860+0000","last_clean":"2024-04-23T19:01:41.556860+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:01:41.556860+0000","last_undegraded":"2024-04-23T19:01:41.556860+0000","last_fullsized":"2024-04-23T19:01:41.556860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589385+0000","last_change":"2024-04-23T19:00:21.313162+0000","last_active":"2024-04-23T19:01:41.589385+0000","last_peered":"2024-04-23T19:01:41.589385+0000","last_clean":"2024-04-23T19:01:41.589385+0000","last_became_active":"2024-04-23T19:00:21.312313+0000","last_became_peered":"2024-04-23T19:00:21.312313+0000","last_unstale":"2024-04-23T19:01:41.589385+0000","last_undegraded":"2024-04-23T19:01:41.589385+0000","last_fullsized":"2024-04-23T19:01:41.589385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:05.309099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099454+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:01:41.099454+0000","last_peered":"2024-04-23T19:01:41.099454+0000","last_clean":"2024-04-23T19:01:41.099454+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:01:41.099454+0000","last_undegraded":"2024-04-23T19:01:41.099454+0000","last_fullsized":"2024-04-23T19:01:41.099454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102414+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:01:41.102414+0000","last_peered":"2024-04-23T19:01:41.102414+0000","last_clean":"2024-04-23T19:01:41.102414+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:01:41.102414+0000","last_undegraded":"2024-04-23T19:01:41.102414+0000","last_fullsized":"2024-04-23T19:01:41.102414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103234+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:01:41.103234+0000","last_peered":"2024-04-23T19:01:41.103234+0000","last_clean":"2024-04-23T19:01:41.103234+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:01:41.103234+0000","last_undegraded":"2024-04-23T19:01:41.103234+0000","last_fullsized":"2024-04-23T19:01:41.103234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102040+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:01:41.102040+0000","last_peered":"2024-04-23T19:01:41.102040+0000","last_clean":"2024-04-23T19:01:41.102040+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:01:41.102040+0000","last_undegraded":"2024-04-23T19:01:41.102040+0000","last_fullsized":"2024-04-23T19:01:41.102040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591076+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:01:41.591076+0000","last_peered":"2024-04-23T19:01:41.591076+0000","last_clean":"2024-04-23T19:01:41.591076+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:01:41.591076+0000","last_undegraded":"2024-04-23T19:01:41.591076+0000","last_fullsized":"2024-04-23T19:01:41.591076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591330+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:01:41.591330+0000","last_peered":"2024-04-23T19:01:41.591330+0000","last_clean":"2024-04-23T19:01:41.591330+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:01:41.591330+0000","last_undegraded":"2024-04-23T19:01:41.591330+0000","last_fullsized":"2024-04-23T19:01:41.591330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591751+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:01:41.591751+0000","last_peered":"2024-04-23T19:01:41.591751+0000","last_clean":"2024-04-23T19:01:41.591751+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:01:41.591751+0000","last_undegraded":"2024-04-23T19:01:41.591751+0000","last_fullsized":"2024-04-23T19:01:41.591751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"57'92","reported_seq":260,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099533+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:01:41.099533+0000","last_peered":"2024-04-23T19:01:41.099533+0000","last_clean":"2024-04-23T19:01:41.099533+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:01:41.099533+0000","last_undegraded":"2024-04-23T19:01:41.099533+0000","last_fullsized":"2024-04-23T19:01:41.099533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381888+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:01:41.381888+0000","last_peered":"2024-04-23T19:01:41.381888+0000","last_clean":"2024-04-23T19:01:41.381888+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:01:41.381888+0000","last_undegraded":"2024-04-23T19:01:41.381888+0000","last_fullsized":"2024-04-23T19:01:41.381888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591787+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:01:41.591787+0000","last_peered":"2024-04-23T19:01:41.591787+0000","last_clean":"2024-04-23T19:01:41.591787+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:01:41.591787+0000","last_undegraded":"2024-04-23T19:01:41.591787+0000","last_fullsized":"2024-04-23T19:01:41.591787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382849+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:01:41.382849+0000","last_peered":"2024-04-23T19:01:41.382849+0000","last_clean":"2024-04-23T19:01:41.382849+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:01:41.382849+0000","last_undegraded":"2024-04-23T19:01:41.382849+0000","last_fullsized":"2024-04-23T19:01:41.382849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558658+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:01:41.558658+0000","last_peered":"2024-04-23T19:01:41.558658+0000","last_clean":"2024-04-23T19:01:41.558658+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:01:41.558658+0000","last_undegraded":"2024-04-23T19:01:41.558658+0000","last_fullsized":"2024-04-23T19:01:41.558658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103173+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:01:41.103173+0000","last_peered":"2024-04-23T19:01:41.103173+0000","last_clean":"2024-04-23T19:01:41.103173+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:01:41.103173+0000","last_undegraded":"2024-04-23T19:01:41.103173+0000","last_fullsized":"2024-04-23T19:01:41.103173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"57'34","reported_seq":129,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590999+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:01:41.590999+0000","last_peered":"2024-04-23T19:01:41.590999+0000","last_clean":"2024-04-23T19:01:41.590999+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:01:41.590999+0000","last_undegraded":"2024-04-23T19:01:41.590999+0000","last_fullsized":"2024-04-23T19:01:41.590999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098427+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:01:41.098427+0000","last_peered":"2024-04-23T19:01:41.098427+0000","last_clean":"2024-04-23T19:01:41.098427+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:01:41.098427+0000","last_undegraded":"2024-04-23T19:01:41.098427+0000","last_fullsized":"2024-04-23T19:01:41.098427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099964+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:01:41.099964+0000","last_peered":"2024-04-23T19:01:41.099964+0000","last_clean":"2024-04-23T19:01:41.099964+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:01:41.099964+0000","last_undegraded":"2024-04-23T19:01:41.099964+0000","last_fullsized":"2024-04-23T19:01:41.099964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382107+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:01:41.382107+0000","last_peered":"2024-04-23T19:01:41.382107+0000","last_clean":"2024-04-23T19:01:41.382107+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:01:41.382107+0000","last_undegraded":"2024-04-23T19:01:41.382107+0000","last_fullsized":"2024-04-23T19:01:41.382107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590918+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:01:41.590918+0000","last_peered":"2024-04-23T19:01:41.590918+0000","last_clean":"2024-04-23T19:01:41.590918+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:01:41.590918+0000","last_undegraded":"2024-04-23T19:01:41.590918+0000","last_fullsized":"2024-04-23T19:01:41.590918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592966+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:01:41.592966+0000","last_peered":"2024-04-23T19:01:41.592966+0000","last_clean":"2024-04-23T19:01:41.592966+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:01:41.592966+0000","last_undegraded":"2024-04-23T19:01:41.592966+0000","last_fullsized":"2024-04-23T19:01:41.592966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589993+0000","last_change":"2024-04-23T19:00:19.302914+0000","last_active":"2024-04-23T19:01:41.589993+0000","last_peered":"2024-04-23T19:01:41.589993+0000","last_clean":"2024-04-23T19:01:41.589993+0000","last_became_active":"2024-04-23T19:00:19.302271+0000","last_became_peered":"2024-04-23T19:00:19.302271+0000","last_unstale":"2024-04-23T19:01:41.589993+0000","last_undegraded":"2024-04-23T19:01:41.589993+0000","last_fullsized":"2024-04-23T19:01:41.589993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:39.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"57'16","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097881+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:01:41.097881+0000","last_peered":"2024-04-23T19:01:41.097881+0000","last_clean":"2024-04-23T19:01:41.097881+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:01:41.097881+0000","last_undegraded":"2024-04-23T19:01:41.097881+0000","last_fullsized":"2024-04-23T19:01:41.097881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103110+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:01:41.103110+0000","last_peered":"2024-04-23T19:01:41.103110+0000","last_clean":"2024-04-23T19:01:41.103110+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:01:41.103110+0000","last_undegraded":"2024-04-23T19:01:41.103110+0000","last_fullsized":"2024-04-23T19:01:41.103110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102041+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:01:41.102041+0000","last_peered":"2024-04-23T19:01:41.102041+0000","last_clean":"2024-04-23T19:01:41.102041+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:01:41.102041+0000","last_undegraded":"2024-04-23T19:01:41.102041+0000","last_fullsized":"2024-04-23T19:01:41.102041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589765+0000","last_change":"2024-04-23T19:00:17.321501+0000","last_active":"2024-04-23T19:01:41.589765+0000","last_peered":"2024-04-23T19:01:41.589765+0000","last_clean":"2024-04-23T19:01:41.589765+0000","last_became_active":"2024-04-23T19:00:17.321203+0000","last_became_peered":"2024-04-23T19:00:17.321203+0000","last_unstale":"2024-04-23T19:01:41.589765+0000","last_undegraded":"2024-04-23T19:01:41.589765+0000","last_fullsized":"2024-04-23T19:01:41.589765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593987+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:01:41.593987+0000","last_peered":"2024-04-23T19:01:41.593987+0000","last_clean":"2024-04-23T19:01:41.593987+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:01:41.593987+0000","last_undegraded":"2024-04-23T19:01:41.593987+0000","last_fullsized":"2024-04-23T19:01:41.593987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098895+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:01:41.098895+0000","last_peered":"2024-04-23T19:01:41.098895+0000","last_clean":"2024-04-23T19:01:41.098895+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:01:41.098895+0000","last_undegraded":"2024-04-23T19:01:41.098895+0000","last_fullsized":"2024-04-23T19:01:41.098895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"54'6","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380316+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:01:41.380316+0000","last_peered":"2024-04-23T19:01:41.380316+0000","last_clean":"2024-04-23T19:01:41.380316+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:01:41.380316+0000","last_undegraded":"2024-04-23T19:01:41.380316+0000","last_fullsized":"2024-04-23T19:01:41.380316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591660+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:01:41.591660+0000","last_peered":"2024-04-23T19:01:41.591660+0000","last_clean":"2024-04-23T19:01:41.591660+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:01:41.591660+0000","last_undegraded":"2024-04-23T19:01:41.591660+0000","last_fullsized":"2024-04-23T19:01:41.591660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381839+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:01:41.381839+0000","last_peered":"2024-04-23T19:01:41.381839+0000","last_clean":"2024-04-23T19:01:41.381839+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:01:41.381839+0000","last_undegraded":"2024-04-23T19:01:41.381839+0000","last_fullsized":"2024-04-23T19:01:41.381839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098263+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:01:41.098263+0000","last_peered":"2024-04-23T19:01:41.098263+0000","last_clean":"2024-04-23T19:01:41.098263+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:01:41.098263+0000","last_undegraded":"2024-04-23T19:01:41.098263+0000","last_fullsized":"2024-04-23T19:01:41.098263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102461+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:01:41.102461+0000","last_peered":"2024-04-23T19:01:41.102461+0000","last_clean":"2024-04-23T19:01:41.102461+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:01:41.102461+0000","last_undegraded":"2024-04-23T19:01:41.102461+0000","last_fullsized":"2024-04-23T19:01:41.102461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593186+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:01:41.593186+0000","last_peered":"2024-04-23T19:01:41.593186+0000","last_clean":"2024-04-23T19:01:41.593186+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:01:41.593186+0000","last_undegraded":"2024-04-23T19:01:41.593186+0000","last_fullsized":"2024-04-23T19:01:41.593186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"57'18","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098724+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:01:41.098724+0000","last_peered":"2024-04-23T19:01:41.098724+0000","last_clean":"2024-04-23T19:01:41.098724+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:01:41.098724+0000","last_undegraded":"2024-04-23T19:01:41.098724+0000","last_fullsized":"2024-04-23T19:01:41.098724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556841+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:01:41.556841+0000","last_peered":"2024-04-23T19:01:41.556841+0000","last_clean":"2024-04-23T19:01:41.556841+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:01:41.556841+0000","last_undegraded":"2024-04-23T19:01:41.556841+0000","last_fullsized":"2024-04-23T19:01:41.556841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099429+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:01:41.099429+0000","last_peered":"2024-04-23T19:01:41.099429+0000","last_clean":"2024-04-23T19:01:41.099429+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:01:41.099429+0000","last_undegraded":"2024-04-23T19:01:41.099429+0000","last_fullsized":"2024-04-23T19:01:41.099429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103298+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:01:41.103298+0000","last_peered":"2024-04-23T19:01:41.103298+0000","last_clean":"2024-04-23T19:01:41.103298+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:01:41.103298+0000","last_undegraded":"2024-04-23T19:01:41.103298+0000","last_fullsized":"2024-04-23T19:01:41.103298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382414+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:01:41.382414+0000","last_peered":"2024-04-23T19:01:41.382414+0000","last_clean":"2024-04-23T19:01:41.382414+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:01:41.382414+0000","last_undegraded":"2024-04-23T19:01:41.382414+0000","last_fullsized":"2024-04-23T19:01:41.382414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556754+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:01:41.556754+0000","last_peered":"2024-04-23T19:01:41.556754+0000","last_clean":"2024-04-23T19:01:41.556754+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:01:41.556754+0000","last_undegraded":"2024-04-23T19:01:41.556754+0000","last_fullsized":"2024-04-23T19:01:41.556754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"57'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591496+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:01:41.591496+0000","last_peered":"2024-04-23T19:01:41.591496+0000","last_clean":"2024-04-23T19:01:41.591496+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:01:41.591496+0000","last_undegraded":"2024-04-23T19:01:41.591496+0000","last_fullsized":"2024-04-23T19:01:41.591496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381678+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:01:41.381678+0000","last_peered":"2024-04-23T19:01:41.381678+0000","last_clean":"2024-04-23T19:01:41.381678+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:01:41.381678+0000","last_undegraded":"2024-04-23T19:01:41.381678+0000","last_fullsized":"2024-04-23T19:01:41.381678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558429+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:01:41.558429+0000","last_peered":"2024-04-23T19:01:41.558429+0000","last_clean":"2024-04-23T19:01:41.558429+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:01:41.558429+0000","last_undegraded":"2024-04-23T19:01:41.558429+0000","last_fullsized":"2024-04-23T19:01:41.558429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"57'6","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103357+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:01:41.103357+0000","last_peered":"2024-04-23T19:01:41.103357+0000","last_clean":"2024-04-23T19:01:41.103357+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:01:41.103357+0000","last_undegraded":"2024-04-23T19:01:41.103357+0000","last_fullsized":"2024-04-23T19:01:41.103357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382572+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:01:41.382572+0000","last_peered":"2024-04-23T19:01:41.382572+0000","last_clean":"2024-04-23T19:01:41.382572+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:01:41.382572+0000","last_undegraded":"2024-04-23T19:01:41.382572+0000","last_fullsized":"2024-04-23T19:01:41.382572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"57'22","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589173+0000","last_change":"2024-04-23T19:00:21.317917+0000","last_active":"2024-04-23T19:01:41.589173+0000","last_peered":"2024-04-23T19:01:41.589173+0000","last_clean":"2024-04-23T19:01:41.589173+0000","last_became_active":"2024-04-23T19:00:21.317050+0000","last_became_peered":"2024-04-23T19:00:21.317050+0000","last_unstale":"2024-04-23T19:01:41.589173+0000","last_undegraded":"2024-04-23T19:01:41.589173+0000","last_fullsized":"2024-04-23T19:01:41.589173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:14.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100254+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:01:41.100254+0000","last_peered":"2024-04-23T19:01:41.100254+0000","last_clean":"2024-04-23T19:01:41.100254+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:01:41.100254+0000","last_undegraded":"2024-04-23T19:01:41.100254+0000","last_fullsized":"2024-04-23T19:01:41.100254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098535+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:01:41.098535+0000","last_peered":"2024-04-23T19:01:41.098535+0000","last_clean":"2024-04-23T19:01:41.098535+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:01:41.098535+0000","last_undegraded":"2024-04-23T19:01:41.098535+0000","last_fullsized":"2024-04-23T19:01:41.098535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382661+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:01:41.382661+0000","last_peered":"2024-04-23T19:01:41.382661+0000","last_clean":"2024-04-23T19:01:41.382661+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:01:41.382661+0000","last_undegraded":"2024-04-23T19:01:41.382661+0000","last_fullsized":"2024-04-23T19:01:41.382661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589957+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:01:41.589957+0000","last_peered":"2024-04-23T19:01:41.589957+0000","last_clean":"2024-04-23T19:01:41.589957+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:01:41.589957+0000","last_undegraded":"2024-04-23T19:01:41.589957+0000","last_fullsized":"2024-04-23T19:01:41.589957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558196+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:01:41.558196+0000","last_peered":"2024-04-23T19:01:41.558196+0000","last_clean":"2024-04-23T19:01:41.558196+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:01:41.558196+0000","last_undegraded":"2024-04-23T19:01:41.558196+0000","last_fullsized":"2024-04-23T19:01:41.558196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"57'21","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590245+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:01:41.590245+0000","last_peered":"2024-04-23T19:01:41.590245+0000","last_clean":"2024-04-23T19:01:41.590245+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:01:41.590245+0000","last_undegraded":"2024-04-23T19:01:41.590245+0000","last_fullsized":"2024-04-23T19:01:41.590245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590557+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:01:41.590557+0000","last_peered":"2024-04-23T19:01:41.590557+0000","last_clean":"2024-04-23T19:01:41.590557+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:01:41.590557+0000","last_undegraded":"2024-04-23T19:01:41.590557+0000","last_fullsized":"2024-04-23T19:01:41.590557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556570+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:01:41.556570+0000","last_peered":"2024-04-23T19:01:41.556570+0000","last_clean":"2024-04-23T19:01:41.556570+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:01:41.556570+0000","last_undegraded":"2024-04-23T19:01:41.556570+0000","last_fullsized":"2024-04-23T19:01:41.556570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101901+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:01:41.101901+0000","last_peered":"2024-04-23T19:01:41.101901+0000","last_clean":"2024-04-23T19:01:41.101901+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:01:41.101901+0000","last_undegraded":"2024-04-23T19:01:41.101901+0000","last_fullsized":"2024-04-23T19:01:41.101901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"57'8","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592760+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:01:41.592760+0000","last_peered":"2024-04-23T19:01:41.592760+0000","last_clean":"2024-04-23T19:01:41.592760+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:01:41.592760+0000","last_undegraded":"2024-04-23T19:01:41.592760+0000","last_fullsized":"2024-04-23T19:01:41.592760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594243+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:01:41.594243+0000","last_peered":"2024-04-23T19:01:41.594243+0000","last_clean":"2024-04-23T19:01:41.594243+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:01:41.594243+0000","last_undegraded":"2024-04-23T19:01:41.594243+0000","last_fullsized":"2024-04-23T19:01:41.594243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"57'17","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102646+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:01:41.102646+0000","last_peered":"2024-04-23T19:01:41.102646+0000","last_clean":"2024-04-23T19:01:41.102646+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:01:41.102646+0000","last_undegraded":"2024-04-23T19:01:41.102646+0000","last_fullsized":"2024-04-23T19:01:41.102646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590634+0000","last_change":"2024-04-23T19:00:23.344133+0000","last_active":"2024-04-23T19:01:41.590634+0000","last_peered":"2024-04-23T19:01:41.590634+0000","last_clean":"2024-04-23T19:01:41.590634+0000","last_became_active":"2024-04-23T19:00:23.343020+0000","last_became_peered":"2024-04-23T19:00:23.343020+0000","last_unstale":"2024-04-23T19:01:41.590634+0000","last_undegraded":"2024-04-23T19:01:41.590634+0000","last_fullsized":"2024-04-23T19:01:41.590634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:16.330420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"52'5","reported_seq":77,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099123+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:01:41.099123+0000","last_peered":"2024-04-23T19:01:41.099123+0000","last_clean":"2024-04-23T19:01:41.099123+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:01:41.099123+0000","last_undegraded":"2024-04-23T19:01:41.099123+0000","last_fullsized":"2024-04-23T19:01:41.099123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100618+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:01:41.100618+0000","last_peered":"2024-04-23T19:01:41.100618+0000","last_clean":"2024-04-23T19:01:41.100618+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:01:41.100618+0000","last_undegraded":"2024-04-23T19:01:41.100618+0000","last_fullsized":"2024-04-23T19:01:41.100618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"57'4","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381583+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:01:41.381583+0000","last_peered":"2024-04-23T19:01:41.381583+0000","last_clean":"2024-04-23T19:01:41.381583+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:01:41.381583+0000","last_undegraded":"2024-04-23T19:01:41.381583+0000","last_fullsized":"2024-04-23T19:01:41.381583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590821+0000","last_change":"2024-04-23T19:00:19.306559+0000","last_active":"2024-04-23T19:01:41.590821+0000","last_peered":"2024-04-23T19:01:41.590821+0000","last_clean":"2024-04-23T19:01:41.590821+0000","last_became_active":"2024-04-23T19:00:19.305854+0000","last_became_peered":"2024-04-23T19:00:19.305854+0000","last_unstale":"2024-04-23T19:01:41.590821+0000","last_undegraded":"2024-04-23T19:01:41.590821+0000","last_fullsized":"2024-04-23T19:01:41.590821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593911+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:01:41.593911+0000","last_peered":"2024-04-23T19:01:41.593911+0000","last_clean":"2024-04-23T19:01:41.593911+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:01:41.593911+0000","last_undegraded":"2024-04-23T19:01:41.593911+0000","last_fullsized":"2024-04-23T19:01:41.593911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557859+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:01:41.557859+0000","last_peered":"2024-04-23T19:01:41.557859+0000","last_clean":"2024-04-23T19:01:41.557859+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:01:41.557859+0000","last_undegraded":"2024-04-23T19:01:41.557859+0000","last_fullsized":"2024-04-23T19:01:41.557859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592937+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:01:41.592937+0000","last_peered":"2024-04-23T19:01:41.592937+0000","last_clean":"2024-04-23T19:01:41.592937+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:01:41.592937+0000","last_undegraded":"2024-04-23T19:01:41.592937+0000","last_fullsized":"2024-04-23T19:01:41.592937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590865+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:01:41.590865+0000","last_peered":"2024-04-23T19:01:41.590865+0000","last_clean":"2024-04-23T19:01:41.590865+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:01:41.590865+0000","last_undegraded":"2024-04-23T19:01:41.590865+0000","last_fullsized":"2024-04-23T19:01:41.590865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100698+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:01:41.100698+0000","last_peered":"2024-04-23T19:01:41.100698+0000","last_clean":"2024-04-23T19:01:41.100698+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:01:41.100698+0000","last_undegraded":"2024-04-23T19:01:41.100698+0000","last_fullsized":"2024-04-23T19:01:41.100698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592008+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:01:41.592008+0000","last_peered":"2024-04-23T19:01:41.592008+0000","last_clean":"2024-04-23T19:01:41.592008+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:01:41.592008+0000","last_undegraded":"2024-04-23T19:01:41.592008+0000","last_fullsized":"2024-04-23T19:01:41.592008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"57'20","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099429+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:01:41.099429+0000","last_peered":"2024-04-23T19:01:41.099429+0000","last_clean":"2024-04-23T19:01:41.099429+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:01:41.099429+0000","last_undegraded":"2024-04-23T19:01:41.099429+0000","last_fullsized":"2024-04-23T19:01:41.099429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380705+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:01:41.380705+0000","last_peered":"2024-04-23T19:01:41.380705+0000","last_clean":"2024-04-23T19:01:41.380705+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:01:41.380705+0000","last_undegraded":"2024-04-23T19:01:41.380705+0000","last_fullsized":"2024-04-23T19:01:41.380705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594712+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:01:41.594712+0000","last_peered":"2024-04-23T19:01:41.594712+0000","last_clean":"2024-04-23T19:01:41.594712+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:01:41.594712+0000","last_undegraded":"2024-04-23T19:01:41.594712+0000","last_fullsized":"2024-04-23T19:01:41.594712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"57'6","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592066+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:01:41.592066+0000","last_peered":"2024-04-23T19:01:41.592066+0000","last_clean":"2024-04-23T19:01:41.592066+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:01:41.592066+0000","last_undegraded":"2024-04-23T19:01:41.592066+0000","last_fullsized":"2024-04-23T19:01:41.592066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"57'3","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098371+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:01:41.098371+0000","last_peered":"2024-04-23T19:01:41.098371+0000","last_clean":"2024-04-23T19:01:41.098371+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:01:41.098371+0000","last_undegraded":"2024-04-23T19:01:41.098371+0000","last_fullsized":"2024-04-23T19:01:41.098371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099801+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:01:41.099801+0000","last_peered":"2024-04-23T19:01:41.099801+0000","last_clean":"2024-04-23T19:01:41.099801+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:01:41.099801+0000","last_undegraded":"2024-04-23T19:01:41.099801+0000","last_fullsized":"2024-04-23T19:01:41.099801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"57'14","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380827+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:01:41.380827+0000","last_peered":"2024-04-23T19:01:41.380827+0000","last_clean":"2024-04-23T19:01:41.380827+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:01:41.380827+0000","last_undegraded":"2024-04-23T19:01:41.380827+0000","last_fullsized":"2024-04-23T19:01:41.380827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556356+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:01:41.556356+0000","last_peered":"2024-04-23T19:01:41.556356+0000","last_clean":"2024-04-23T19:01:41.556356+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:01:41.556356+0000","last_undegraded":"2024-04-23T19:01:41.556356+0000","last_fullsized":"2024-04-23T19:01:41.556356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102038+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:01:41.102038+0000","last_peered":"2024-04-23T19:01:41.102038+0000","last_clean":"2024-04-23T19:01:41.102038+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:01:41.102038+0000","last_undegraded":"2024-04-23T19:01:41.102038+0000","last_fullsized":"2024-04-23T19:01:41.102038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":128,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098417+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:01:41.098417+0000","last_peered":"2024-04-23T19:01:41.098417+0000","last_clean":"2024-04-23T19:01:41.098417+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:01:41.098417+0000","last_undegraded":"2024-04-23T19:01:41.098417+0000","last_fullsized":"2024-04-23T19:01:41.098417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102224+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:01:41.102224+0000","last_peered":"2024-04-23T19:01:41.102224+0000","last_clean":"2024-04-23T19:01:41.102224+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:01:41.102224+0000","last_undegraded":"2024-04-23T19:01:41.102224+0000","last_fullsized":"2024-04-23T19:01:41.102224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590215+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:01:41.590215+0000","last_peered":"2024-04-23T19:01:41.590215+0000","last_clean":"2024-04-23T19:01:41.590215+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:01:41.590215+0000","last_undegraded":"2024-04-23T19:01:41.590215+0000","last_fullsized":"2024-04-23T19:01:41.590215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"57'11","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099344+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:01:41.099344+0000","last_peered":"2024-04-23T19:01:41.099344+0000","last_clean":"2024-04-23T19:01:41.099344+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:01:41.099344+0000","last_undegraded":"2024-04-23T19:01:41.099344+0000","last_fullsized":"2024-04-23T19:01:41.099344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590286+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:01:41.590286+0000","last_peered":"2024-04-23T19:01:41.590286+0000","last_clean":"2024-04-23T19:01:41.590286+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:01:41.590286+0000","last_undegraded":"2024-04-23T19:01:41.590286+0000","last_fullsized":"2024-04-23T19:01:41.590286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593625+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:01:41.593625+0000","last_peered":"2024-04-23T19:01:41.593625+0000","last_clean":"2024-04-23T19:01:41.593625+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:01:41.593625+0000","last_undegraded":"2024-04-23T19:01:41.593625+0000","last_fullsized":"2024-04-23T19:01:41.593625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590468+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:01:41.590468+0000","last_peered":"2024-04-23T19:01:41.590468+0000","last_clean":"2024-04-23T19:01:41.590468+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:01:41.590468+0000","last_undegraded":"2024-04-23T19:01:41.590468+0000","last_fullsized":"2024-04-23T19:01:41.590468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"56'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382014+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:01:41.382014+0000","last_peered":"2024-04-23T19:01:41.382014+0000","last_clean":"2024-04-23T19:01:41.382014+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:01:41.382014+0000","last_undegraded":"2024-04-23T19:01:41.382014+0000","last_fullsized":"2024-04-23T19:01:41.382014+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589391+0000","last_change":"2024-04-23T19:00:19.302840+0000","last_active":"2024-04-23T19:01:41.589391+0000","last_peered":"2024-04-23T19:01:41.589391+0000","last_clean":"2024-04-23T19:01:41.589391+0000","last_became_active":"2024-04-23T19:00:19.302069+0000","last_became_peered":"2024-04-23T19:00:19.302069+0000","last_unstale":"2024-04-23T19:01:41.589391+0000","last_undegraded":"2024-04-23T19:01:41.589391+0000","last_fullsized":"2024-04-23T19:01:41.589391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:15.157506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"57'15","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589858+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:01:41.589858+0000","last_peered":"2024-04-23T19:01:41.589858+0000","last_clean":"2024-04-23T19:01:41.589858+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:01:41.589858+0000","last_undegraded":"2024-04-23T19:01:41.589858+0000","last_fullsized":"2024-04-23T19:01:41.589858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381586+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:01:41.381586+0000","last_peered":"2024-04-23T19:01:41.381586+0000","last_clean":"2024-04-23T19:01:41.381586+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:01:41.381586+0000","last_undegraded":"2024-04-23T19:01:41.381586+0000","last_fullsized":"2024-04-23T19:01:41.381586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592526+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:01:41.592526+0000","last_peered":"2024-04-23T19:01:41.592526+0000","last_clean":"2024-04-23T19:01:41.592526+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:01:41.592526+0000","last_undegraded":"2024-04-23T19:01:41.592526+0000","last_fullsized":"2024-04-23T19:01:41.592526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591129+0000","last_change":"2024-04-23T19:00:17.315323+0000","last_active":"2024-04-23T19:01:41.591129+0000","last_peered":"2024-04-23T19:01:41.591129+0000","last_clean":"2024-04-23T19:01:41.591129+0000","last_became_active":"2024-04-23T19:00:17.315077+0000","last_became_peered":"2024-04-23T19:00:17.315077+0000","last_unstale":"2024-04-23T19:01:41.591129+0000","last_undegraded":"2024-04-23T19:01:41.591129+0000","last_fullsized":"2024-04-23T19:01:41.591129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"57'3","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556307+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:01:41.556307+0000","last_peered":"2024-04-23T19:01:41.556307+0000","last_clean":"2024-04-23T19:01:41.556307+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:01:41.556307+0000","last_undegraded":"2024-04-23T19:01:41.556307+0000","last_fullsized":"2024-04-23T19:01:41.556307+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590845+0000","last_change":"2024-04-23T19:00:17.297003+0000","last_active":"2024-04-23T19:01:41.590845+0000","last_peered":"2024-04-23T19:01:41.590845+0000","last_clean":"2024-04-23T19:01:41.590845+0000","last_became_active":"2024-04-23T19:00:17.295108+0000","last_became_peered":"2024-04-23T19:00:17.295108+0000","last_unstale":"2024-04-23T19:01:41.590845+0000","last_undegraded":"2024-04-23T19:01:41.590845+0000","last_fullsized":"2024-04-23T19:01:41.590845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097670+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:01:41.097670+0000","last_peered":"2024-04-23T19:01:41.097670+0000","last_clean":"2024-04-23T19:01:41.097670+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:01:41.097670+0000","last_undegraded":"2024-04-23T19:01:41.097670+0000","last_fullsized":"2024-04-23T19:01:41.097670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100977+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:01:41.100977+0000","last_peered":"2024-04-23T19:01:41.100977+0000","last_clean":"2024-04-23T19:01:41.100977+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:01:41.100977+0000","last_undegraded":"2024-04-23T19:01:41.100977+0000","last_fullsized":"2024-04-23T19:01:41.100977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100611+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:01:41.100611+0000","last_peered":"2024-04-23T19:01:41.100611+0000","last_clean":"2024-04-23T19:01:41.100611+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:01:41.100611+0000","last_undegraded":"2024-04-23T19:01:41.100611+0000","last_fullsized":"2024-04-23T19:01:41.100611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590296+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:01:41.590296+0000","last_peered":"2024-04-23T19:01:41.590296+0000","last_clean":"2024-04-23T19:01:41.590296+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:01:41.590296+0000","last_undegraded":"2024-04-23T19:01:41.590296+0000","last_fullsized":"2024-04-23T19:01:41.590296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"57'5","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381534+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:01:41.381534+0000","last_peered":"2024-04-23T19:01:41.381534+0000","last_clean":"2024-04-23T19:01:41.381534+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:01:41.381534+0000","last_undegraded":"2024-04-23T19:01:41.381534+0000","last_fullsized":"2024-04-23T19:01:41.381534+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":124,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099112+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:01:41.099112+0000","last_peered":"2024-04-23T19:01:41.099112+0000","last_clean":"2024-04-23T19:01:41.099112+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:01:41.099112+0000","last_undegraded":"2024-04-23T19:01:41.099112+0000","last_fullsized":"2024-04-23T19:01:41.099112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"57'7","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100319+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:01:41.100319+0000","last_peered":"2024-04-23T19:01:41.100319+0000","last_clean":"2024-04-23T19:01:41.100319+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:01:41.100319+0000","last_undegraded":"2024-04-23T19:01:41.100319+0000","last_fullsized":"2024-04-23T19:01:41.100319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592490+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:01:41.592490+0000","last_peered":"2024-04-23T19:01:41.592490+0000","last_clean":"2024-04-23T19:01:41.592490+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:01:41.592490+0000","last_undegraded":"2024-04-23T19:01:41.592490+0000","last_fullsized":"2024-04-23T19:01:41.592490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"57'9","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591035+0000","last_change":"2024-04-23T19:00:15.251155+0000","last_active":"2024-04-23T19:01:41.591035+0000","last_peered":"2024-04-23T19:01:41.591035+0000","last_clean":"2024-04-23T19:01:41.591035+0000","last_became_active":"2024-04-23T19:00:15.250798+0000","last_became_peered":"2024-04-23T19:00:15.250798+0000","last_unstale":"2024-04-23T19:01:41.591035+0000","last_undegraded":"2024-04-23T19:01:41.591035+0000","last_fullsized":"2024-04-23T19:01:41.591035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098175+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:01:41.098175+0000","last_peered":"2024-04-23T19:01:41.098175+0000","last_clean":"2024-04-23T19:01:41.098175+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:01:41.098175+0000","last_undegraded":"2024-04-23T19:01:41.098175+0000","last_fullsized":"2024-04-23T19:01:41.098175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558157+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:01:41.558157+0000","last_peered":"2024-04-23T19:01:41.558157+0000","last_clean":"2024-04-23T19:01:41.558157+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:01:41.558157+0000","last_undegraded":"2024-04-23T19:01:41.558157+0000","last_fullsized":"2024-04-23T19:01:41.558157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556157+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:01:41.556157+0000","last_peered":"2024-04-23T19:01:41.556157+0000","last_clean":"2024-04-23T19:01:41.556157+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:01:41.556157+0000","last_undegraded":"2024-04-23T19:01:41.556157+0000","last_fullsized":"2024-04-23T19:01:41.556157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102312+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:01:41.102312+0000","last_peered":"2024-04-23T19:01:41.102312+0000","last_clean":"2024-04-23T19:01:41.102312+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:01:41.102312+0000","last_undegraded":"2024-04-23T19:01:41.102312+0000","last_fullsized":"2024-04-23T19:01:41.102312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382321+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:01:41.382321+0000","last_peered":"2024-04-23T19:01:41.382321+0000","last_clean":"2024-04-23T19:01:41.382321+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:01:41.382321+0000","last_undegraded":"2024-04-23T19:01:41.382321+0000","last_fullsized":"2024-04-23T19:01:41.382321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"57'12","reported_seq":105,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099942+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:01:41.099942+0000","last_peered":"2024-04-23T19:01:41.099942+0000","last_clean":"2024-04-23T19:01:41.099942+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:01:41.099942+0000","last_undegraded":"2024-04-23T19:01:41.099942+0000","last_fullsized":"2024-04-23T19:01:41.099942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594405+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:01:41.594405+0000","last_peered":"2024-04-23T19:01:41.594405+0000","last_clean":"2024-04-23T19:01:41.594405+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:01:41.594405+0000","last_undegraded":"2024-04-23T19:01:41.594405+0000","last_fullsized":"2024-04-23T19:01:41.594405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098493+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:01:41.098493+0000","last_peered":"2024-04-23T19:01:41.098493+0000","last_clean":"2024-04-23T19:01:41.098493+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:01:41.098493+0000","last_undegraded":"2024-04-23T19:01:41.098493+0000","last_fullsized":"2024-04-23T19:01:41.098493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098772+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:01:41.098772+0000","last_peered":"2024-04-23T19:01:41.098772+0000","last_clean":"2024-04-23T19:01:41.098772+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:01:41.098772+0000","last_undegraded":"2024-04-23T19:01:41.098772+0000","last_fullsized":"2024-04-23T19:01:41.098772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"57'8","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100585+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:01:41.100585+0000","last_peered":"2024-04-23T19:01:41.100585+0000","last_clean":"2024-04-23T19:01:41.100585+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:01:41.100585+0000","last_undegraded":"2024-04-23T19:01:41.100585+0000","last_fullsized":"2024-04-23T19:01:41.100585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593955+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:01:41.593955+0000","last_peered":"2024-04-23T19:01:41.593955+0000","last_clean":"2024-04-23T19:01:41.593955+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:01:41.593955+0000","last_undegraded":"2024-04-23T19:01:41.593955+0000","last_fullsized":"2024-04-23T19:01:41.593955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381955+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:01:41.381955+0000","last_peered":"2024-04-23T19:01:41.381955+0000","last_clean":"2024-04-23T19:01:41.381955+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:01:41.381955+0000","last_undegraded":"2024-04-23T19:01:41.381955+0000","last_fullsized":"2024-04-23T19:01:41.381955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591518+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:01:41.591518+0000","last_peered":"2024-04-23T19:01:41.591518+0000","last_clean":"2024-04-23T19:01:41.591518+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:01:41.591518+0000","last_undegraded":"2024-04-23T19:01:41.591518+0000","last_fullsized":"2024-04-23T19:01:41.591518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557530+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:01:41.557530+0000","last_peered":"2024-04-23T19:01:41.557530+0000","last_clean":"2024-04-23T19:01:41.557530+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:01:41.557530+0000","last_undegraded":"2024-04-23T19:01:41.557530+0000","last_fullsized":"2024-04-23T19:01:41.557530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381148+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:01:41.381148+0000","last_peered":"2024-04-23T19:01:41.381148+0000","last_clean":"2024-04-23T19:01:41.381148+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:01:41.381148+0000","last_undegraded":"2024-04-23T19:01:41.381148+0000","last_fullsized":"2024-04-23T19:01:41.381148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"57'7","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594334+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:01:41.594334+0000","last_peered":"2024-04-23T19:01:41.594334+0000","last_clean":"2024-04-23T19:01:41.594334+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:01:41.594334+0000","last_undegraded":"2024-04-23T19:01:41.594334+0000","last_fullsized":"2024-04-23T19:01:41.594334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"53'6","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098083+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:01:41.098083+0000","last_peered":"2024-04-23T19:01:41.098083+0000","last_clean":"2024-04-23T19:01:41.098083+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:01:41.098083+0000","last_undegraded":"2024-04-23T19:01:41.098083+0000","last_fullsized":"2024-04-23T19:01:41.098083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099070+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:01:41.099070+0000","last_peered":"2024-04-23T19:01:41.099070+0000","last_clean":"2024-04-23T19:01:41.099070+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:01:41.099070+0000","last_undegraded":"2024-04-23T19:01:41.099070+0000","last_fullsized":"2024-04-23T19:01:41.099070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593794+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:01:41.593794+0000","last_peered":"2024-04-23T19:01:41.593794+0000","last_clean":"2024-04-23T19:01:41.593794+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:01:41.593794+0000","last_undegraded":"2024-04-23T19:01:41.593794+0000","last_fullsized":"2024-04-23T19:01:41.593794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"57'3","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097606+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:01:41.097606+0000","last_peered":"2024-04-23T19:01:41.097606+0000","last_clean":"2024-04-23T19:01:41.097606+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:01:41.097606+0000","last_undegraded":"2024-04-23T19:01:41.097606+0000","last_fullsized":"2024-04-23T19:01:41.097606+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099750+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:01:41.099750+0000","last_peered":"2024-04-23T19:01:41.099750+0000","last_clean":"2024-04-23T19:01:41.099750+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:01:41.099750+0000","last_undegraded":"2024-04-23T19:01:41.099750+0000","last_fullsized":"2024-04-23T19:01:41.099750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"53'4","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382221+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:01:41.382221+0000","last_peered":"2024-04-23T19:01:41.382221+0000","last_clean":"2024-04-23T19:01:41.382221+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:01:41.382221+0000","last_undegraded":"2024-04-23T19:01:41.382221+0000","last_fullsized":"2024-04-23T19:01:41.382221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589799+0000","last_change":"2024-04-23T19:00:15.270216+0000","last_active":"2024-04-23T19:01:41.589799+0000","last_peered":"2024-04-23T19:01:41.589799+0000","last_clean":"2024-04-23T19:01:41.589799+0000","last_became_active":"2024-04-23T19:00:15.269392+0000","last_became_peered":"2024-04-23T19:00:15.269392+0000","last_unstale":"2024-04-23T19:01:41.589799+0000","last_undegraded":"2024-04-23T19:01:41.589799+0000","last_fullsized":"2024-04-23T19:01:41.589799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102079+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:01:41.102079+0000","last_peered":"2024-04-23T19:01:41.102079+0000","last_clean":"2024-04-23T19:01:41.102079+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:01:41.102079+0000","last_undegraded":"2024-04-23T19:01:41.102079+0000","last_fullsized":"2024-04-23T19:01:41.102079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":242,"num_write":218,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":83510,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":794,"num_read_kb":553,"num_write":443,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":127160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":623,"ondisk_log_size":623,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":304,"num_read_kb":304,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":1095,"num_write":228,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329472,"kb_used_data":298288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94042368,"statfs":{"total":96636764160,"available":96299384832,"internally_reserved":0,"allocated":305446912,"data_stored":305056531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189600,"kb_used_data":158412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94182240,"statfs":{"total":96636764160,"available":96442613760,"internally_reserved":0,"allocated":162213888,"data_stored":161858599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345300,"kb_used_data":314112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94026540,"statfs":{"total":96636764160,"available":96283176960,"internally_reserved":0,"allocated":321650688,"data_stored":321249257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349324,"kb_used_data":318136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94022516,"statfs":{"total":96636764160,"available":96279056384,"internally_reserved":0,"allocated":325771264,"data_stored":325434404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412920,"kb_used_data":381740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93958920,"statfs":{"total":96636764160,"available":96213934080,"internally_reserved":0,"allocated":390901760,"data_stored":390514544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208072,"kb_used_data":176884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94163768,"statfs":{"total":96636764160,"available":96423698432,"internally_reserved":0,"allocated":181129216,"data_stored":180788633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":212144,"kb_used_data":180956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94159696,"statfs":{"total":96636764160,"available":96419528704,"internally_reserved":0,"allocated":185298944,"data_stored":184926800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298732,"kb_used_data":267544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94073108,"statfs":{"total":96636764160,"available":96330862592,"internally_reserved":0,"allocated":273965056,"data_stored":273598088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":184549376,"data_stored":184549376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":180355072,"data_stored":180355072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":390070272,"data_stored":390070272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":325058560,"data_stored":325058560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":320864256,"data_stored":320864256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161480704,"data_stored":161480704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":304087040,"data_stored":304087040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:01:45.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:01:45.590 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:45.590 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:45.598 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:45.598 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:45.614 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:45.615 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:45.635 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:45.635 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:45.655 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:45.655 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:45.660 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:45.657+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:45.676 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:45.676 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:45.689 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:45.689 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:45.696 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:45.697 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:45.704 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:45.761 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:45.757+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:45.862 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:45.861+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:45.871 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:45.872 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:45.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:45.914 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:01:45.920 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:01:45.928 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-04-23T19:01:45.148049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070223414,"num_objects":455,"num_object_clones":0,"num_object_copies":910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":2605,"num_read_kb":2309,"num_write":1375,"num_write_kb":1067576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2057,"ondisk_log_size":2057,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":534,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2345564,"kb_used_data":2096072,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752629156,"statfs":{"total":773094113280,"available":770692255744,"internally_reserved":0,"allocated":2146377728,"data_stored":2143426856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4133263,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":139,"num_read_kb":136,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":81789038,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052214"},"pg_stats":[{"pgid":"3.3f","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592948+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:01:41.592948+0000","last_peered":"2024-04-23T19:01:41.592948+0000","last_clean":"2024-04-23T19:01:41.592948+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:01:41.592948+0000","last_undegraded":"2024-04-23T19:01:41.592948+0000","last_fullsized":"2024-04-23T19:01:41.592948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099136+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:01:41.099136+0000","last_peered":"2024-04-23T19:01:41.099136+0000","last_clean":"2024-04-23T19:01:41.099136+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:01:41.099136+0000","last_undegraded":"2024-04-23T19:01:41.099136+0000","last_fullsized":"2024-04-23T19:01:41.099136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591089+0000","last_change":"2024-04-23T19:00:15.257176+0000","last_active":"2024-04-23T19:01:41.591089+0000","last_peered":"2024-04-23T19:01:41.591089+0000","last_clean":"2024-04-23T19:01:41.591089+0000","last_became_active":"2024-04-23T19:00:15.256794+0000","last_became_peered":"2024-04-23T19:00:15.256794+0000","last_unstale":"2024-04-23T19:01:41.591089+0000","last_undegraded":"2024-04-23T19:01:41.591089+0000","last_fullsized":"2024-04-23T19:01:41.591089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591908+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:01:41.591908+0000","last_peered":"2024-04-23T19:01:41.591908+0000","last_clean":"2024-04-23T19:01:41.591908+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:01:41.591908+0000","last_undegraded":"2024-04-23T19:01:41.591908+0000","last_fullsized":"2024-04-23T19:01:41.591908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382098+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:01:41.382098+0000","last_peered":"2024-04-23T19:01:41.382098+0000","last_clean":"2024-04-23T19:01:41.382098+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:01:41.382098+0000","last_undegraded":"2024-04-23T19:01:41.382098+0000","last_fullsized":"2024-04-23T19:01:41.382098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591137+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:01:41.591137+0000","last_peered":"2024-04-23T19:01:41.591137+0000","last_clean":"2024-04-23T19:01:41.591137+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:01:41.591137+0000","last_undegraded":"2024-04-23T19:01:41.591137+0000","last_fullsized":"2024-04-23T19:01:41.591137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100553+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:01:41.100553+0000","last_peered":"2024-04-23T19:01:41.100553+0000","last_clean":"2024-04-23T19:01:41.100553+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:01:41.100553+0000","last_undegraded":"2024-04-23T19:01:41.100553+0000","last_fullsized":"2024-04-23T19:01:41.100553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381771+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:01:41.381771+0000","last_peered":"2024-04-23T19:01:41.381771+0000","last_clean":"2024-04-23T19:01:41.381771+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:01:41.381771+0000","last_undegraded":"2024-04-23T19:01:41.381771+0000","last_fullsized":"2024-04-23T19:01:41.381771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"57'5","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592103+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:01:41.592103+0000","last_peered":"2024-04-23T19:01:41.592103+0000","last_clean":"2024-04-23T19:01:41.592103+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:01:41.592103+0000","last_undegraded":"2024-04-23T19:01:41.592103+0000","last_fullsized":"2024-04-23T19:01:41.592103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":121,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557249+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:01:41.557249+0000","last_peered":"2024-04-23T19:01:41.557249+0000","last_clean":"2024-04-23T19:01:41.557249+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:01:41.557249+0000","last_undegraded":"2024-04-23T19:01:41.557249+0000","last_fullsized":"2024-04-23T19:01:41.557249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099776+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:01:41.099776+0000","last_peered":"2024-04-23T19:01:41.099776+0000","last_clean":"2024-04-23T19:01:41.099776+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:01:41.099776+0000","last_undegraded":"2024-04-23T19:01:41.099776+0000","last_fullsized":"2024-04-23T19:01:41.099776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'8","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593252+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:01:41.593252+0000","last_peered":"2024-04-23T19:01:41.593252+0000","last_clean":"2024-04-23T19:01:41.593252+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:01:41.593252+0000","last_undegraded":"2024-04-23T19:01:41.593252+0000","last_fullsized":"2024-04-23T19:01:41.593252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592892+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:01:41.592892+0000","last_peered":"2024-04-23T19:01:41.592892+0000","last_clean":"2024-04-23T19:01:41.592892+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:01:41.592892+0000","last_undegraded":"2024-04-23T19:01:41.592892+0000","last_fullsized":"2024-04-23T19:01:41.592892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101729+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:01:41.101729+0000","last_peered":"2024-04-23T19:01:41.101729+0000","last_clean":"2024-04-23T19:01:41.101729+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:01:41.101729+0000","last_undegraded":"2024-04-23T19:01:41.101729+0000","last_fullsized":"2024-04-23T19:01:41.101729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103357+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:01:41.103357+0000","last_peered":"2024-04-23T19:01:41.103357+0000","last_clean":"2024-04-23T19:01:41.103357+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:01:41.103357+0000","last_undegraded":"2024-04-23T19:01:41.103357+0000","last_fullsized":"2024-04-23T19:01:41.103357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"53'6","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100887+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:01:41.100887+0000","last_peered":"2024-04-23T19:01:41.100887+0000","last_clean":"2024-04-23T19:01:41.100887+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:01:41.100887+0000","last_undegraded":"2024-04-23T19:01:41.100887+0000","last_fullsized":"2024-04-23T19:01:41.100887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590335+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:01:41.590335+0000","last_peered":"2024-04-23T19:01:41.590335+0000","last_clean":"2024-04-23T19:01:41.590335+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:01:41.590335+0000","last_undegraded":"2024-04-23T19:01:41.590335+0000","last_fullsized":"2024-04-23T19:01:41.590335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"56'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594220+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:01:41.594220+0000","last_peered":"2024-04-23T19:01:41.594220+0000","last_clean":"2024-04-23T19:01:41.594220+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:01:41.594220+0000","last_undegraded":"2024-04-23T19:01:41.594220+0000","last_fullsized":"2024-04-23T19:01:41.594220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592154+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:01:41.592154+0000","last_peered":"2024-04-23T19:01:41.592154+0000","last_clean":"2024-04-23T19:01:41.592154+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:01:41.592154+0000","last_undegraded":"2024-04-23T19:01:41.592154+0000","last_fullsized":"2024-04-23T19:01:41.592154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557936+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:01:41.557936+0000","last_peered":"2024-04-23T19:01:41.557936+0000","last_clean":"2024-04-23T19:01:41.557936+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:01:41.557936+0000","last_undegraded":"2024-04-23T19:01:41.557936+0000","last_fullsized":"2024-04-23T19:01:41.557936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":133,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100261+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:01:41.100261+0000","last_peered":"2024-04-23T19:01:41.100261+0000","last_clean":"2024-04-23T19:01:41.100261+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:01:41.100261+0000","last_undegraded":"2024-04-23T19:01:41.100261+0000","last_fullsized":"2024-04-23T19:01:41.100261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558075+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:01:41.558075+0000","last_peered":"2024-04-23T19:01:41.558075+0000","last_clean":"2024-04-23T19:01:41.558075+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:01:41.558075+0000","last_undegraded":"2024-04-23T19:01:41.558075+0000","last_fullsized":"2024-04-23T19:01:41.558075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098029+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:01:41.098029+0000","last_peered":"2024-04-23T19:01:41.098029+0000","last_clean":"2024-04-23T19:01:41.098029+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:01:41.098029+0000","last_undegraded":"2024-04-23T19:01:41.098029+0000","last_fullsized":"2024-04-23T19:01:41.098029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593253+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:01:41.593253+0000","last_peered":"2024-04-23T19:01:41.593253+0000","last_clean":"2024-04-23T19:01:41.593253+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:01:41.593253+0000","last_undegraded":"2024-04-23T19:01:41.593253+0000","last_fullsized":"2024-04-23T19:01:41.593253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":121,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100604+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:01:41.100604+0000","last_peered":"2024-04-23T19:01:41.100604+0000","last_clean":"2024-04-23T19:01:41.100604+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:01:41.100604+0000","last_undegraded":"2024-04-23T19:01:41.100604+0000","last_fullsized":"2024-04-23T19:01:41.100604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"56'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098813+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:01:41.098813+0000","last_peered":"2024-04-23T19:01:41.098813+0000","last_clean":"2024-04-23T19:01:41.098813+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:01:41.098813+0000","last_undegraded":"2024-04-23T19:01:41.098813+0000","last_fullsized":"2024-04-23T19:01:41.098813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593353+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:01:41.593353+0000","last_peered":"2024-04-23T19:01:41.593353+0000","last_clean":"2024-04-23T19:01:41.593353+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:01:41.593353+0000","last_undegraded":"2024-04-23T19:01:41.593353+0000","last_fullsized":"2024-04-23T19:01:41.593353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"57'5","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381794+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:01:41.381794+0000","last_peered":"2024-04-23T19:01:41.381794+0000","last_clean":"2024-04-23T19:01:41.381794+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:01:41.381794+0000","last_undegraded":"2024-04-23T19:01:41.381794+0000","last_fullsized":"2024-04-23T19:01:41.381794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590025+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:01:41.590025+0000","last_peered":"2024-04-23T19:01:41.590025+0000","last_clean":"2024-04-23T19:01:41.590025+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:01:41.590025+0000","last_undegraded":"2024-04-23T19:01:41.590025+0000","last_fullsized":"2024-04-23T19:01:41.590025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100085+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:01:41.100085+0000","last_peered":"2024-04-23T19:01:41.100085+0000","last_clean":"2024-04-23T19:01:41.100085+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:01:41.100085+0000","last_undegraded":"2024-04-23T19:01:41.100085+0000","last_fullsized":"2024-04-23T19:01:41.100085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"57'5","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097936+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:01:41.097936+0000","last_peered":"2024-04-23T19:01:41.097936+0000","last_clean":"2024-04-23T19:01:41.097936+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:01:41.097936+0000","last_undegraded":"2024-04-23T19:01:41.097936+0000","last_fullsized":"2024-04-23T19:01:41.097936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100243+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:01:41.100243+0000","last_peered":"2024-04-23T19:01:41.100243+0000","last_clean":"2024-04-23T19:01:41.100243+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:01:41.100243+0000","last_undegraded":"2024-04-23T19:01:41.100243+0000","last_fullsized":"2024-04-23T19:01:41.100243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"57'16","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381791+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:01:41.381791+0000","last_peered":"2024-04-23T19:01:41.381791+0000","last_clean":"2024-04-23T19:01:41.381791+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:01:41.381791+0000","last_undegraded":"2024-04-23T19:01:41.381791+0000","last_fullsized":"2024-04-23T19:01:41.381791+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594572+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:01:41.594572+0000","last_peered":"2024-04-23T19:01:41.594572+0000","last_clean":"2024-04-23T19:01:41.594572+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:01:41.594572+0000","last_undegraded":"2024-04-23T19:01:41.594572+0000","last_fullsized":"2024-04-23T19:01:41.594572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"57'36","reported_seq":119,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098956+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:01:41.098956+0000","last_peered":"2024-04-23T19:01:41.098956+0000","last_clean":"2024-04-23T19:01:41.098956+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:01:41.098956+0000","last_undegraded":"2024-04-23T19:01:41.098956+0000","last_fullsized":"2024-04-23T19:01:41.098956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101438+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:01:41.101438+0000","last_peered":"2024-04-23T19:01:41.101438+0000","last_clean":"2024-04-23T19:01:41.101438+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:01:41.101438+0000","last_undegraded":"2024-04-23T19:01:41.101438+0000","last_fullsized":"2024-04-23T19:01:41.101438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"57'9","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381511+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:01:41.381511+0000","last_peered":"2024-04-23T19:01:41.381511+0000","last_clean":"2024-04-23T19:01:41.381511+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:01:41.381511+0000","last_undegraded":"2024-04-23T19:01:41.381511+0000","last_fullsized":"2024-04-23T19:01:41.381511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099953+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:01:41.099953+0000","last_peered":"2024-04-23T19:01:41.099953+0000","last_clean":"2024-04-23T19:01:41.099953+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:01:41.099953+0000","last_undegraded":"2024-04-23T19:01:41.099953+0000","last_fullsized":"2024-04-23T19:01:41.099953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589865+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:01:41.589865+0000","last_peered":"2024-04-23T19:01:41.589865+0000","last_clean":"2024-04-23T19:01:41.589865+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:01:41.589865+0000","last_undegraded":"2024-04-23T19:01:41.589865+0000","last_fullsized":"2024-04-23T19:01:41.589865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593361+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:01:41.593361+0000","last_peered":"2024-04-23T19:01:41.593361+0000","last_clean":"2024-04-23T19:01:41.593361+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:01:41.593361+0000","last_undegraded":"2024-04-23T19:01:41.593361+0000","last_fullsized":"2024-04-23T19:01:41.593361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381242+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:01:41.381242+0000","last_peered":"2024-04-23T19:01:41.381242+0000","last_clean":"2024-04-23T19:01:41.381242+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:01:41.381242+0000","last_undegraded":"2024-04-23T19:01:41.381242+0000","last_fullsized":"2024-04-23T19:01:41.381242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382839+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:01:41.382839+0000","last_peered":"2024-04-23T19:01:41.382839+0000","last_clean":"2024-04-23T19:01:41.382839+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:01:41.382839+0000","last_undegraded":"2024-04-23T19:01:41.382839+0000","last_fullsized":"2024-04-23T19:01:41.382839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"56'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592659+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:01:41.592659+0000","last_peered":"2024-04-23T19:01:41.592659+0000","last_clean":"2024-04-23T19:01:41.592659+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:01:41.592659+0000","last_undegraded":"2024-04-23T19:01:41.592659+0000","last_fullsized":"2024-04-23T19:01:41.592659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102746+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:01:41.102746+0000","last_peered":"2024-04-23T19:01:41.102746+0000","last_clean":"2024-04-23T19:01:41.102746+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:01:41.102746+0000","last_undegraded":"2024-04-23T19:01:41.102746+0000","last_fullsized":"2024-04-23T19:01:41.102746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098426+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:01:41.098426+0000","last_peered":"2024-04-23T19:01:41.098426+0000","last_clean":"2024-04-23T19:01:41.098426+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:01:41.098426+0000","last_undegraded":"2024-04-23T19:01:41.098426+0000","last_fullsized":"2024-04-23T19:01:41.098426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593178+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:01:41.593178+0000","last_peered":"2024-04-23T19:01:41.593178+0000","last_clean":"2024-04-23T19:01:41.593178+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:01:41.593178+0000","last_undegraded":"2024-04-23T19:01:41.593178+0000","last_fullsized":"2024-04-23T19:01:41.593178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"57'2","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590564+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:01:41.590564+0000","last_peered":"2024-04-23T19:01:41.590564+0000","last_clean":"2024-04-23T19:01:41.590564+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:01:41.590564+0000","last_undegraded":"2024-04-23T19:01:41.590564+0000","last_fullsized":"2024-04-23T19:01:41.590564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102211+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:01:41.102211+0000","last_peered":"2024-04-23T19:01:41.102211+0000","last_clean":"2024-04-23T19:01:41.102211+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:01:41.102211+0000","last_undegraded":"2024-04-23T19:01:41.102211+0000","last_fullsized":"2024-04-23T19:01:41.102211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556545+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:01:41.556545+0000","last_peered":"2024-04-23T19:01:41.556545+0000","last_clean":"2024-04-23T19:01:41.556545+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:01:41.556545+0000","last_undegraded":"2024-04-23T19:01:41.556545+0000","last_fullsized":"2024-04-23T19:01:41.556545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101501+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:01:41.101501+0000","last_peered":"2024-04-23T19:01:41.101501+0000","last_clean":"2024-04-23T19:01:41.101501+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:01:41.101501+0000","last_undegraded":"2024-04-23T19:01:41.101501+0000","last_fullsized":"2024-04-23T19:01:41.101501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"57'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593447+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:01:41.593447+0000","last_peered":"2024-04-23T19:01:41.593447+0000","last_clean":"2024-04-23T19:01:41.593447+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:01:41.593447+0000","last_undegraded":"2024-04-23T19:01:41.593447+0000","last_fullsized":"2024-04-23T19:01:41.593447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099687+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:01:41.099687+0000","last_peered":"2024-04-23T19:01:41.099687+0000","last_clean":"2024-04-23T19:01:41.099687+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:01:41.099687+0000","last_undegraded":"2024-04-23T19:01:41.099687+0000","last_fullsized":"2024-04-23T19:01:41.099687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099661+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:01:41.099661+0000","last_peered":"2024-04-23T19:01:41.099661+0000","last_clean":"2024-04-23T19:01:41.099661+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:01:41.099661+0000","last_undegraded":"2024-04-23T19:01:41.099661+0000","last_fullsized":"2024-04-23T19:01:41.099661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594545+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:01:41.594545+0000","last_peered":"2024-04-23T19:01:41.594545+0000","last_clean":"2024-04-23T19:01:41.594545+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:01:41.594545+0000","last_undegraded":"2024-04-23T19:01:41.594545+0000","last_fullsized":"2024-04-23T19:01:41.594545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":144,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591206+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:01:41.591206+0000","last_peered":"2024-04-23T19:01:41.591206+0000","last_clean":"2024-04-23T19:01:41.591206+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:01:41.591206+0000","last_undegraded":"2024-04-23T19:01:41.591206+0000","last_fullsized":"2024-04-23T19:01:41.591206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"57'24","reported_seq":114,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099115+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:01:41.099115+0000","last_peered":"2024-04-23T19:01:41.099115+0000","last_clean":"2024-04-23T19:01:41.099115+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:01:41.099115+0000","last_undegraded":"2024-04-23T19:01:41.099115+0000","last_fullsized":"2024-04-23T19:01:41.099115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589926+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:01:41.589926+0000","last_peered":"2024-04-23T19:01:41.589926+0000","last_clean":"2024-04-23T19:01:41.589926+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:01:41.589926+0000","last_undegraded":"2024-04-23T19:01:41.589926+0000","last_fullsized":"2024-04-23T19:01:41.589926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":79,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099968+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:01:41.099968+0000","last_peered":"2024-04-23T19:01:41.099968+0000","last_clean":"2024-04-23T19:01:41.099968+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:01:41.099968+0000","last_undegraded":"2024-04-23T19:01:41.099968+0000","last_fullsized":"2024-04-23T19:01:41.099968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591565+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:01:41.591565+0000","last_peered":"2024-04-23T19:01:41.591565+0000","last_clean":"2024-04-23T19:01:41.591565+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:01:41.591565+0000","last_undegraded":"2024-04-23T19:01:41.591565+0000","last_fullsized":"2024-04-23T19:01:41.591565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592083+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:01:41.592083+0000","last_peered":"2024-04-23T19:01:41.592083+0000","last_clean":"2024-04-23T19:01:41.592083+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:01:41.592083+0000","last_undegraded":"2024-04-23T19:01:41.592083+0000","last_fullsized":"2024-04-23T19:01:41.592083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097470+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:01:41.097470+0000","last_peered":"2024-04-23T19:01:41.097470+0000","last_clean":"2024-04-23T19:01:41.097470+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:01:41.097470+0000","last_undegraded":"2024-04-23T19:01:41.097470+0000","last_fullsized":"2024-04-23T19:01:41.097470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"57'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099204+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:01:41.099204+0000","last_peered":"2024-04-23T19:01:41.099204+0000","last_clean":"2024-04-23T19:01:41.099204+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:01:41.099204+0000","last_undegraded":"2024-04-23T19:01:41.099204+0000","last_fullsized":"2024-04-23T19:01:41.099204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098365+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:01:41.098365+0000","last_peered":"2024-04-23T19:01:41.098365+0000","last_clean":"2024-04-23T19:01:41.098365+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:01:41.098365+0000","last_undegraded":"2024-04-23T19:01:41.098365+0000","last_fullsized":"2024-04-23T19:01:41.098365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557295+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:01:41.557295+0000","last_peered":"2024-04-23T19:01:41.557295+0000","last_clean":"2024-04-23T19:01:41.557295+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:01:41.557295+0000","last_undegraded":"2024-04-23T19:01:41.557295+0000","last_fullsized":"2024-04-23T19:01:41.557295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557228+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:01:41.557228+0000","last_peered":"2024-04-23T19:01:41.557228+0000","last_clean":"2024-04-23T19:01:41.557228+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:01:41.557228+0000","last_undegraded":"2024-04-23T19:01:41.557228+0000","last_fullsized":"2024-04-23T19:01:41.557228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594078+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:01:41.594078+0000","last_peered":"2024-04-23T19:01:41.594078+0000","last_clean":"2024-04-23T19:01:41.594078+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:01:41.594078+0000","last_undegraded":"2024-04-23T19:01:41.594078+0000","last_fullsized":"2024-04-23T19:01:41.594078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098263+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:01:41.098263+0000","last_peered":"2024-04-23T19:01:41.098263+0000","last_clean":"2024-04-23T19:01:41.098263+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:01:41.098263+0000","last_undegraded":"2024-04-23T19:01:41.098263+0000","last_fullsized":"2024-04-23T19:01:41.098263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"57'20","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591046+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:01:41.591046+0000","last_peered":"2024-04-23T19:01:41.591046+0000","last_clean":"2024-04-23T19:01:41.591046+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:01:41.591046+0000","last_undegraded":"2024-04-23T19:01:41.591046+0000","last_fullsized":"2024-04-23T19:01:41.591046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"57'92","reported_seq":185,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380742+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:01:41.380742+0000","last_peered":"2024-04-23T19:01:41.380742+0000","last_clean":"2024-04-23T19:01:41.380742+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:01:41.380742+0000","last_undegraded":"2024-04-23T19:01:41.380742+0000","last_fullsized":"2024-04-23T19:01:41.380742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"53'5","reported_seq":78,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381944+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:01:41.381944+0000","last_peered":"2024-04-23T19:01:41.381944+0000","last_clean":"2024-04-23T19:01:41.381944+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:01:41.381944+0000","last_undegraded":"2024-04-23T19:01:41.381944+0000","last_fullsized":"2024-04-23T19:01:41.381944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"53'4","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382392+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:01:41.382392+0000","last_peered":"2024-04-23T19:01:41.382392+0000","last_clean":"2024-04-23T19:01:41.382392+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:01:41.382392+0000","last_undegraded":"2024-04-23T19:01:41.382392+0000","last_fullsized":"2024-04-23T19:01:41.382392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101059+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:01:41.101059+0000","last_peered":"2024-04-23T19:01:41.101059+0000","last_clean":"2024-04-23T19:01:41.101059+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:01:41.101059+0000","last_undegraded":"2024-04-23T19:01:41.101059+0000","last_fullsized":"2024-04-23T19:01:41.101059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098099+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:01:41.098099+0000","last_peered":"2024-04-23T19:01:41.098099+0000","last_clean":"2024-04-23T19:01:41.098099+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:01:41.098099+0000","last_undegraded":"2024-04-23T19:01:41.098099+0000","last_fullsized":"2024-04-23T19:01:41.098099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"57'23","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380931+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:01:41.380931+0000","last_peered":"2024-04-23T19:01:41.380931+0000","last_clean":"2024-04-23T19:01:41.380931+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:01:41.380931+0000","last_undegraded":"2024-04-23T19:01:41.380931+0000","last_fullsized":"2024-04-23T19:01:41.380931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097324+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:01:41.097324+0000","last_peered":"2024-04-23T19:01:41.097324+0000","last_clean":"2024-04-23T19:01:41.097324+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:01:41.097324+0000","last_undegraded":"2024-04-23T19:01:41.097324+0000","last_fullsized":"2024-04-23T19:01:41.097324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"53'6","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590960+0000","last_change":"2024-04-23T19:00:25.352691+0000","last_active":"2024-04-23T19:01:41.590960+0000","last_peered":"2024-04-23T19:01:41.590960+0000","last_clean":"2024-04-23T19:01:41.590960+0000","last_became_active":"2024-04-23T19:00:25.351805+0000","last_became_peered":"2024-04-23T19:00:25.351805+0000","last_unstale":"2024-04-23T19:01:41.590960+0000","last_undegraded":"2024-04-23T19:01:41.590960+0000","last_fullsized":"2024-04-23T19:01:41.590960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:41.939230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":53,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593731+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:01:41.593731+0000","last_peered":"2024-04-23T19:01:41.593731+0000","last_clean":"2024-04-23T19:01:41.593731+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:01:41.593731+0000","last_undegraded":"2024-04-23T19:01:41.593731+0000","last_fullsized":"2024-04-23T19:01:41.593731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098631+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:01:41.098631+0000","last_peered":"2024-04-23T19:01:41.098631+0000","last_clean":"2024-04-23T19:01:41.098631+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:01:41.098631+0000","last_undegraded":"2024-04-23T19:01:41.098631+0000","last_fullsized":"2024-04-23T19:01:41.098631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098470+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:01:41.098470+0000","last_peered":"2024-04-23T19:01:41.098470+0000","last_clean":"2024-04-23T19:01:41.098470+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:01:41.098470+0000","last_undegraded":"2024-04-23T19:01:41.098470+0000","last_fullsized":"2024-04-23T19:01:41.098470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"57'16","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593639+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:01:41.593639+0000","last_peered":"2024-04-23T19:01:41.593639+0000","last_clean":"2024-04-23T19:01:41.593639+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:01:41.593639+0000","last_undegraded":"2024-04-23T19:01:41.593639+0000","last_fullsized":"2024-04-23T19:01:41.593639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382360+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:01:41.382360+0000","last_peered":"2024-04-23T19:01:41.382360+0000","last_clean":"2024-04-23T19:01:41.382360+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:01:41.382360+0000","last_undegraded":"2024-04-23T19:01:41.382360+0000","last_fullsized":"2024-04-23T19:01:41.382360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103072+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:01:41.103072+0000","last_peered":"2024-04-23T19:01:41.103072+0000","last_clean":"2024-04-23T19:01:41.103072+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:01:41.103072+0000","last_undegraded":"2024-04-23T19:01:41.103072+0000","last_fullsized":"2024-04-23T19:01:41.103072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593538+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:01:41.593538+0000","last_peered":"2024-04-23T19:01:41.593538+0000","last_clean":"2024-04-23T19:01:41.593538+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:01:41.593538+0000","last_undegraded":"2024-04-23T19:01:41.593538+0000","last_fullsized":"2024-04-23T19:01:41.593538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557525+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:01:41.557525+0000","last_peered":"2024-04-23T19:01:41.557525+0000","last_clean":"2024-04-23T19:01:41.557525+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:01:41.557525+0000","last_undegraded":"2024-04-23T19:01:41.557525+0000","last_fullsized":"2024-04-23T19:01:41.557525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590026+0000","last_change":"2024-04-23T19:00:19.306483+0000","last_active":"2024-04-23T19:01:41.590026+0000","last_peered":"2024-04-23T19:01:41.590026+0000","last_clean":"2024-04-23T19:01:41.590026+0000","last_became_active":"2024-04-23T19:00:19.305544+0000","last_became_peered":"2024-04-23T19:00:19.305544+0000","last_unstale":"2024-04-23T19:01:41.590026+0000","last_undegraded":"2024-04-23T19:01:41.590026+0000","last_fullsized":"2024-04-23T19:01:41.590026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:57.250293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"57'22","reported_seq":110,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100772+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:01:41.100772+0000","last_peered":"2024-04-23T19:01:41.100772+0000","last_clean":"2024-04-23T19:01:41.100772+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:01:41.100772+0000","last_undegraded":"2024-04-23T19:01:41.100772+0000","last_fullsized":"2024-04-23T19:01:41.100772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"57'92","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098725+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:01:41.098725+0000","last_peered":"2024-04-23T19:01:41.098725+0000","last_clean":"2024-04-23T19:01:41.098725+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:01:41.098725+0000","last_undegraded":"2024-04-23T19:01:41.098725+0000","last_fullsized":"2024-04-23T19:01:41.098725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589664+0000","last_change":"2024-04-23T19:00:25.341628+0000","last_active":"2024-04-23T19:01:41.589664+0000","last_peered":"2024-04-23T19:01:41.589664+0000","last_clean":"2024-04-23T19:01:41.589664+0000","last_became_active":"2024-04-23T19:00:25.341011+0000","last_became_peered":"2024-04-23T19:00:25.341011+0000","last_unstale":"2024-04-23T19:01:41.589664+0000","last_undegraded":"2024-04-23T19:01:41.589664+0000","last_fullsized":"2024-04-23T19:01:41.589664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:34.837079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594673+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:01:41.594673+0000","last_peered":"2024-04-23T19:01:41.594673+0000","last_clean":"2024-04-23T19:01:41.594673+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:01:41.594673+0000","last_undegraded":"2024-04-23T19:01:41.594673+0000","last_fullsized":"2024-04-23T19:01:41.594673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592510+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:01:41.592510+0000","last_peered":"2024-04-23T19:01:41.592510+0000","last_clean":"2024-04-23T19:01:41.592510+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:01:41.592510+0000","last_undegraded":"2024-04-23T19:01:41.592510+0000","last_fullsized":"2024-04-23T19:01:41.592510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":206,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101348+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:01:41.101348+0000","last_peered":"2024-04-23T19:01:41.101348+0000","last_clean":"2024-04-23T19:01:41.101348+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:01:41.101348+0000","last_undegraded":"2024-04-23T19:01:41.101348+0000","last_fullsized":"2024-04-23T19:01:41.101348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"52'11","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099775+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:01:41.099775+0000","last_peered":"2024-04-23T19:01:41.099775+0000","last_clean":"2024-04-23T19:01:41.099775+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:01:41.099775+0000","last_undegraded":"2024-04-23T19:01:41.099775+0000","last_fullsized":"2024-04-23T19:01:41.099775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"57'92","reported_seq":218,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557525+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:01:41.557525+0000","last_peered":"2024-04-23T19:01:41.557525+0000","last_clean":"2024-04-23T19:01:41.557525+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:01:41.557525+0000","last_undegraded":"2024-04-23T19:01:41.557525+0000","last_fullsized":"2024-04-23T19:01:41.557525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590866+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:01:41.590866+0000","last_peered":"2024-04-23T19:01:41.590866+0000","last_clean":"2024-04-23T19:01:41.590866+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:01:41.590866+0000","last_undegraded":"2024-04-23T19:01:41.590866+0000","last_fullsized":"2024-04-23T19:01:41.590866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591140+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:01:41.591140+0000","last_peered":"2024-04-23T19:01:41.591140+0000","last_clean":"2024-04-23T19:01:41.591140+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:01:41.591140+0000","last_undegraded":"2024-04-23T19:01:41.591140+0000","last_fullsized":"2024-04-23T19:01:41.591140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103453+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:01:41.103453+0000","last_peered":"2024-04-23T19:01:41.103453+0000","last_clean":"2024-04-23T19:01:41.103453+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:01:41.103453+0000","last_undegraded":"2024-04-23T19:01:41.103453+0000","last_fullsized":"2024-04-23T19:01:41.103453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594165+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:01:41.594165+0000","last_peered":"2024-04-23T19:01:41.594165+0000","last_clean":"2024-04-23T19:01:41.594165+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:01:41.594165+0000","last_undegraded":"2024-04-23T19:01:41.594165+0000","last_fullsized":"2024-04-23T19:01:41.594165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"57'23","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100131+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:01:41.100131+0000","last_peered":"2024-04-23T19:01:41.100131+0000","last_clean":"2024-04-23T19:01:41.100131+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:01:41.100131+0000","last_undegraded":"2024-04-23T19:01:41.100131+0000","last_fullsized":"2024-04-23T19:01:41.100131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556975+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:01:41.556975+0000","last_peered":"2024-04-23T19:01:41.556975+0000","last_clean":"2024-04-23T19:01:41.556975+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:01:41.556975+0000","last_undegraded":"2024-04-23T19:01:41.556975+0000","last_fullsized":"2024-04-23T19:01:41.556975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589852+0000","last_change":"2024-04-23T19:00:25.337128+0000","last_active":"2024-04-23T19:01:41.589852+0000","last_peered":"2024-04-23T19:01:41.589852+0000","last_clean":"2024-04-23T19:01:41.589852+0000","last_became_active":"2024-04-23T19:00:25.336132+0000","last_became_peered":"2024-04-23T19:00:25.336132+0000","last_unstale":"2024-04-23T19:01:41.589852+0000","last_undegraded":"2024-04-23T19:01:41.589852+0000","last_fullsized":"2024-04-23T19:01:41.589852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:40.547819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557811+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:01:41.557811+0000","last_peered":"2024-04-23T19:01:41.557811+0000","last_clean":"2024-04-23T19:01:41.557811+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:01:41.557811+0000","last_undegraded":"2024-04-23T19:01:41.557811+0000","last_fullsized":"2024-04-23T19:01:41.557811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":252,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594550+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:01:41.594550+0000","last_peered":"2024-04-23T19:01:41.594550+0000","last_clean":"2024-04-23T19:01:41.594550+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:01:41.594550+0000","last_undegraded":"2024-04-23T19:01:41.594550+0000","last_fullsized":"2024-04-23T19:01:41.594550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100259+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:01:41.100259+0000","last_peered":"2024-04-23T19:01:41.100259+0000","last_clean":"2024-04-23T19:01:41.100259+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:01:41.100259+0000","last_undegraded":"2024-04-23T19:01:41.100259+0000","last_fullsized":"2024-04-23T19:01:41.100259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"57'8","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098754+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:01:41.098754+0000","last_peered":"2024-04-23T19:01:41.098754+0000","last_clean":"2024-04-23T19:01:41.098754+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:01:41.098754+0000","last_undegraded":"2024-04-23T19:01:41.098754+0000","last_fullsized":"2024-04-23T19:01:41.098754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591638+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:01:41.591638+0000","last_peered":"2024-04-23T19:01:41.591638+0000","last_clean":"2024-04-23T19:01:41.591638+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:01:41.591638+0000","last_undegraded":"2024-04-23T19:01:41.591638+0000","last_fullsized":"2024-04-23T19:01:41.591638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"57'28","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101892+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:01:41.101892+0000","last_peered":"2024-04-23T19:01:41.101892+0000","last_clean":"2024-04-23T19:01:41.101892+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:01:41.101892+0000","last_undegraded":"2024-04-23T19:01:41.101892+0000","last_fullsized":"2024-04-23T19:01:41.101892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382056+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:01:41.382056+0000","last_peered":"2024-04-23T19:01:41.382056+0000","last_clean":"2024-04-23T19:01:41.382056+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:01:41.382056+0000","last_undegraded":"2024-04-23T19:01:41.382056+0000","last_fullsized":"2024-04-23T19:01:41.382056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556108+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:01:41.556108+0000","last_peered":"2024-04-23T19:01:41.556108+0000","last_clean":"2024-04-23T19:01:41.556108+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:01:41.556108+0000","last_undegraded":"2024-04-23T19:01:41.556108+0000","last_fullsized":"2024-04-23T19:01:41.556108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382718+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:01:41.382718+0000","last_peered":"2024-04-23T19:01:41.382718+0000","last_clean":"2024-04-23T19:01:41.382718+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:01:41.382718+0000","last_undegraded":"2024-04-23T19:01:41.382718+0000","last_fullsized":"2024-04-23T19:01:41.382718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594194+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:01:41.594194+0000","last_peered":"2024-04-23T19:01:41.594194+0000","last_clean":"2024-04-23T19:01:41.594194+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:01:41.594194+0000","last_undegraded":"2024-04-23T19:01:41.594194+0000","last_fullsized":"2024-04-23T19:01:41.594194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"57'7","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380940+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:01:41.380940+0000","last_peered":"2024-04-23T19:01:41.380940+0000","last_clean":"2024-04-23T19:01:41.380940+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:01:41.380940+0000","last_undegraded":"2024-04-23T19:01:41.380940+0000","last_fullsized":"2024-04-23T19:01:41.380940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102428+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:01:41.102428+0000","last_peered":"2024-04-23T19:01:41.102428+0000","last_clean":"2024-04-23T19:01:41.102428+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:01:41.102428+0000","last_undegraded":"2024-04-23T19:01:41.102428+0000","last_fullsized":"2024-04-23T19:01:41.102428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"57'98","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589107+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:01:41.589107+0000","last_peered":"2024-04-23T19:01:41.589107+0000","last_clean":"2024-04-23T19:01:41.589107+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:01:41.589107+0000","last_undegraded":"2024-04-23T19:01:41.589107+0000","last_fullsized":"2024-04-23T19:01:41.589107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":132,"num_read_kb":117,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593400+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:01:41.593400+0000","last_peered":"2024-04-23T19:01:41.593400+0000","last_clean":"2024-04-23T19:01:41.593400+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:01:41.593400+0000","last_undegraded":"2024-04-23T19:01:41.593400+0000","last_fullsized":"2024-04-23T19:01:41.593400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589588+0000","last_change":"2024-04-23T19:00:25.337116+0000","last_active":"2024-04-23T19:01:41.589588+0000","last_peered":"2024-04-23T19:01:41.589588+0000","last_clean":"2024-04-23T19:01:41.589588+0000","last_became_active":"2024-04-23T19:00:25.336196+0000","last_became_peered":"2024-04-23T19:00:25.336196+0000","last_unstale":"2024-04-23T19:01:41.589588+0000","last_undegraded":"2024-04-23T19:01:41.589588+0000","last_fullsized":"2024-04-23T19:01:41.589588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:14.525312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"53'6","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591218+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:01:41.591218+0000","last_peered":"2024-04-23T19:01:41.591218+0000","last_clean":"2024-04-23T19:01:41.591218+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:01:41.591218+0000","last_undegraded":"2024-04-23T19:01:41.591218+0000","last_fullsized":"2024-04-23T19:01:41.591218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097834+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:01:41.097834+0000","last_peered":"2024-04-23T19:01:41.097834+0000","last_clean":"2024-04-23T19:01:41.097834+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:01:41.097834+0000","last_undegraded":"2024-04-23T19:01:41.097834+0000","last_fullsized":"2024-04-23T19:01:41.097834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589431+0000","last_change":"2024-04-23T19:00:15.254230+0000","last_active":"2024-04-23T19:01:41.589431+0000","last_peered":"2024-04-23T19:01:41.589431+0000","last_clean":"2024-04-23T19:01:41.589431+0000","last_became_active":"2024-04-23T19:00:15.253857+0000","last_became_peered":"2024-04-23T19:00:15.253857+0000","last_unstale":"2024-04-23T19:01:41.589431+0000","last_undegraded":"2024-04-23T19:01:41.589431+0000","last_fullsized":"2024-04-23T19:01:41.589431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098870+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:01:41.098870+0000","last_peered":"2024-04-23T19:01:41.098870+0000","last_clean":"2024-04-23T19:01:41.098870+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:01:41.098870+0000","last_undegraded":"2024-04-23T19:01:41.098870+0000","last_fullsized":"2024-04-23T19:01:41.098870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'16","reported_seq":116,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593690+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:01:41.593690+0000","last_peered":"2024-04-23T19:01:41.593690+0000","last_clean":"2024-04-23T19:01:41.593690+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:01:41.593690+0000","last_undegraded":"2024-04-23T19:01:41.593690+0000","last_fullsized":"2024-04-23T19:01:41.593690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382081+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:01:41.382081+0000","last_peered":"2024-04-23T19:01:41.382081+0000","last_clean":"2024-04-23T19:01:41.382081+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:01:41.382081+0000","last_undegraded":"2024-04-23T19:01:41.382081+0000","last_fullsized":"2024-04-23T19:01:41.382081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098970+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:01:41.098970+0000","last_peered":"2024-04-23T19:01:41.098970+0000","last_clean":"2024-04-23T19:01:41.098970+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:01:41.098970+0000","last_undegraded":"2024-04-23T19:01:41.098970+0000","last_fullsized":"2024-04-23T19:01:41.098970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590179+0000","last_change":"2024-04-23T19:00:17.298132+0000","last_active":"2024-04-23T19:01:41.590179+0000","last_peered":"2024-04-23T19:01:41.590179+0000","last_clean":"2024-04-23T19:01:41.590179+0000","last_became_active":"2024-04-23T19:00:17.297866+0000","last_became_peered":"2024-04-23T19:00:17.297866+0000","last_unstale":"2024-04-23T19:01:41.590179+0000","last_undegraded":"2024-04-23T19:01:41.590179+0000","last_fullsized":"2024-04-23T19:01:41.590179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100858+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:01:41.100858+0000","last_peered":"2024-04-23T19:01:41.100858+0000","last_clean":"2024-04-23T19:01:41.100858+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:01:41.100858+0000","last_undegraded":"2024-04-23T19:01:41.100858+0000","last_fullsized":"2024-04-23T19:01:41.100858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591513+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:01:41.591513+0000","last_peered":"2024-04-23T19:01:41.591513+0000","last_clean":"2024-04-23T19:01:41.591513+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:01:41.591513+0000","last_undegraded":"2024-04-23T19:01:41.591513+0000","last_fullsized":"2024-04-23T19:01:41.591513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":144,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381772+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:01:41.381772+0000","last_peered":"2024-04-23T19:01:41.381772+0000","last_clean":"2024-04-23T19:01:41.381772+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:01:41.381772+0000","last_undegraded":"2024-04-23T19:01:41.381772+0000","last_fullsized":"2024-04-23T19:01:41.381772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102143+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:01:41.102143+0000","last_peered":"2024-04-23T19:01:41.102143+0000","last_clean":"2024-04-23T19:01:41.102143+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:01:41.102143+0000","last_undegraded":"2024-04-23T19:01:41.102143+0000","last_fullsized":"2024-04-23T19:01:41.102143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558082+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:01:41.558082+0000","last_peered":"2024-04-23T19:01:41.558082+0000","last_clean":"2024-04-23T19:01:41.558082+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:01:41.558082+0000","last_undegraded":"2024-04-23T19:01:41.558082+0000","last_fullsized":"2024-04-23T19:01:41.558082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"57'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098750+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:01:41.098750+0000","last_peered":"2024-04-23T19:01:41.098750+0000","last_clean":"2024-04-23T19:01:41.098750+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:01:41.098750+0000","last_undegraded":"2024-04-23T19:01:41.098750+0000","last_fullsized":"2024-04-23T19:01:41.098750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589934+0000","last_change":"2024-04-23T19:00:17.323700+0000","last_active":"2024-04-23T19:01:41.589934+0000","last_peered":"2024-04-23T19:01:41.589934+0000","last_clean":"2024-04-23T19:01:41.589934+0000","last_became_active":"2024-04-23T19:00:17.323443+0000","last_became_peered":"2024-04-23T19:00:17.323443+0000","last_unstale":"2024-04-23T19:01:41.589934+0000","last_undegraded":"2024-04-23T19:01:41.589934+0000","last_fullsized":"2024-04-23T19:01:41.589934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101581+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:01:41.101581+0000","last_peered":"2024-04-23T19:01:41.101581+0000","last_clean":"2024-04-23T19:01:41.101581+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:01:41.101581+0000","last_undegraded":"2024-04-23T19:01:41.101581+0000","last_fullsized":"2024-04-23T19:01:41.101581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590365+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:01:41.590365+0000","last_peered":"2024-04-23T19:01:41.590365+0000","last_clean":"2024-04-23T19:01:41.590365+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:01:41.590365+0000","last_undegraded":"2024-04-23T19:01:41.590365+0000","last_fullsized":"2024-04-23T19:01:41.590365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381866+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:01:41.381866+0000","last_peered":"2024-04-23T19:01:41.381866+0000","last_clean":"2024-04-23T19:01:41.381866+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:01:41.381866+0000","last_undegraded":"2024-04-23T19:01:41.381866+0000","last_fullsized":"2024-04-23T19:01:41.381866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"57'28","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380303+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:01:41.380303+0000","last_peered":"2024-04-23T19:01:41.380303+0000","last_clean":"2024-04-23T19:01:41.380303+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:01:41.380303+0000","last_undegraded":"2024-04-23T19:01:41.380303+0000","last_fullsized":"2024-04-23T19:01:41.380303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590762+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:01:41.590762+0000","last_peered":"2024-04-23T19:01:41.590762+0000","last_clean":"2024-04-23T19:01:41.590762+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:01:41.590762+0000","last_undegraded":"2024-04-23T19:01:41.590762+0000","last_fullsized":"2024-04-23T19:01:41.590762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":78,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381846+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:01:41.381846+0000","last_peered":"2024-04-23T19:01:41.381846+0000","last_clean":"2024-04-23T19:01:41.381846+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:01:41.381846+0000","last_undegraded":"2024-04-23T19:01:41.381846+0000","last_fullsized":"2024-04-23T19:01:41.381846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382286+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:01:41.382286+0000","last_peered":"2024-04-23T19:01:41.382286+0000","last_clean":"2024-04-23T19:01:41.382286+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:01:41.382286+0000","last_undegraded":"2024-04-23T19:01:41.382286+0000","last_fullsized":"2024-04-23T19:01:41.382286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"56'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590290+0000","last_change":"2024-04-23T19:00:15.252825+0000","last_active":"2024-04-23T19:01:41.590290+0000","last_peered":"2024-04-23T19:01:41.590290+0000","last_clean":"2024-04-23T19:01:41.590290+0000","last_became_active":"2024-04-23T19:00:15.247413+0000","last_became_peered":"2024-04-23T19:00:15.247413+0000","last_unstale":"2024-04-23T19:01:41.590290+0000","last_undegraded":"2024-04-23T19:01:41.590290+0000","last_fullsized":"2024-04-23T19:01:41.590290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594379+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:01:41.594379+0000","last_peered":"2024-04-23T19:01:41.594379+0000","last_clean":"2024-04-23T19:01:41.594379+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:01:41.594379+0000","last_undegraded":"2024-04-23T19:01:41.594379+0000","last_fullsized":"2024-04-23T19:01:41.594379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556860+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:01:41.556860+0000","last_peered":"2024-04-23T19:01:41.556860+0000","last_clean":"2024-04-23T19:01:41.556860+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:01:41.556860+0000","last_undegraded":"2024-04-23T19:01:41.556860+0000","last_fullsized":"2024-04-23T19:01:41.556860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589385+0000","last_change":"2024-04-23T19:00:21.313162+0000","last_active":"2024-04-23T19:01:41.589385+0000","last_peered":"2024-04-23T19:01:41.589385+0000","last_clean":"2024-04-23T19:01:41.589385+0000","last_became_active":"2024-04-23T19:00:21.312313+0000","last_became_peered":"2024-04-23T19:00:21.312313+0000","last_unstale":"2024-04-23T19:01:41.589385+0000","last_undegraded":"2024-04-23T19:01:41.589385+0000","last_fullsized":"2024-04-23T19:01:41.589385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:05.309099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099454+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:01:41.099454+0000","last_peered":"2024-04-23T19:01:41.099454+0000","last_clean":"2024-04-23T19:01:41.099454+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:01:41.099454+0000","last_undegraded":"2024-04-23T19:01:41.099454+0000","last_fullsized":"2024-04-23T19:01:41.099454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102414+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:01:41.102414+0000","last_peered":"2024-04-23T19:01:41.102414+0000","last_clean":"2024-04-23T19:01:41.102414+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:01:41.102414+0000","last_undegraded":"2024-04-23T19:01:41.102414+0000","last_fullsized":"2024-04-23T19:01:41.102414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103234+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:01:41.103234+0000","last_peered":"2024-04-23T19:01:41.103234+0000","last_clean":"2024-04-23T19:01:41.103234+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:01:41.103234+0000","last_undegraded":"2024-04-23T19:01:41.103234+0000","last_fullsized":"2024-04-23T19:01:41.103234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102040+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:01:41.102040+0000","last_peered":"2024-04-23T19:01:41.102040+0000","last_clean":"2024-04-23T19:01:41.102040+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:01:41.102040+0000","last_undegraded":"2024-04-23T19:01:41.102040+0000","last_fullsized":"2024-04-23T19:01:41.102040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591076+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:01:41.591076+0000","last_peered":"2024-04-23T19:01:41.591076+0000","last_clean":"2024-04-23T19:01:41.591076+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:01:41.591076+0000","last_undegraded":"2024-04-23T19:01:41.591076+0000","last_fullsized":"2024-04-23T19:01:41.591076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591330+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:01:41.591330+0000","last_peered":"2024-04-23T19:01:41.591330+0000","last_clean":"2024-04-23T19:01:41.591330+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:01:41.591330+0000","last_undegraded":"2024-04-23T19:01:41.591330+0000","last_fullsized":"2024-04-23T19:01:41.591330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591751+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:01:41.591751+0000","last_peered":"2024-04-23T19:01:41.591751+0000","last_clean":"2024-04-23T19:01:41.591751+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:01:41.591751+0000","last_undegraded":"2024-04-23T19:01:41.591751+0000","last_fullsized":"2024-04-23T19:01:41.591751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"57'92","reported_seq":260,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099533+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:01:41.099533+0000","last_peered":"2024-04-23T19:01:41.099533+0000","last_clean":"2024-04-23T19:01:41.099533+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:01:41.099533+0000","last_undegraded":"2024-04-23T19:01:41.099533+0000","last_fullsized":"2024-04-23T19:01:41.099533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381888+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:01:41.381888+0000","last_peered":"2024-04-23T19:01:41.381888+0000","last_clean":"2024-04-23T19:01:41.381888+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:01:41.381888+0000","last_undegraded":"2024-04-23T19:01:41.381888+0000","last_fullsized":"2024-04-23T19:01:41.381888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591787+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:01:41.591787+0000","last_peered":"2024-04-23T19:01:41.591787+0000","last_clean":"2024-04-23T19:01:41.591787+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:01:41.591787+0000","last_undegraded":"2024-04-23T19:01:41.591787+0000","last_fullsized":"2024-04-23T19:01:41.591787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382849+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:01:41.382849+0000","last_peered":"2024-04-23T19:01:41.382849+0000","last_clean":"2024-04-23T19:01:41.382849+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:01:41.382849+0000","last_undegraded":"2024-04-23T19:01:41.382849+0000","last_fullsized":"2024-04-23T19:01:41.382849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558658+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:01:41.558658+0000","last_peered":"2024-04-23T19:01:41.558658+0000","last_clean":"2024-04-23T19:01:41.558658+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:01:41.558658+0000","last_undegraded":"2024-04-23T19:01:41.558658+0000","last_fullsized":"2024-04-23T19:01:41.558658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103173+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:01:41.103173+0000","last_peered":"2024-04-23T19:01:41.103173+0000","last_clean":"2024-04-23T19:01:41.103173+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:01:41.103173+0000","last_undegraded":"2024-04-23T19:01:41.103173+0000","last_fullsized":"2024-04-23T19:01:41.103173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"57'34","reported_seq":129,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590999+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:01:41.590999+0000","last_peered":"2024-04-23T19:01:41.590999+0000","last_clean":"2024-04-23T19:01:41.590999+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:01:41.590999+0000","last_undegraded":"2024-04-23T19:01:41.590999+0000","last_fullsized":"2024-04-23T19:01:41.590999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098427+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:01:41.098427+0000","last_peered":"2024-04-23T19:01:41.098427+0000","last_clean":"2024-04-23T19:01:41.098427+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:01:41.098427+0000","last_undegraded":"2024-04-23T19:01:41.098427+0000","last_fullsized":"2024-04-23T19:01:41.098427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099964+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:01:41.099964+0000","last_peered":"2024-04-23T19:01:41.099964+0000","last_clean":"2024-04-23T19:01:41.099964+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:01:41.099964+0000","last_undegraded":"2024-04-23T19:01:41.099964+0000","last_fullsized":"2024-04-23T19:01:41.099964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382107+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:01:41.382107+0000","last_peered":"2024-04-23T19:01:41.382107+0000","last_clean":"2024-04-23T19:01:41.382107+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:01:41.382107+0000","last_undegraded":"2024-04-23T19:01:41.382107+0000","last_fullsized":"2024-04-23T19:01:41.382107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590918+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:01:41.590918+0000","last_peered":"2024-04-23T19:01:41.590918+0000","last_clean":"2024-04-23T19:01:41.590918+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:01:41.590918+0000","last_undegraded":"2024-04-23T19:01:41.590918+0000","last_fullsized":"2024-04-23T19:01:41.590918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592966+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:01:41.592966+0000","last_peered":"2024-04-23T19:01:41.592966+0000","last_clean":"2024-04-23T19:01:41.592966+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:01:41.592966+0000","last_undegraded":"2024-04-23T19:01:41.592966+0000","last_fullsized":"2024-04-23T19:01:41.592966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589993+0000","last_change":"2024-04-23T19:00:19.302914+0000","last_active":"2024-04-23T19:01:41.589993+0000","last_peered":"2024-04-23T19:01:41.589993+0000","last_clean":"2024-04-23T19:01:41.589993+0000","last_became_active":"2024-04-23T19:00:19.302271+0000","last_became_peered":"2024-04-23T19:00:19.302271+0000","last_unstale":"2024-04-23T19:01:41.589993+0000","last_undegraded":"2024-04-23T19:01:41.589993+0000","last_fullsized":"2024-04-23T19:01:41.589993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:39.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"57'16","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097881+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:01:41.097881+0000","last_peered":"2024-04-23T19:01:41.097881+0000","last_clean":"2024-04-23T19:01:41.097881+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:01:41.097881+0000","last_undegraded":"2024-04-23T19:01:41.097881+0000","last_fullsized":"2024-04-23T19:01:41.097881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103110+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:01:41.103110+0000","last_peered":"2024-04-23T19:01:41.103110+0000","last_clean":"2024-04-23T19:01:41.103110+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:01:41.103110+0000","last_undegraded":"2024-04-23T19:01:41.103110+0000","last_fullsized":"2024-04-23T19:01:41.103110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102041+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:01:41.102041+0000","last_peered":"2024-04-23T19:01:41.102041+0000","last_clean":"2024-04-23T19:01:41.102041+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:01:41.102041+0000","last_undegraded":"2024-04-23T19:01:41.102041+0000","last_fullsized":"2024-04-23T19:01:41.102041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589765+0000","last_change":"2024-04-23T19:00:17.321501+0000","last_active":"2024-04-23T19:01:41.589765+0000","last_peered":"2024-04-23T19:01:41.589765+0000","last_clean":"2024-04-23T19:01:41.589765+0000","last_became_active":"2024-04-23T19:00:17.321203+0000","last_became_peered":"2024-04-23T19:00:17.321203+0000","last_unstale":"2024-04-23T19:01:41.589765+0000","last_undegraded":"2024-04-23T19:01:41.589765+0000","last_fullsized":"2024-04-23T19:01:41.589765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"57'6","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593987+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:01:41.593987+0000","last_peered":"2024-04-23T19:01:41.593987+0000","last_clean":"2024-04-23T19:01:41.593987+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:01:41.593987+0000","last_undegraded":"2024-04-23T19:01:41.593987+0000","last_fullsized":"2024-04-23T19:01:41.593987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098895+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:01:41.098895+0000","last_peered":"2024-04-23T19:01:41.098895+0000","last_clean":"2024-04-23T19:01:41.098895+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:01:41.098895+0000","last_undegraded":"2024-04-23T19:01:41.098895+0000","last_fullsized":"2024-04-23T19:01:41.098895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"54'6","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380316+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:01:41.380316+0000","last_peered":"2024-04-23T19:01:41.380316+0000","last_clean":"2024-04-23T19:01:41.380316+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:01:41.380316+0000","last_undegraded":"2024-04-23T19:01:41.380316+0000","last_fullsized":"2024-04-23T19:01:41.380316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591660+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:01:41.591660+0000","last_peered":"2024-04-23T19:01:41.591660+0000","last_clean":"2024-04-23T19:01:41.591660+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:01:41.591660+0000","last_undegraded":"2024-04-23T19:01:41.591660+0000","last_fullsized":"2024-04-23T19:01:41.591660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381839+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:01:41.381839+0000","last_peered":"2024-04-23T19:01:41.381839+0000","last_clean":"2024-04-23T19:01:41.381839+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:01:41.381839+0000","last_undegraded":"2024-04-23T19:01:41.381839+0000","last_fullsized":"2024-04-23T19:01:41.381839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098263+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:01:41.098263+0000","last_peered":"2024-04-23T19:01:41.098263+0000","last_clean":"2024-04-23T19:01:41.098263+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:01:41.098263+0000","last_undegraded":"2024-04-23T19:01:41.098263+0000","last_fullsized":"2024-04-23T19:01:41.098263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102461+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:01:41.102461+0000","last_peered":"2024-04-23T19:01:41.102461+0000","last_clean":"2024-04-23T19:01:41.102461+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:01:41.102461+0000","last_undegraded":"2024-04-23T19:01:41.102461+0000","last_fullsized":"2024-04-23T19:01:41.102461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593186+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:01:41.593186+0000","last_peered":"2024-04-23T19:01:41.593186+0000","last_clean":"2024-04-23T19:01:41.593186+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:01:41.593186+0000","last_undegraded":"2024-04-23T19:01:41.593186+0000","last_fullsized":"2024-04-23T19:01:41.593186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"57'18","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098724+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:01:41.098724+0000","last_peered":"2024-04-23T19:01:41.098724+0000","last_clean":"2024-04-23T19:01:41.098724+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:01:41.098724+0000","last_undegraded":"2024-04-23T19:01:41.098724+0000","last_fullsized":"2024-04-23T19:01:41.098724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556841+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:01:41.556841+0000","last_peered":"2024-04-23T19:01:41.556841+0000","last_clean":"2024-04-23T19:01:41.556841+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:01:41.556841+0000","last_undegraded":"2024-04-23T19:01:41.556841+0000","last_fullsized":"2024-04-23T19:01:41.556841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099429+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:01:41.099429+0000","last_peered":"2024-04-23T19:01:41.099429+0000","last_clean":"2024-04-23T19:01:41.099429+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:01:41.099429+0000","last_undegraded":"2024-04-23T19:01:41.099429+0000","last_fullsized":"2024-04-23T19:01:41.099429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103298+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:01:41.103298+0000","last_peered":"2024-04-23T19:01:41.103298+0000","last_clean":"2024-04-23T19:01:41.103298+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:01:41.103298+0000","last_undegraded":"2024-04-23T19:01:41.103298+0000","last_fullsized":"2024-04-23T19:01:41.103298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382414+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:01:41.382414+0000","last_peered":"2024-04-23T19:01:41.382414+0000","last_clean":"2024-04-23T19:01:41.382414+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:01:41.382414+0000","last_undegraded":"2024-04-23T19:01:41.382414+0000","last_fullsized":"2024-04-23T19:01:41.382414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556754+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:01:41.556754+0000","last_peered":"2024-04-23T19:01:41.556754+0000","last_clean":"2024-04-23T19:01:41.556754+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:01:41.556754+0000","last_undegraded":"2024-04-23T19:01:41.556754+0000","last_fullsized":"2024-04-23T19:01:41.556754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"57'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591496+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:01:41.591496+0000","last_peered":"2024-04-23T19:01:41.591496+0000","last_clean":"2024-04-23T19:01:41.591496+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:01:41.591496+0000","last_undegraded":"2024-04-23T19:01:41.591496+0000","last_fullsized":"2024-04-23T19:01:41.591496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381678+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:01:41.381678+0000","last_peered":"2024-04-23T19:01:41.381678+0000","last_clean":"2024-04-23T19:01:41.381678+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:01:41.381678+0000","last_undegraded":"2024-04-23T19:01:41.381678+0000","last_fullsized":"2024-04-23T19:01:41.381678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558429+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:01:41.558429+0000","last_peered":"2024-04-23T19:01:41.558429+0000","last_clean":"2024-04-23T19:01:41.558429+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:01:41.558429+0000","last_undegraded":"2024-04-23T19:01:41.558429+0000","last_fullsized":"2024-04-23T19:01:41.558429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"57'6","reported_seq":120,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.103357+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:01:41.103357+0000","last_peered":"2024-04-23T19:01:41.103357+0000","last_clean":"2024-04-23T19:01:41.103357+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:01:41.103357+0000","last_undegraded":"2024-04-23T19:01:41.103357+0000","last_fullsized":"2024-04-23T19:01:41.103357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382572+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:01:41.382572+0000","last_peered":"2024-04-23T19:01:41.382572+0000","last_clean":"2024-04-23T19:01:41.382572+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:01:41.382572+0000","last_undegraded":"2024-04-23T19:01:41.382572+0000","last_fullsized":"2024-04-23T19:01:41.382572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"57'22","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589173+0000","last_change":"2024-04-23T19:00:21.317917+0000","last_active":"2024-04-23T19:01:41.589173+0000","last_peered":"2024-04-23T19:01:41.589173+0000","last_clean":"2024-04-23T19:01:41.589173+0000","last_became_active":"2024-04-23T19:00:21.317050+0000","last_became_peered":"2024-04-23T19:00:21.317050+0000","last_unstale":"2024-04-23T19:01:41.589173+0000","last_undegraded":"2024-04-23T19:01:41.589173+0000","last_fullsized":"2024-04-23T19:01:41.589173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:14.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100254+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:01:41.100254+0000","last_peered":"2024-04-23T19:01:41.100254+0000","last_clean":"2024-04-23T19:01:41.100254+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:01:41.100254+0000","last_undegraded":"2024-04-23T19:01:41.100254+0000","last_fullsized":"2024-04-23T19:01:41.100254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098535+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:01:41.098535+0000","last_peered":"2024-04-23T19:01:41.098535+0000","last_clean":"2024-04-23T19:01:41.098535+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:01:41.098535+0000","last_undegraded":"2024-04-23T19:01:41.098535+0000","last_fullsized":"2024-04-23T19:01:41.098535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382661+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:01:41.382661+0000","last_peered":"2024-04-23T19:01:41.382661+0000","last_clean":"2024-04-23T19:01:41.382661+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:01:41.382661+0000","last_undegraded":"2024-04-23T19:01:41.382661+0000","last_fullsized":"2024-04-23T19:01:41.382661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589957+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:01:41.589957+0000","last_peered":"2024-04-23T19:01:41.589957+0000","last_clean":"2024-04-23T19:01:41.589957+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:01:41.589957+0000","last_undegraded":"2024-04-23T19:01:41.589957+0000","last_fullsized":"2024-04-23T19:01:41.589957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558196+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:01:41.558196+0000","last_peered":"2024-04-23T19:01:41.558196+0000","last_clean":"2024-04-23T19:01:41.558196+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:01:41.558196+0000","last_undegraded":"2024-04-23T19:01:41.558196+0000","last_fullsized":"2024-04-23T19:01:41.558196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"57'21","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590245+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:01:41.590245+0000","last_peered":"2024-04-23T19:01:41.590245+0000","last_clean":"2024-04-23T19:01:41.590245+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:01:41.590245+0000","last_undegraded":"2024-04-23T19:01:41.590245+0000","last_fullsized":"2024-04-23T19:01:41.590245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590557+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:01:41.590557+0000","last_peered":"2024-04-23T19:01:41.590557+0000","last_clean":"2024-04-23T19:01:41.590557+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:01:41.590557+0000","last_undegraded":"2024-04-23T19:01:41.590557+0000","last_fullsized":"2024-04-23T19:01:41.590557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556570+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:01:41.556570+0000","last_peered":"2024-04-23T19:01:41.556570+0000","last_clean":"2024-04-23T19:01:41.556570+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:01:41.556570+0000","last_undegraded":"2024-04-23T19:01:41.556570+0000","last_fullsized":"2024-04-23T19:01:41.556570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.101901+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:01:41.101901+0000","last_peered":"2024-04-23T19:01:41.101901+0000","last_clean":"2024-04-23T19:01:41.101901+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:01:41.101901+0000","last_undegraded":"2024-04-23T19:01:41.101901+0000","last_fullsized":"2024-04-23T19:01:41.101901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"57'8","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592760+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:01:41.592760+0000","last_peered":"2024-04-23T19:01:41.592760+0000","last_clean":"2024-04-23T19:01:41.592760+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:01:41.592760+0000","last_undegraded":"2024-04-23T19:01:41.592760+0000","last_fullsized":"2024-04-23T19:01:41.592760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594243+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:01:41.594243+0000","last_peered":"2024-04-23T19:01:41.594243+0000","last_clean":"2024-04-23T19:01:41.594243+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:01:41.594243+0000","last_undegraded":"2024-04-23T19:01:41.594243+0000","last_fullsized":"2024-04-23T19:01:41.594243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"57'17","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102646+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:01:41.102646+0000","last_peered":"2024-04-23T19:01:41.102646+0000","last_clean":"2024-04-23T19:01:41.102646+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:01:41.102646+0000","last_undegraded":"2024-04-23T19:01:41.102646+0000","last_fullsized":"2024-04-23T19:01:41.102646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590634+0000","last_change":"2024-04-23T19:00:23.344133+0000","last_active":"2024-04-23T19:01:41.590634+0000","last_peered":"2024-04-23T19:01:41.590634+0000","last_clean":"2024-04-23T19:01:41.590634+0000","last_became_active":"2024-04-23T19:00:23.343020+0000","last_became_peered":"2024-04-23T19:00:23.343020+0000","last_unstale":"2024-04-23T19:01:41.590634+0000","last_undegraded":"2024-04-23T19:01:41.590634+0000","last_fullsized":"2024-04-23T19:01:41.590634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:16.330420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"52'5","reported_seq":77,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099123+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:01:41.099123+0000","last_peered":"2024-04-23T19:01:41.099123+0000","last_clean":"2024-04-23T19:01:41.099123+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:01:41.099123+0000","last_undegraded":"2024-04-23T19:01:41.099123+0000","last_fullsized":"2024-04-23T19:01:41.099123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100618+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:01:41.100618+0000","last_peered":"2024-04-23T19:01:41.100618+0000","last_clean":"2024-04-23T19:01:41.100618+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:01:41.100618+0000","last_undegraded":"2024-04-23T19:01:41.100618+0000","last_fullsized":"2024-04-23T19:01:41.100618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"57'4","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381583+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:01:41.381583+0000","last_peered":"2024-04-23T19:01:41.381583+0000","last_clean":"2024-04-23T19:01:41.381583+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:01:41.381583+0000","last_undegraded":"2024-04-23T19:01:41.381583+0000","last_fullsized":"2024-04-23T19:01:41.381583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590821+0000","last_change":"2024-04-23T19:00:19.306559+0000","last_active":"2024-04-23T19:01:41.590821+0000","last_peered":"2024-04-23T19:01:41.590821+0000","last_clean":"2024-04-23T19:01:41.590821+0000","last_became_active":"2024-04-23T19:00:19.305854+0000","last_became_peered":"2024-04-23T19:00:19.305854+0000","last_unstale":"2024-04-23T19:01:41.590821+0000","last_undegraded":"2024-04-23T19:01:41.590821+0000","last_fullsized":"2024-04-23T19:01:41.590821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593911+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:01:41.593911+0000","last_peered":"2024-04-23T19:01:41.593911+0000","last_clean":"2024-04-23T19:01:41.593911+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:01:41.593911+0000","last_undegraded":"2024-04-23T19:01:41.593911+0000","last_fullsized":"2024-04-23T19:01:41.593911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"57'92","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557859+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:01:41.557859+0000","last_peered":"2024-04-23T19:01:41.557859+0000","last_clean":"2024-04-23T19:01:41.557859+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:01:41.557859+0000","last_undegraded":"2024-04-23T19:01:41.557859+0000","last_fullsized":"2024-04-23T19:01:41.557859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592937+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:01:41.592937+0000","last_peered":"2024-04-23T19:01:41.592937+0000","last_clean":"2024-04-23T19:01:41.592937+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:01:41.592937+0000","last_undegraded":"2024-04-23T19:01:41.592937+0000","last_fullsized":"2024-04-23T19:01:41.592937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590865+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:01:41.590865+0000","last_peered":"2024-04-23T19:01:41.590865+0000","last_clean":"2024-04-23T19:01:41.590865+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:01:41.590865+0000","last_undegraded":"2024-04-23T19:01:41.590865+0000","last_fullsized":"2024-04-23T19:01:41.590865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100698+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:01:41.100698+0000","last_peered":"2024-04-23T19:01:41.100698+0000","last_clean":"2024-04-23T19:01:41.100698+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:01:41.100698+0000","last_undegraded":"2024-04-23T19:01:41.100698+0000","last_fullsized":"2024-04-23T19:01:41.100698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592008+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:01:41.592008+0000","last_peered":"2024-04-23T19:01:41.592008+0000","last_clean":"2024-04-23T19:01:41.592008+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:01:41.592008+0000","last_undegraded":"2024-04-23T19:01:41.592008+0000","last_fullsized":"2024-04-23T19:01:41.592008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"57'20","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099429+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:01:41.099429+0000","last_peered":"2024-04-23T19:01:41.099429+0000","last_clean":"2024-04-23T19:01:41.099429+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:01:41.099429+0000","last_undegraded":"2024-04-23T19:01:41.099429+0000","last_fullsized":"2024-04-23T19:01:41.099429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380705+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:01:41.380705+0000","last_peered":"2024-04-23T19:01:41.380705+0000","last_clean":"2024-04-23T19:01:41.380705+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:01:41.380705+0000","last_undegraded":"2024-04-23T19:01:41.380705+0000","last_fullsized":"2024-04-23T19:01:41.380705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":76,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594712+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:01:41.594712+0000","last_peered":"2024-04-23T19:01:41.594712+0000","last_clean":"2024-04-23T19:01:41.594712+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:01:41.594712+0000","last_undegraded":"2024-04-23T19:01:41.594712+0000","last_fullsized":"2024-04-23T19:01:41.594712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"57'6","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592066+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:01:41.592066+0000","last_peered":"2024-04-23T19:01:41.592066+0000","last_clean":"2024-04-23T19:01:41.592066+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:01:41.592066+0000","last_undegraded":"2024-04-23T19:01:41.592066+0000","last_fullsized":"2024-04-23T19:01:41.592066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"57'3","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098371+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:01:41.098371+0000","last_peered":"2024-04-23T19:01:41.098371+0000","last_clean":"2024-04-23T19:01:41.098371+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:01:41.098371+0000","last_undegraded":"2024-04-23T19:01:41.098371+0000","last_fullsized":"2024-04-23T19:01:41.098371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099801+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:01:41.099801+0000","last_peered":"2024-04-23T19:01:41.099801+0000","last_clean":"2024-04-23T19:01:41.099801+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:01:41.099801+0000","last_undegraded":"2024-04-23T19:01:41.099801+0000","last_fullsized":"2024-04-23T19:01:41.099801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"57'14","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.380827+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:01:41.380827+0000","last_peered":"2024-04-23T19:01:41.380827+0000","last_clean":"2024-04-23T19:01:41.380827+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:01:41.380827+0000","last_undegraded":"2024-04-23T19:01:41.380827+0000","last_fullsized":"2024-04-23T19:01:41.380827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556356+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:01:41.556356+0000","last_peered":"2024-04-23T19:01:41.556356+0000","last_clean":"2024-04-23T19:01:41.556356+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:01:41.556356+0000","last_undegraded":"2024-04-23T19:01:41.556356+0000","last_fullsized":"2024-04-23T19:01:41.556356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102038+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:01:41.102038+0000","last_peered":"2024-04-23T19:01:41.102038+0000","last_clean":"2024-04-23T19:01:41.102038+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:01:41.102038+0000","last_undegraded":"2024-04-23T19:01:41.102038+0000","last_fullsized":"2024-04-23T19:01:41.102038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":128,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098417+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:01:41.098417+0000","last_peered":"2024-04-23T19:01:41.098417+0000","last_clean":"2024-04-23T19:01:41.098417+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:01:41.098417+0000","last_undegraded":"2024-04-23T19:01:41.098417+0000","last_fullsized":"2024-04-23T19:01:41.098417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"57'3","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102224+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:01:41.102224+0000","last_peered":"2024-04-23T19:01:41.102224+0000","last_clean":"2024-04-23T19:01:41.102224+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:01:41.102224+0000","last_undegraded":"2024-04-23T19:01:41.102224+0000","last_fullsized":"2024-04-23T19:01:41.102224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590215+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:01:41.590215+0000","last_peered":"2024-04-23T19:01:41.590215+0000","last_clean":"2024-04-23T19:01:41.590215+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:01:41.590215+0000","last_undegraded":"2024-04-23T19:01:41.590215+0000","last_fullsized":"2024-04-23T19:01:41.590215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"57'11","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099344+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:01:41.099344+0000","last_peered":"2024-04-23T19:01:41.099344+0000","last_clean":"2024-04-23T19:01:41.099344+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:01:41.099344+0000","last_undegraded":"2024-04-23T19:01:41.099344+0000","last_fullsized":"2024-04-23T19:01:41.099344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590286+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:01:41.590286+0000","last_peered":"2024-04-23T19:01:41.590286+0000","last_clean":"2024-04-23T19:01:41.590286+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:01:41.590286+0000","last_undegraded":"2024-04-23T19:01:41.590286+0000","last_fullsized":"2024-04-23T19:01:41.590286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593625+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:01:41.593625+0000","last_peered":"2024-04-23T19:01:41.593625+0000","last_clean":"2024-04-23T19:01:41.593625+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:01:41.593625+0000","last_undegraded":"2024-04-23T19:01:41.593625+0000","last_fullsized":"2024-04-23T19:01:41.593625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590468+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:01:41.590468+0000","last_peered":"2024-04-23T19:01:41.590468+0000","last_clean":"2024-04-23T19:01:41.590468+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:01:41.590468+0000","last_undegraded":"2024-04-23T19:01:41.590468+0000","last_fullsized":"2024-04-23T19:01:41.590468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"56'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382014+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:01:41.382014+0000","last_peered":"2024-04-23T19:01:41.382014+0000","last_clean":"2024-04-23T19:01:41.382014+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:01:41.382014+0000","last_undegraded":"2024-04-23T19:01:41.382014+0000","last_fullsized":"2024-04-23T19:01:41.382014+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589391+0000","last_change":"2024-04-23T19:00:19.302840+0000","last_active":"2024-04-23T19:01:41.589391+0000","last_peered":"2024-04-23T19:01:41.589391+0000","last_clean":"2024-04-23T19:01:41.589391+0000","last_became_active":"2024-04-23T19:00:19.302069+0000","last_became_peered":"2024-04-23T19:00:19.302069+0000","last_unstale":"2024-04-23T19:01:41.589391+0000","last_undegraded":"2024-04-23T19:01:41.589391+0000","last_fullsized":"2024-04-23T19:01:41.589391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:15.157506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"57'15","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589858+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:01:41.589858+0000","last_peered":"2024-04-23T19:01:41.589858+0000","last_clean":"2024-04-23T19:01:41.589858+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:01:41.589858+0000","last_undegraded":"2024-04-23T19:01:41.589858+0000","last_fullsized":"2024-04-23T19:01:41.589858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381586+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:01:41.381586+0000","last_peered":"2024-04-23T19:01:41.381586+0000","last_clean":"2024-04-23T19:01:41.381586+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:01:41.381586+0000","last_undegraded":"2024-04-23T19:01:41.381586+0000","last_fullsized":"2024-04-23T19:01:41.381586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592526+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:01:41.592526+0000","last_peered":"2024-04-23T19:01:41.592526+0000","last_clean":"2024-04-23T19:01:41.592526+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:01:41.592526+0000","last_undegraded":"2024-04-23T19:01:41.592526+0000","last_fullsized":"2024-04-23T19:01:41.592526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591129+0000","last_change":"2024-04-23T19:00:17.315323+0000","last_active":"2024-04-23T19:01:41.591129+0000","last_peered":"2024-04-23T19:01:41.591129+0000","last_clean":"2024-04-23T19:01:41.591129+0000","last_became_active":"2024-04-23T19:00:17.315077+0000","last_became_peered":"2024-04-23T19:00:17.315077+0000","last_unstale":"2024-04-23T19:01:41.591129+0000","last_undegraded":"2024-04-23T19:01:41.591129+0000","last_fullsized":"2024-04-23T19:01:41.591129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"57'3","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556307+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:01:41.556307+0000","last_peered":"2024-04-23T19:01:41.556307+0000","last_clean":"2024-04-23T19:01:41.556307+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:01:41.556307+0000","last_undegraded":"2024-04-23T19:01:41.556307+0000","last_fullsized":"2024-04-23T19:01:41.556307+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590845+0000","last_change":"2024-04-23T19:00:17.297003+0000","last_active":"2024-04-23T19:01:41.590845+0000","last_peered":"2024-04-23T19:01:41.590845+0000","last_clean":"2024-04-23T19:01:41.590845+0000","last_became_active":"2024-04-23T19:00:17.295108+0000","last_became_peered":"2024-04-23T19:00:17.295108+0000","last_unstale":"2024-04-23T19:01:41.590845+0000","last_undegraded":"2024-04-23T19:01:41.590845+0000","last_fullsized":"2024-04-23T19:01:41.590845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097670+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:01:41.097670+0000","last_peered":"2024-04-23T19:01:41.097670+0000","last_clean":"2024-04-23T19:01:41.097670+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:01:41.097670+0000","last_undegraded":"2024-04-23T19:01:41.097670+0000","last_fullsized":"2024-04-23T19:01:41.097670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100977+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:01:41.100977+0000","last_peered":"2024-04-23T19:01:41.100977+0000","last_clean":"2024-04-23T19:01:41.100977+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:01:41.100977+0000","last_undegraded":"2024-04-23T19:01:41.100977+0000","last_fullsized":"2024-04-23T19:01:41.100977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100611+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:01:41.100611+0000","last_peered":"2024-04-23T19:01:41.100611+0000","last_clean":"2024-04-23T19:01:41.100611+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:01:41.100611+0000","last_undegraded":"2024-04-23T19:01:41.100611+0000","last_fullsized":"2024-04-23T19:01:41.100611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.590296+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:01:41.590296+0000","last_peered":"2024-04-23T19:01:41.590296+0000","last_clean":"2024-04-23T19:01:41.590296+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:01:41.590296+0000","last_undegraded":"2024-04-23T19:01:41.590296+0000","last_fullsized":"2024-04-23T19:01:41.590296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"57'5","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381534+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:01:41.381534+0000","last_peered":"2024-04-23T19:01:41.381534+0000","last_clean":"2024-04-23T19:01:41.381534+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:01:41.381534+0000","last_undegraded":"2024-04-23T19:01:41.381534+0000","last_fullsized":"2024-04-23T19:01:41.381534+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":124,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099112+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:01:41.099112+0000","last_peered":"2024-04-23T19:01:41.099112+0000","last_clean":"2024-04-23T19:01:41.099112+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:01:41.099112+0000","last_undegraded":"2024-04-23T19:01:41.099112+0000","last_fullsized":"2024-04-23T19:01:41.099112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"57'7","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100319+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:01:41.100319+0000","last_peered":"2024-04-23T19:01:41.100319+0000","last_clean":"2024-04-23T19:01:41.100319+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:01:41.100319+0000","last_undegraded":"2024-04-23T19:01:41.100319+0000","last_fullsized":"2024-04-23T19:01:41.100319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.592490+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:01:41.592490+0000","last_peered":"2024-04-23T19:01:41.592490+0000","last_clean":"2024-04-23T19:01:41.592490+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:01:41.592490+0000","last_undegraded":"2024-04-23T19:01:41.592490+0000","last_fullsized":"2024-04-23T19:01:41.592490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"57'9","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591035+0000","last_change":"2024-04-23T19:00:15.251155+0000","last_active":"2024-04-23T19:01:41.591035+0000","last_peered":"2024-04-23T19:01:41.591035+0000","last_clean":"2024-04-23T19:01:41.591035+0000","last_became_active":"2024-04-23T19:00:15.250798+0000","last_became_peered":"2024-04-23T19:00:15.250798+0000","last_unstale":"2024-04-23T19:01:41.591035+0000","last_undegraded":"2024-04-23T19:01:41.591035+0000","last_fullsized":"2024-04-23T19:01:41.591035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098175+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:01:41.098175+0000","last_peered":"2024-04-23T19:01:41.098175+0000","last_clean":"2024-04-23T19:01:41.098175+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:01:41.098175+0000","last_undegraded":"2024-04-23T19:01:41.098175+0000","last_fullsized":"2024-04-23T19:01:41.098175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.558157+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:01:41.558157+0000","last_peered":"2024-04-23T19:01:41.558157+0000","last_clean":"2024-04-23T19:01:41.558157+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:01:41.558157+0000","last_undegraded":"2024-04-23T19:01:41.558157+0000","last_fullsized":"2024-04-23T19:01:41.558157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.556157+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:01:41.556157+0000","last_peered":"2024-04-23T19:01:41.556157+0000","last_clean":"2024-04-23T19:01:41.556157+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:01:41.556157+0000","last_undegraded":"2024-04-23T19:01:41.556157+0000","last_fullsized":"2024-04-23T19:01:41.556157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102312+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:01:41.102312+0000","last_peered":"2024-04-23T19:01:41.102312+0000","last_clean":"2024-04-23T19:01:41.102312+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:01:41.102312+0000","last_undegraded":"2024-04-23T19:01:41.102312+0000","last_fullsized":"2024-04-23T19:01:41.102312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382321+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:01:41.382321+0000","last_peered":"2024-04-23T19:01:41.382321+0000","last_clean":"2024-04-23T19:01:41.382321+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:01:41.382321+0000","last_undegraded":"2024-04-23T19:01:41.382321+0000","last_fullsized":"2024-04-23T19:01:41.382321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"57'12","reported_seq":105,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099942+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:01:41.099942+0000","last_peered":"2024-04-23T19:01:41.099942+0000","last_clean":"2024-04-23T19:01:41.099942+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:01:41.099942+0000","last_undegraded":"2024-04-23T19:01:41.099942+0000","last_fullsized":"2024-04-23T19:01:41.099942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"53'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594405+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:01:41.594405+0000","last_peered":"2024-04-23T19:01:41.594405+0000","last_clean":"2024-04-23T19:01:41.594405+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:01:41.594405+0000","last_undegraded":"2024-04-23T19:01:41.594405+0000","last_fullsized":"2024-04-23T19:01:41.594405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098493+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:01:41.098493+0000","last_peered":"2024-04-23T19:01:41.098493+0000","last_clean":"2024-04-23T19:01:41.098493+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:01:41.098493+0000","last_undegraded":"2024-04-23T19:01:41.098493+0000","last_fullsized":"2024-04-23T19:01:41.098493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"52'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098772+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:01:41.098772+0000","last_peered":"2024-04-23T19:01:41.098772+0000","last_clean":"2024-04-23T19:01:41.098772+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:01:41.098772+0000","last_undegraded":"2024-04-23T19:01:41.098772+0000","last_fullsized":"2024-04-23T19:01:41.098772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"57'8","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.100585+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:01:41.100585+0000","last_peered":"2024-04-23T19:01:41.100585+0000","last_clean":"2024-04-23T19:01:41.100585+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:01:41.100585+0000","last_undegraded":"2024-04-23T19:01:41.100585+0000","last_fullsized":"2024-04-23T19:01:41.100585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593955+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:01:41.593955+0000","last_peered":"2024-04-23T19:01:41.593955+0000","last_clean":"2024-04-23T19:01:41.593955+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:01:41.593955+0000","last_undegraded":"2024-04-23T19:01:41.593955+0000","last_fullsized":"2024-04-23T19:01:41.593955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"57'2","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381955+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:01:41.381955+0000","last_peered":"2024-04-23T19:01:41.381955+0000","last_clean":"2024-04-23T19:01:41.381955+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:01:41.381955+0000","last_undegraded":"2024-04-23T19:01:41.381955+0000","last_fullsized":"2024-04-23T19:01:41.381955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.591518+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:01:41.591518+0000","last_peered":"2024-04-23T19:01:41.591518+0000","last_clean":"2024-04-23T19:01:41.591518+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:01:41.591518+0000","last_undegraded":"2024-04-23T19:01:41.591518+0000","last_fullsized":"2024-04-23T19:01:41.591518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"57'1","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.557530+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:01:41.557530+0000","last_peered":"2024-04-23T19:01:41.557530+0000","last_clean":"2024-04-23T19:01:41.557530+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:01:41.557530+0000","last_undegraded":"2024-04-23T19:01:41.557530+0000","last_fullsized":"2024-04-23T19:01:41.557530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.381148+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:01:41.381148+0000","last_peered":"2024-04-23T19:01:41.381148+0000","last_clean":"2024-04-23T19:01:41.381148+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:01:41.381148+0000","last_undegraded":"2024-04-23T19:01:41.381148+0000","last_fullsized":"2024-04-23T19:01:41.381148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"57'7","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.594334+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:01:41.594334+0000","last_peered":"2024-04-23T19:01:41.594334+0000","last_clean":"2024-04-23T19:01:41.594334+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:01:41.594334+0000","last_undegraded":"2024-04-23T19:01:41.594334+0000","last_fullsized":"2024-04-23T19:01:41.594334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"53'6","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.098083+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:01:41.098083+0000","last_peered":"2024-04-23T19:01:41.098083+0000","last_clean":"2024-04-23T19:01:41.098083+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:01:41.098083+0000","last_undegraded":"2024-04-23T19:01:41.098083+0000","last_fullsized":"2024-04-23T19:01:41.098083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099070+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:01:41.099070+0000","last_peered":"2024-04-23T19:01:41.099070+0000","last_clean":"2024-04-23T19:01:41.099070+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:01:41.099070+0000","last_undegraded":"2024-04-23T19:01:41.099070+0000","last_fullsized":"2024-04-23T19:01:41.099070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.593794+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:01:41.593794+0000","last_peered":"2024-04-23T19:01:41.593794+0000","last_clean":"2024-04-23T19:01:41.593794+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:01:41.593794+0000","last_undegraded":"2024-04-23T19:01:41.593794+0000","last_fullsized":"2024-04-23T19:01:41.593794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"57'3","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.097606+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:01:41.097606+0000","last_peered":"2024-04-23T19:01:41.097606+0000","last_clean":"2024-04-23T19:01:41.097606+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:01:41.097606+0000","last_undegraded":"2024-04-23T19:01:41.097606+0000","last_fullsized":"2024-04-23T19:01:41.097606+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"57'4","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.099750+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:01:41.099750+0000","last_peered":"2024-04-23T19:01:41.099750+0000","last_clean":"2024-04-23T19:01:41.099750+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:01:41.099750+0000","last_undegraded":"2024-04-23T19:01:41.099750+0000","last_fullsized":"2024-04-23T19:01:41.099750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"53'4","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.382221+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:01:41.382221+0000","last_peered":"2024-04-23T19:01:41.382221+0000","last_clean":"2024-04-23T19:01:41.382221+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:01:41.382221+0000","last_undegraded":"2024-04-23T19:01:41.382221+0000","last_fullsized":"2024-04-23T19:01:41.382221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"57'5","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.589799+0000","last_change":"2024-04-23T19:00:15.270216+0000","last_active":"2024-04-23T19:01:41.589799+0000","last_peered":"2024-04-23T19:01:41.589799+0000","last_clean":"2024-04-23T19:01:41.589799+0000","last_became_active":"2024-04-23T19:00:15.269392+0000","last_became_peered":"2024-04-23T19:00:15.269392+0000","last_unstale":"2024-04-23T19:01:41.589799+0000","last_undegraded":"2024-04-23T19:01:41.589799+0000","last_fullsized":"2024-04-23T19:01:41.589799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-23T19:01:41.102079+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:01:41.102079+0000","last_peered":"2024-04-23T19:01:41.102079+0000","last_clean":"2024-04-23T19:01:41.102079+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:01:41.102079+0000","last_undegraded":"2024-04-23T19:01:41.102079+0000","last_fullsized":"2024-04-23T19:01:41.102079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":242,"num_write":218,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":83510,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":794,"num_read_kb":553,"num_write":443,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":127160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":623,"ondisk_log_size":623,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":304,"num_read_kb":304,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":1095,"num_write":228,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329472,"kb_used_data":298288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94042368,"statfs":{"total":96636764160,"available":96299384832,"internally_reserved":0,"allocated":305446912,"data_stored":305056531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189600,"kb_used_data":158412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94182240,"statfs":{"total":96636764160,"available":96442613760,"internally_reserved":0,"allocated":162213888,"data_stored":161858599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345300,"kb_used_data":314112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94026540,"statfs":{"total":96636764160,"available":96283176960,"internally_reserved":0,"allocated":321650688,"data_stored":321249257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349324,"kb_used_data":318136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94022516,"statfs":{"total":96636764160,"available":96279056384,"internally_reserved":0,"allocated":325771264,"data_stored":325434404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412920,"kb_used_data":381740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93958920,"statfs":{"total":96636764160,"available":96213934080,"internally_reserved":0,"allocated":390901760,"data_stored":390514544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208072,"kb_used_data":176884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94163768,"statfs":{"total":96636764160,"available":96423698432,"internally_reserved":0,"allocated":181129216,"data_stored":180788633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":212144,"kb_used_data":180956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94159696,"statfs":{"total":96636764160,"available":96419528704,"internally_reserved":0,"allocated":185298944,"data_stored":184926800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298732,"kb_used_data":267544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94073108,"statfs":{"total":96636764160,"available":96330862592,"internally_reserved":0,"allocated":273965056,"data_stored":273598088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":184549376,"data_stored":184549376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":180355072,"data_stored":180355072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":390070272,"data_stored":390070272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":325058560,"data_stored":325058560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":320864256,"data_stored":320864256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161480704,"data_stored":161480704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":304087040,"data_stored":304087040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:01:45.939 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-23T19:01:45.939 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T19:01:45.940 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-23T19:01:45.940 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-23T19:01:45.969 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:45.971+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:46.003 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:46.003 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:46.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:46.064 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:46.067+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:46.109 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:46.110 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:46.112 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:46.112 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:46.113 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-23T19:01:46.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:01:46.164 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:46.161+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:46.180 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:46.181 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:46.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:46.278 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:46.279 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:46.279 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:46.279+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:46.281 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:46.281 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:46.281 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-23T19:01:46.352 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:46.352 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:46.366 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:46.367+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:46.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:46.466 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:46.467 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:46.467+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:46.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:46.468 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:46.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-23T19:01:46.518 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:46.518 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:46.531 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:46.578 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:46.577+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:46.664 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:46.664 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:46.667 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:46.668 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:46.668 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:46.668 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:46.669 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:46.665+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:46.671 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:46.671 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:46.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-04-23T19:01:46.678 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:46.769 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:46.765+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:46.822 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:46.823 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:46.825 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:46.825 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:46.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-04-23T19:01:46.847 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:46.847 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:46.861 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:46.872 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:46.875+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:46.964 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:46.967 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:46.967 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:46.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-04-23T19:01:46.971 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:46.969+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:47.026 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:47.026 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:47.041 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:47.082 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:47.081+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:47.158 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:47.159 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:47.161 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:47.162 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:47.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-04-23T19:01:47.165 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:01:47.173 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:47.169+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:47.211 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:47.211 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:47.225 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:47.273 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:47.275+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:no valid command found; 10 closest matches: 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:0 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:1 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:2 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:abort 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:assert 2024-04-23T19:01:47.301 INFO:teuthology.orchestra.run.smithi169.stderr:bench [] [] [] [] 2024-04-23T19:01:47.302 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs debug_inject_read_zeros 2024-04-23T19:01:47.302 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs files list 2024-04-23T19:01:47.302 INFO:teuthology.orchestra.run.smithi169.stderr:bluefs stats 2024-04-23T19:01:47.302 INFO:teuthology.orchestra.run.smithi169.stderr:bluestore allocator dump block 2024-04-23T19:01:47.302 INFO:teuthology.orchestra.run.smithi169.stderr:Error EINVAL: invalid command 2024-04-23T19:01:47.304 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T19:01:47.304 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T19:01:47.375 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:47.375+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:47.396 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:47.396 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:47.410 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:47.475 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:47.473+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:47.531 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:47.532 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:47.546 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:47.590 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:47.589+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:47.678 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:47.679+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:47.714 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:47.714 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:47.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:47.729 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:47.778 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:47.779+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:47.847 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:47.847 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:47.863 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:47.872 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:47.872 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:47.879 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:47.879+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:47.888 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:47.888 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:47.904 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:47.904 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:47.920 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:47.920 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:47.938 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:47.939 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:47.955 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:47.956 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:47.975 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:47.976 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:47.980 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:47.979+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:47.990 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:47.990 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:47.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:47.990 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:47.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.990 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 84.678058246999996, 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019933253000000001, 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 46 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:47.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311135+0000", 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311139+0000", 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3799999999999998e-06 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:47.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311155+0000", 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6103000000000002e-05 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311188+0000", 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3470000000000003e-05 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311214+0000", 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6047e-05 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311367+0000", 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015252500000000001 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.311388+0000", 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1552999999999998e-05 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.323774+0000", 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012385115 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324119+0000", 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000345197 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.324425+0000", 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00030639799999999999 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330449+0000", 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060236760000000004 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330816+0000", 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036673100000000002 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.330959+0000", 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000143805 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:23.331069+0000", 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010925300000000001 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:47.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2122 3.35 3:ac268df4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.056480148, 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018444747000000001, 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2122 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.997 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932713+0000", 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.932716+0000", 2024-04-23T19:01:47.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.159e-06 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937085+0000", 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043697329999999998 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937119+0000", 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3586e-05 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937134+0000", 2024-04-23T19:01:47.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4995e-05 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937228+0000", 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4450000000000005e-05 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937404+0000", 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000175959 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.937565+0000", 2024-04-23T19:01:48.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016108999999999999 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.950657+0000", 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013091139999999999 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951001+0000", 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000344271 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951087+0000", 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6594000000000005e-05 2024-04-23T19:01:48.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.951158+0000", 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0770000000000002e-05 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2135 3.26 3:66cd9a47:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.919409206999999, 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016955900999999999, 2024-04-23T19:01:48.002 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2135 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069784+0000", 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.069787+0000", 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.694e-06 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.073999+0000", 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042116469999999998 2024-04-23T19:01:48.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074024+0000", 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5264000000000001e-05 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074036+0000", 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1773000000000001e-05 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074110+0000", 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4214999999999993e-05 2024-04-23T19:01:48.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074253+0000", 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014303100000000001 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.074360+0000", 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107318 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086400+0000", 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012039574000000001 2024-04-23T19:01:48.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086656+0000", 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256469 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086702+0000", 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5985000000000001e-05 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.086740+0000", 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7931e-05 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.007 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2142 3.26 3:6505eb65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.848910158000001, 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016460737, 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.008 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2142 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140283+0000", 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.140287+0000", 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144147+0000", 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038599770000000001 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144168+0000", 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1328999999999999e-05 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144177+0000", 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1749999999999994e-06 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144257+0000", 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9913000000000006e-05 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144408+0000", 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000151056 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.144539+0000", 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013111899999999999 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.153118+0000", 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085787459999999999 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156562+0000", 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0034444940000000002 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156663+0000", 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010056399999999999 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.156744+0000", 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1148000000000003e-05 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2157 3.10 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.013 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.695728565, 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019824521000000001, 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2157 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293465+0000", 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.293467+0000", 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3089999999999998e-06 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297404+0000", 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039368550000000004 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297432+0000", 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7931000000000001e-05 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297444+0000", 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1508000000000001e-05 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297536+0000", 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2513e-05 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297733+0000", 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019660000000000001 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.297970+0000", 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023758399999999999 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.305333+0000", 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073631290000000004 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313164+0000", 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078300209999999995 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313231+0000", 2024-04-23T19:01:48.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7168000000000005e-05 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.313290+0000", 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8903000000000002e-05 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2190 3.1e e56/20 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.42935784, 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015976137000000001, 2024-04-23T19:01:48.019 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559836+0000", 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.559838+0000", 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564659+0000", 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048211950000000003 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564700+0000", 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1159999999999999e-05 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564717+0000", 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6543000000000001e-05 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564880+0000", 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163272 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.564935+0000", 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4632000000000001e-05 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.575758+0000", 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010822915000000001 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.575812+0000", 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4237000000000003e-05 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2201 3.a 3:531f5619:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.023 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.264656023000001, 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017986076, 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2201 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:48.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724538+0000", 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724541+0000", 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0139999999999999e-06 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728829+0000", 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004288877 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728873+0000", 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3457000000000001e-05 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728891+0000", 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8122999999999999e-05 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.728990+0000", 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9127000000000001e-05 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.729175+0000", 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018525799999999999 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.729338+0000", 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016262000000000001 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.736796+0000", 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074580870000000004 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742396+0000", 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055994080000000002 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742464+0000", 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8662000000000001e-05 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.742524+0000", 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9443e-05 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.893072029000001, 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.029 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:01:48.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:01:48.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:01:48.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:01:48.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:01:48.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:01:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:01:48.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2231 3.3f e57/20 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.756491246, 2024-04-23T19:01:48.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016114270999999999, 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232702+0000", 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232703+0000", 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0800000000000004e-07 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235193+0000", 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024894169999999998 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235226+0000", 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3810999999999999e-05 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235242+0000", 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.558e-05 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235334+0000", 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1736000000000004e-05 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.235355+0000", 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1691e-05 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.248745+0000", 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01338981 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.248817+0000", 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1518000000000002e-05 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2242 3.a 3:509848d5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.041 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.631480806000001, 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016205213999999999, 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2242 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357713+0000", 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.357715+0000", 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3709999999999998e-06 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361530+0000", 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038150910000000001 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361551+0000", 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0514999999999999e-05 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361562+0000", 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1445e-05 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361630+0000", 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8101000000000004e-05 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361736+0000", 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010526000000000001 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.361841+0000", 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105863 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373149+0000", 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307661 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373842+0000", 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00069307099999999996 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373879+0000", 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6792999999999998e-05 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.373918+0000", 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9042999999999999e-05 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2249 3.35 3:ae24b40c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.552371181, 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685019999999999, 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.047 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2249 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436822+0000", 2024-04-23T19:01:48.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.436826+0000", 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.507e-06 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440809+0000", 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039834889999999998 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440848+0000", 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8189999999999999e-05 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440873+0000", 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5313e-05 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.440998+0000", 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012463700000000001 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.441213+0000", 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000215183 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.441385+0000", 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017184500000000001 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.448887+0000", 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075019520000000001 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454385+0000", 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054989130000000002 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454452+0000", 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6635000000000002e-05 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.454507+0000", 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5356000000000003e-05 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.052 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2252 3.35 3:adca29dd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.505190220999999, 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016301998000000002, 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2252 2024-04-23T19:01:48.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484003+0000", 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.484006+0000", 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0000000000000001e-06 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487732+0000", 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037260729999999999 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487756+0000", 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3226000000000001e-05 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487770+0000", 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4714e-05 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.487923+0000", 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015277800000000001 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.488177+0000", 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025382699999999998 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.488427+0000", 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025014699999999999 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.498240+0000", 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009812856 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500143+0000", 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0019034360000000001 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500222+0000", 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8545000000000001e-05 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.500305+0000", 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3395999999999999e-05 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2262 3.20 3:05df02c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.058 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.358526672, 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019440939000000001, 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2262 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630667+0000", 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.630669+0000", 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.542e-06 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634459+0000", 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037898820000000001 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634487+0000", 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7691999999999998e-05 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634499+0000", 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2413e-05 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634632+0000", 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132051 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.634896+0000", 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026448999999999998 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.635126+0000", 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023023100000000001 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.649368+0000", 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014241517 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.649913+0000", 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00054570599999999997 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.650001+0000", 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7293000000000006e-05 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.650108+0000", 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107122 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.301971839, 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.064 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:01:48.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:01:48.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:01:48.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2271 3.20 3:04eeff99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.246719583000001, 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019123983000000001, 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2271 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742474+0000", 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.742479+0000", 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5600000000000004e-06 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746899+0000", 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044202349999999998 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746938+0000", 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9002999999999999e-05 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.746957+0000", 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9242999999999999e-05 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747141+0000", 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018355499999999999 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747511+0000", 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037069199999999999 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.747786+0000", 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027515699999999999 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.757116+0000", 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093292600000000007 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761429+0000", 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131599999999999 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761520+0000", 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0891999999999996e-05 2024-04-23T19:01:48.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.761598+0000", 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8226000000000006e-05 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.205693352999999, 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.075 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:01:48.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:01:48.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.942017332000001, 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:01:48.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.086 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.836902786, 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:48.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:01:48.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:01:48.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2305 3.2e e57/20 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.813293784000001, 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016943086999999999, 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.092 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175900+0000", 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5730000000000002e-06 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180626+0000", 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047234290000000003 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180652+0000", 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6233000000000001e-05 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180667+0000", 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4514e-05 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180779+0000", 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112868 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.180819+0000", 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0015999999999998e-05 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.192748+0000", 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928068999999999 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.192843+0000", 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5384999999999996e-05 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.690329603, 2024-04-23T19:01:48.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.102 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:48.103 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:48.104 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:48.105 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:48.105 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:48.103+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:48.205 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:48.207+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:48.237 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:48.237 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:48.237 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:48.237 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:48.249 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:48.306 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:48.307+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:48.366 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:48.366 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:48.367 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:48.367 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:48.367 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:48.380 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:48.407 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:48.407+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:48.504 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:48.504 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 105.33364552800001, 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.505 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 104.60135912600001, 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020225847000000002, 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 112 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903390+0000", 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903391+0000", 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3740000000000001e-06 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903509+0000", 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117502 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903528+0000", 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9550000000000001e-05 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903538+0000", 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7860000000000008e-06 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916529+0000", 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012990432999999999 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916660+0000", 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131032 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.916861+0000", 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020173899999999999 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.919789+0000", 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029278110000000002 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923459+0000", 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003669931 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923541+0000", 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2013000000000002e-05 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923616+0000", 2024-04-23T19:01:48.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4676000000000001e-05 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 104.601189147, 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:01:48.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:01:48.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:01:48.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 104.601138581, 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:01:48.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 104.60099624199999, 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.528 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 104.60079294099999, 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.534 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:01:48.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 104.60075375700001, 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:01:48.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:01:48.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:01:48.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:01:48.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2155 3.e 3:7394e207:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.232618005000001, 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019575268999999999, 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2155 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272131+0000", 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.272134+0000", 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.514e-06 2024-04-23T19:01:48.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.275986+0000", 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038527090000000002 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276009+0000", 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2949e-05 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276020+0000", 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0893000000000001e-05 2024-04-23T19:01:48.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276096+0000", 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5844000000000001e-05 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276285+0000", 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000189073 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.276427+0000", 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014148700000000001 2024-04-23T19:01:48.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291495+0000", 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015068152 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291548+0000", 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3384999999999998e-05 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291660+0000", 2024-04-23T19:01:48.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111712 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.291706+0000", 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6551000000000002e-05 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2198 3.2d 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.830447855999999, 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019840345999999998, 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.551 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2198 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674301+0000", 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.674304+0000", 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2139999999999999e-06 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678249+0000", 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039455699999999998 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678275+0000", 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6322e-05 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678287+0000", 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1533e-05 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678382+0000", 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5379999999999998e-05 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678559+0000", 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000176787 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.678678+0000", 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011892000000000001 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.685235+0000", 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065573610000000003 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.693941+0000", 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087059919999999992 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694056+0000", 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011435200000000001 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.694142+0000", 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5915000000000007e-05 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.556 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2202 3.3f 3:fcdbdc32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.758764802, 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019991346, 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.557 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2202 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745984+0000", 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.745987+0000", 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.305e-06 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749881+0000", 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038945059999999998 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749910+0000", 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9164000000000001e-05 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.749925+0000", 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4443999999999999e-05 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750113+0000", 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018781700000000001 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750360+0000", 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024755000000000003 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.750598+0000", 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237498 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.763676+0000", 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01307818 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765795+0000", 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002119297 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765897+0000", 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101619 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.765976+0000", 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8966000000000003e-05 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2205 3.2d 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:48.562 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.706330619999999, 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021534458999999999, 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2205 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798421+0000", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4370000000000001e-06 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802242+0000", 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038212939999999998 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802263+0000", 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0543e-05 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802273+0000", 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0248000000000001e-05 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802427+0000", 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015376100000000001 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802688+0000", 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026095699999999998 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802960+0000", 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027196700000000002 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.814078+0000", 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011118031 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819767+0000", 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056894629999999996 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819878+0000", 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011114499999999999 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819953+0000", 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4612999999999999e-05 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.422122663, 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021578863, 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:01:48.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103605+0000", 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012893465999999999 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103925+0000", 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032048599999999998 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104067+0000", 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014224100000000001 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104205+0000", 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013803200000000001 2024-04-23T19:01:48.573 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.387967033000001, 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:48.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:01:48.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:01:48.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2231 3.3f 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.276929915, 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021281242999999998, 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.578 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2231 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227821+0000", 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499999999999999e-06 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231570+0000", 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037486009999999998 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231593+0000", 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3295999999999999e-05 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231602+0000", 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9330000000000007e-06 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231729+0000", 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012735200000000001 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232086+0000", 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000356635 2024-04-23T19:01:48.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232429+0000", 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034333600000000002 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.245402+0000", 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012972450999999999 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249012+0000", 2024-04-23T19:01:48.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036096840000000002 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249058+0000", 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6462999999999999e-05 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249100+0000", 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2441999999999998e-05 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2246 3.d 3:b0736148:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.104031839999999, 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019541955999999999, 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2246 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400717+0000", 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.400720+0000", 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3020000000000002e-06 2024-04-23T19:01:48.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404442+0000", 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037224620000000002 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404474+0000", 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1953999999999999e-05 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404486+0000", 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1562999999999999e-05 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404588+0000", 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010257 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.404852+0000", 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026406599999999998 2024-04-23T19:01:48.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.405237+0000", 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000384612 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.419338+0000", 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014101058 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420099+0000", 2024-04-23T19:01:48.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00076121100000000003 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420189+0000", 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9458999999999998e-05 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.420259+0000", 2024-04-23T19:01:48.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0698999999999995e-05 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.812381486, 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.740221188, 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.594 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:01:48.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2295 3.12 e57/20 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head v 57'8, mlcod=56'6)", 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.43280337, 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020893219000000001, 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:48.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071949+0000", 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5559999999999999e-06 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077385+0000", 2024-04-23T19:01:48.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054361019999999999 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077829+0000", 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044398899999999999 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.078932+0000", 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011023750000000001 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081607+0000", 2024-04-23T19:01:48.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026748969999999999 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081654+0000", 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7644e-05 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092752+0000", 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011097164 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092839+0000", 2024-04-23T19:01:48.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7491999999999995e-05 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2299 3.f 3:f2287333:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.390535757, 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023125123000000001, 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.604 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2299 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114216+0000", 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5100000000000001e-06 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119361+0000", 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051446879999999997 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119396+0000", 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5812999999999997e-05 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119414+0000", 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7269999999999999e-05 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119583+0000", 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016943199999999999 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119990+0000", 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040668900000000001 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.120394+0000", 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403755 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.129091+0000", 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086969969999999997 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137017+0000", 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079263489999999992 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137206+0000", 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018926500000000001 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137339+0000", 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013235499999999999 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2311 3.d 3:b2884c89:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:48.609 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.269692832, 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022499029, 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2311 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:48.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235060+0000", 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7759999999999999e-06 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238950+0000", 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038900689999999999 2024-04-23T19:01:48.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238993+0000", 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3303000000000002e-05 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239013+0000", 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9879999999999999e-05 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239210+0000", 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019640400000000001 2024-04-23T19:01:48.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239612+0000", 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040218900000000001 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.240031+0000", 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041938899999999999 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254300+0000", 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014269097 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257380+0000", 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003079104 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257481+0000", 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101325 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257555+0000", 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4493000000000007e-05 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.614 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.615 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.615 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:48.615 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:48.615 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:48.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:48.617 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:48.615+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:48.718 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:48.717+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:48.748 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:48.748 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:48.762 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:48.818 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:48.819+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:48.882 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:48.883 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:48.883 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:48.883 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:48.883 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:48.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:48.918 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:48.917+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:49.020 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:49.019+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:49.061 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1243 3.2b 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.241698065000001, 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016938254999999999, 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.062 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1243 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821419+0000", 2024-04-23T19:01:49.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9289999999999998e-06 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824120+0000", 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027012009999999999 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824153+0000", 2024-04-23T19:01:49.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2663999999999998e-05 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824168+0000", 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5747999999999999e-05 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824249+0000", 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0492000000000001e-05 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824367+0000", 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117768 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824480+0000", 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011374699999999999 2024-04-23T19:01:49.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.836387+0000", 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011906699999999999 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838288+0000", 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900606 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838322+0000", 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4363000000000003e-05 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838354+0000", 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2036999999999998e-05 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.237263405, 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.070 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:01:49.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:01:49.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:01:49.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2114 3.1 3:8002664d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.208125166, 2024-04-23T19:01:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017114279, 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2114 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854992+0000", 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5080000000000001e-06 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856342+0000", 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001349299 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856377+0000", 2024-04-23T19:01:49.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5281000000000003e-05 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856392+0000", 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4739999999999999e-05 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856485+0000", 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3214999999999994e-05 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856617+0000", 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013243099999999999 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856748+0000", 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013113799999999999 2024-04-23T19:01:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.862501+0000", 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057523319999999998 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871755+0000", 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092546959999999998 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871911+0000", 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015593700000000001 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.872103+0000", 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191702 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2117 3.12 3:4a6ac759:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.178586971, 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013830090999999999, 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2117 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884530+0000", 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9040000000000001e-06 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886120+0000", 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001589823 2024-04-23T19:01:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886143+0000", 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159999999999998e-05 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886152+0000", 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3409999999999992e-06 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886218+0000", 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6157999999999999e-05 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886341+0000", 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245100000000001 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886461+0000", 2024-04-23T19:01:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120381 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.892686+0000", 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062244099999999997 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898130+0000", 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054443349999999998 2024-04-23T19:01:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898186+0000", 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6199999999999997e-05 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898357+0000", 2024-04-23T19:01:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017092799999999999 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2121 3.12 3:4ab0d216:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.140489035, 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015267064, 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2121 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922628+0000", 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6639999999999998e-06 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924374+0000", 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017465239999999999 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924405+0000", 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1035999999999999e-05 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924420+0000", 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4552000000000001e-05 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924517+0000", 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6953999999999994e-05 2024-04-23T19:01:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924704+0000", 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187073 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924878+0000", 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017427299999999999 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.933464+0000", 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085861029999999994 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937770+0000", 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043062389999999999 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937839+0000", 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8887999999999995e-05 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937892+0000", 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2757999999999999e-05 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2127 3.12 3:49e657d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.077162096, 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014820902, 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2127 2024-04-23T19:01:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985954+0000", 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987681+0000", 2024-04-23T19:01:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726265 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987709+0000", 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8496e-05 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987723+0000", 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4433000000000001e-05 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987794+0000", 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0783000000000003e-05 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987915+0000", 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120518 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.988028+0000", 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113268 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.994241+0000", 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062126689999999997 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000685+0000", 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064444890000000003 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000731+0000", 2024-04-23T19:01:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5562999999999997e-05 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000773+0000", 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2001e-05 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2143 3.1 3:818c3cf4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.913033109000001, 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014844245000000001, 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2143 2024-04-23T19:01:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150084+0000", 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2600000000000001e-06 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151570+0000", 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014861189999999999 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151604+0000", 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151621+0000", 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6144e-05 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151697+0000", 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6377000000000004e-05 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151869+0000", 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017231000000000001 2024-04-23T19:01:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151968+0000", 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8455999999999994e-05 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.159112+0000", 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071439989999999998 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164808+0000", 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005696301 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164872+0000", 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3615999999999995e-05 2024-04-23T19:01:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164925+0000", 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3439000000000001e-05 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2144 3.1 3:822f1bc9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.903046315999999, 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01381895, 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2144 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160069+0000", 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8679999999999999e-06 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161620+0000", 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015505709999999999 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161644+0000", 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4269000000000001e-05 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161655+0000", 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161722+0000", 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7409000000000005e-05 2024-04-23T19:01:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161859+0000", 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013668099999999999 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161961+0000", 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102273 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.168267+0000", 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063061339999999997 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173766+0000", 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054986849999999997 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173835+0000", 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9140999999999994e-05 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173887+0000", 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1480999999999997e-05 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2157 3.10 e56/20 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.76431378, 2024-04-23T19:01:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014718479, 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298802+0000", 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.869e-06 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302934+0000", 2024-04-23T19:01:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041324459999999997 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302962+0000", 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7302000000000001e-05 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302975+0000", 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3349999999999999e-05 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303059+0000", 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3782999999999994e-05 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303086+0000", 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7436999999999998e-05 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313460+0000", 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010373408000000001 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313519+0000", 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8884000000000001e-05 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2161 3.12 3:4ba64ee9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.722727674, 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016255067000000002, 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2161 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340390+0000", 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.455e-06 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342958+0000", 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025682109999999999 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342988+0000", 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0199999999999999e-05 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343002+0000", 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3769e-05 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343083+0000", 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0687999999999997e-05 2024-04-23T19:01:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343237+0000", 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015475600000000001 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343340+0000", 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102834 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.349457+0000", 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061166229999999999 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356502+0000", 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070452609999999997 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356576+0000", 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3526e-05 2024-04-23T19:01:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356641+0000", 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5743999999999999e-05 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.148362220999999, 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:01:49.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:01:49.135 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2215 3.b e56/20 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.053054799, 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015142766, 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010061+0000", 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2520000000000002e-06 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013225+0000", 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003163622 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013274+0000", 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9471000000000001e-05 2024-04-23T19:01:49.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013298+0000", 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3628000000000001e-05 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013434+0000", 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013560699999999999 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013475+0000", 2024-04-23T19:01:49.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0938e-05 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025068+0000", 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011593440999999999 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025202+0000", 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133807 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:49.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.018199392, 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:01:49.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:01:49.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:01:49.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:01:49.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2233 3.3a e57/20 3:5c6ef8e1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_122:head v 57'3, mlcod=53'1)", 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.811122169000001, 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014404780000000001, 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.149 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251994+0000", 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.784e-06 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255871+0000", 2024-04-23T19:01:49.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00387762 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255901+0000", 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9901000000000001e-05 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255914+0000", 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.328e-05 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256041+0000", 2024-04-23T19:01:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012621299999999999 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256080+0000", 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9245000000000001e-05 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266324+0000", 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010244659999999999 2024-04-23T19:01:49.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266397+0000", 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2076999999999994e-05 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.680690837, 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:01:49.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:01:49.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:01:49.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2251 3.32 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.596452442, 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015905636000000001, 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.160 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2251 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:49.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466664+0000", 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469135+0000", 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002470164 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469164+0000", 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9115000000000002e-05 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469182+0000", 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8726999999999999e-05 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469306+0000", 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012313600000000001 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469497+0000", 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019168399999999999 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469679+0000", 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018196600000000001 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.476311+0000", 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066314629999999998 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482438+0000", 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061275449999999999 2024-04-23T19:01:49.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482508+0000", 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9795999999999994e-05 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482567+0000", 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9166999999999998e-05 2024-04-23T19:01:49.166 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2265 3.32 3:4d8b1756:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.39799178, 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013967738, 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.167 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2265 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665125+0000", 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1769999999999998e-06 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667169+0000", 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020441040000000001 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667217+0000", 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7262000000000003e-05 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667245+0000", 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7888000000000001e-05 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667343+0000", 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8782000000000004e-05 2024-04-23T19:01:49.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667487+0000", 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143597 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667644+0000", 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697700000000001 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678434+0000", 2024-04-23T19:01:49.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010789801 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678995+0000", 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000560802 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679045+0000", 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0868000000000002e-05 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679090+0000", 2024-04-23T19:01:49.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4480000000000001e-05 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.993567868, 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:01:49.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:01:49.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2298 3.3e e57/20 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.962296645, 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015216608, 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.181 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100819+0000", 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.672e-06 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102788+0000", 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019685979999999998 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102812+0000", 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4012e-05 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102825+0000", 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3288999999999999e-05 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102919+0000", 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4561000000000005e-05 2024-04-23T19:01:49.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102950+0000", 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0434e-05 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.115979+0000", 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013028889 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116034+0000", 2024-04-23T19:01:49.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5152999999999999e-05 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2304 3.12 3:4b60d7e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.900320716, 2024-04-23T19:01:49.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014756422, 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2304 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162794+0000", 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2449999999999999e-06 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164305+0000", 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015100770000000001 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164334+0000", 2024-04-23T19:01:49.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9132000000000002e-05 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164348+0000", 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4378e-05 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164439+0000", 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0886999999999999e-05 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164635+0000", 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019567799999999999 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164810+0000", 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175448 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.171513+0000", 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067025660000000001 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177452+0000", 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059398400000000001 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177497+0000", 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4282000000000001e-05 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177550+0000", 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2889000000000001e-05 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.193 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.194 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.194 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:49.194 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:01:49.196 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:49.196 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:49.193+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:49.295 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:49.295+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:49.369 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:49.370 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:49.370 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:49.370 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:49.388 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:49.397 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:49.393+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:49.497 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:49.499+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:49.545 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:49.545 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:49.545 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:49.545 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:49.545 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:49.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:49.599 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:49.597+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:49.700 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:49.699+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:49.725 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.435252992000002, 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:49.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:49.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:49.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2123 3.0 3:0261d0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.782050492, 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015185707999999999, 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2123 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942998+0000", 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8210000000000002e-06 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944838+0000", 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018401769999999999 2024-04-23T19:01:49.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944863+0000", 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4899999999999999e-05 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944874+0000", 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0926e-05 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944942+0000", 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7428999999999994e-05 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945070+0000", 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012833899999999999 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945175+0000", 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010466100000000001 2024-04-23T19:01:49.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.957371+0000", 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012196864 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958106+0000", 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00073463499999999998 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958147+0000", 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0506000000000001e-05 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958181+0000", 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4449999999999997e-05 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.737 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.472651301000001, 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:01:49.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:01:49.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2162 3.25 3:a68bdb79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.374802948999999, 2024-04-23T19:01:49.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014496184, 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2162 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:49.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350245+0000", 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6249999999999999e-06 2024-04-23T19:01:49.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351950+0000", 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001704721 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351984+0000", 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352000+0000", 2024-04-23T19:01:49.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5662e-05 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352094+0000", 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3715999999999995e-05 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352285+0000", 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019128799999999999 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352456+0000", 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017101200000000001 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364058+0000", 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011602128 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364650+0000", 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059187900000000002 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364688+0000", 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7515999999999998e-05 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364739+0000", 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1412999999999997e-05 2024-04-23T19:01:49.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2171 3.31 3:8c201035:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.269552236999999, 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015626368000000002, 2024-04-23T19:01:49.751 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2171 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455496+0000", 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8949999999999998e-06 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457275+0000", 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017788330000000001 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457301+0000", 2024-04-23T19:01:49.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6024999999999999e-05 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457313+0000", 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1877e-05 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457386+0000", 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3109999999999996e-05 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457527+0000", 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014033399999999999 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457656+0000", 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129789 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.464144+0000", 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064880069999999996 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471010+0000", 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068660070000000004 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471056+0000", 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5943999999999999e-05 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471120+0000", 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3547000000000007e-05 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2187 3.1f 3:fb7660b3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.201665736000001, 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014170726, 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.758 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2187 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523384+0000", 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8530000000000002e-06 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525403+0000", 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020189000000000001 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525440+0000", 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6979e-05 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525453+0000", 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3005e-05 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525563+0000", 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109985 2024-04-23T19:01:49.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525789+0000", 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022658800000000001 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525988+0000", 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000198409 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536623+0000", 2024-04-23T19:01:49.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010635109 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537400+0000", 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077722900000000005 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537466+0000", 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5518999999999994e-05 2024-04-23T19:01:49.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537551+0000", 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5149999999999996e-05 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.158038636000001, 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:01:49.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:01:49.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:01:49.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:01:49.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2200 3.1a e56/20 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head v 56'3, mlcod=52'1)", 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:49.770 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.016791227000001, 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016149459000000001, 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708257+0000", 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.666e-06 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712912+0000", 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004654661 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712947+0000", 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5612999999999999e-05 2024-04-23T19:01:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712965+0000", 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-05 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713105+0000", 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140264 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713170+0000", 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4974999999999994e-05 2024-04-23T19:01:49.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724310+0000", 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011139935 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724404+0000", 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4005000000000005e-05 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.866425951, 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.789477179, 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.779 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:01:49.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:01:49.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:01:49.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2229 3.31 3:8ced272b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.520784296, 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012661527000000001, 2024-04-23T19:01:49.784 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2229 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204264+0000", 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6649999999999999e-06 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205798+0000", 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001534349 2024-04-23T19:01:49.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205838+0000", 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9258000000000003e-05 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205855+0000", 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7532000000000001e-05 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205962+0000", 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010679 2024-04-23T19:01:49.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206143+0000", 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000180559 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206304+0000", 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016126500000000001 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.213214+0000", 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069100849999999998 2024-04-23T19:01:49.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216772+0000", 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035580210000000002 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216855+0000", 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2996000000000003e-05 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216923+0000", 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8007000000000001e-05 2024-04-23T19:01:49.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2243 3.25 3:a47da34a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.357178916000001, 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016498994999999999, 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2243 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367870+0000", 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4479999999999999e-06 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370547+0000", 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026765270000000002 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370583+0000", 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5710999999999997e-05 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370598+0000", 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5726000000000002e-05 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370683+0000", 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4819000000000002e-05 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370832+0000", 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014911899999999999 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370992+0000", 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159815 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381097+0000", 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010105042999999999 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384082+0000", 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029852009999999998 2024-04-23T19:01:49.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384244+0000", 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016155999999999999 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384366+0000", 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122026 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.795 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2245 3.0 3:03deb7e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.335044637999999, 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015195145, 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2245 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390004+0000", 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9679999999999998e-06 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392079+0000", 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020753759999999999 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392103+0000", 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3479e-05 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392116+0000", 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2761e-05 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392224+0000", 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107904 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392428+0000", 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000204186 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392635+0000", 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020687200000000001 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404314+0000", 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011679144000000001 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405073+0000", 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075964499999999998 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405143+0000", 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9394999999999995e-05 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405196+0000", 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3415000000000003e-05 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2251 3.32 e57/20 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head v 57'2, mlcod=0'0)", 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.255201024, 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012365898, 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.801 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.44e-07 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471716+0000", 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018707960000000001 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471751+0000", 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622999999999997e-05 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471769+0000", 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8508e-05 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471919+0000", 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149853 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471968+0000", 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9066000000000001e-05 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482090+0000", 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122160999999999 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482211+0000", 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120347 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2254 3.1a e57/20 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head v 57'5, mlcod=56'3)", 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.204892893, 2024-04-23T19:01:49.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016447765, 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520156+0000", 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6429999999999999e-06 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524703+0000", 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045476930000000002 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524732+0000", 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8551000000000002e-05 2024-04-23T19:01:49.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524745+0000", 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3124e-05 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524844+0000", 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8721999999999994e-05 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524878+0000", 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4839000000000003e-05 2024-04-23T19:01:49.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536495+0000", 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011616912 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536601+0000", 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105281 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2278 3.8 e57/20 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.872218934999999, 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016293365000000001, 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852829+0000", 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9549999999999999e-06 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855964+0000", 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003135035 2024-04-23T19:01:49.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855993+0000", 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9369999999999998e-05 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856007+0000", 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3696999999999999e-05 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856132+0000", 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125313 2024-04-23T19:01:49.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856188+0000", 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6164e-05 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.868860+0000", 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012671319 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869120+0000", 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026051200000000002 2024-04-23T19:01:49.813 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.863791237999999, 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.814 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:01:49.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.819 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2280 3.25 3:a4e9d83c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.848196545, 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014342169, 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2280 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876852+0000", 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.305e-06 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878784+0000", 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001932465 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878822+0000", 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7654999999999998e-05 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878844+0000", 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2124999999999999e-05 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878935+0000", 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1154000000000002e-05 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879107+0000", 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172199 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879257+0000", 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015013200000000001 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.889696+0000", 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010438523999999999 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891118+0000", 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014217640000000001 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891156+0000", 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8597000000000003e-05 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891191+0000", 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5249000000000001e-05 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.626506343999999, 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.825 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.830 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2300 3.25 3:a433329a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.602007013, 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012342531, 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2300 2024-04-23T19:01:49.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123042+0000", 2024-04-23T19:01:49.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2289999999999999e-06 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125053+0000", 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020108349999999999 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125088+0000", 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5472000000000002e-05 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125106+0000", 2024-04-23T19:01:49.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7207e-05 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125188+0000", 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2473999999999997e-05 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125327+0000", 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013878299999999999 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:49.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125436+0000", 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010893200000000001 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.134793+0000", 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0093574209999999994 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135267+0000", 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047370000000000002 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135330+0000", 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135381+0000", 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1567000000000003e-05 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:49.836 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:49.838 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:49.838 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:49.837+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:49.938 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:49.939+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:50.010 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:50.011 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:50.011 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:50.011 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:50.025 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:50.039 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:50.037+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:50.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:50.140 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:50.137+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:50.185 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:01:50.199 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:50.199 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:50.199 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:50.199 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:50.199 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:50.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:50.265 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:50.267+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:50.270 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:50.270 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:50.287 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:50.287 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:50.304 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:50.304 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:50.322 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:50.322 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:50.341 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:50.341 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:50.342 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:50.341+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:50.346 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:50.346 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:50.361 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:50.362 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:50.362 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:50.382 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:50.382 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:50.402 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:50.403 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:50.461 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:50.463+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:50.471 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:50.471 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:50.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:50.544 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:50.541+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:50.645 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:50.641+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:50.646 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:50.647 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:50.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:50.746 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:50.745+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:50.770 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:50.771 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:50.783 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:50.847 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:50.847+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:50.913 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:50.913 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:50.927 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:50.948 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:50.947+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:51.047 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:51.047 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:51.048 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:51.045+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:51.061 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:51.150 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:51.149+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:51.228 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:51.228 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:51.242 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:51.250 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:51.251+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:51.350 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:51.349+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:51.415 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:51.415 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:51.430 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:51.474 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:51.473+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:51.553 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:51.555+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:51.597 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:51.598 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:51.612 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:51.654 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:51.655+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:51.729 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:51.729 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:51.743 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:51.790 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:51.789+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:51.856 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:51.855+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:51.860 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:51.860 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:51.874 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:51.958 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:51.959+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:52.041 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:52.041 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:52.055 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:52.058 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:52.057+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:52.159 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:52.159+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:52.178 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:52.178 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:52.193 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:52.221 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:01:52.260 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:52.257+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:52.309 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:52.309 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:52.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:52.366 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:52.365+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:52.420 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:52.465 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:52.467+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:52.488 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:52.488 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:52.503 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:52.562 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:52.561+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:52.612 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:52.612 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:52.624 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:52.624 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:52.629 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:52.629 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:52.638 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:52.647 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:52.647 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:52.663 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:52.663+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:52.665 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:52.665 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:52.683 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:52.683 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:52.703 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:52.703 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:52.723 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:52.724 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:52.744 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:52.745 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:52.758 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:52.758 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:52.759 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:52.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:52.773 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:52.775+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:52.865 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:52.865+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:52.929 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:52.929 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:52.929 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:52.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:52.966 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:52.965+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1243 3.2b 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:53.065 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.243177322000001, 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016938254999999999, 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1243 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:53.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821419+0000", 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9289999999999998e-06 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824120+0000", 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027012009999999999 2024-04-23T19:01:53.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824153+0000", 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2663999999999998e-05 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824168+0000", 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5747999999999999e-05 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824249+0000", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0492000000000001e-05 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824367+0000", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117768 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824480+0000", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011374699999999999 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.836387+0000", 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011906699999999999 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838288+0000", 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900606 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838322+0000", 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4363000000000003e-05 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838354+0000", 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2036999999999998e-05 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.238742662, 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.071 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2114 3.1 3:8002664d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:53.076 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.209604422999998, 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017114279, 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2114 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854992+0000", 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5080000000000001e-06 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856342+0000", 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001349299 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856377+0000", 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5281000000000003e-05 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856392+0000", 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4739999999999999e-05 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856485+0000", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3214999999999994e-05 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856617+0000", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013243099999999999 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856748+0000", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013113799999999999 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.862501+0000", 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057523319999999998 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871755+0000", 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092546959999999998 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871911+0000", 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015593700000000001 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.872103+0000", 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191702 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2117 3.12 3:4a6ac759:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.180066228000001, 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013830090999999999, 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2117 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884530+0000", 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9040000000000001e-06 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886120+0000", 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001589823 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886143+0000", 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159999999999998e-05 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886152+0000", 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3409999999999992e-06 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886218+0000", 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6157999999999999e-05 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886341+0000", 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245100000000001 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886461+0000", 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120381 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.892686+0000", 2024-04-23T19:01:53.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062244099999999997 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898130+0000", 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054443349999999998 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898186+0000", 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6199999999999997e-05 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898357+0000", 2024-04-23T19:01:53.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017092799999999999 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2121 3.12 3:4ab0d216:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.141968292000001, 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015267064, 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2121 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922628+0000", 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6639999999999998e-06 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924374+0000", 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017465239999999999 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924405+0000", 2024-04-23T19:01:53.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1035999999999999e-05 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924420+0000", 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4552000000000001e-05 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924517+0000", 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6953999999999994e-05 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924704+0000", 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187073 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924878+0000", 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017427299999999999 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.933464+0000", 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085861029999999994 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937770+0000", 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043062389999999999 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937839+0000", 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8887999999999995e-05 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937892+0000", 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2757999999999999e-05 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2127 3.12 3:49e657d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.078641352999998, 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014820902, 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.094 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2127 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985954+0000", 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987681+0000", 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726265 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987709+0000", 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8496e-05 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987723+0000", 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4433000000000001e-05 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987794+0000", 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0783000000000003e-05 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987915+0000", 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120518 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.988028+0000", 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113268 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.994241+0000", 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062126689999999997 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000685+0000", 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064444890000000003 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000731+0000", 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5562999999999997e-05 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000773+0000", 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2001e-05 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2143 3.1 3:818c3cf4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.914512366, 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014844245000000001, 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2143 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150084+0000", 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2600000000000001e-06 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151570+0000", 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014861189999999999 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151604+0000", 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151621+0000", 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6144e-05 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151697+0000", 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6377000000000004e-05 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151869+0000", 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017231000000000001 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151968+0000", 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8455999999999994e-05 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.159112+0000", 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071439989999999998 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164808+0000", 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005696301 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164872+0000", 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3615999999999995e-05 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164925+0000", 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3439000000000001e-05 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2144 3.1 3:822f1bc9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.904525573000001, 2024-04-23T19:01:53.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01381895, 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2144 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160069+0000", 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8679999999999999e-06 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161620+0000", 2024-04-23T19:01:53.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015505709999999999 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161644+0000", 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4269000000000001e-05 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161655+0000", 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161722+0000", 2024-04-23T19:01:53.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7409000000000005e-05 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161859+0000", 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013668099999999999 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161961+0000", 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102273 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.168267+0000", 2024-04-23T19:01:53.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063061339999999997 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173766+0000", 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054986849999999997 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173835+0000", 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9140999999999994e-05 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173887+0000", 2024-04-23T19:01:53.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1480999999999997e-05 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2157 3.10 e56/20 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.765793037000002, 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014718479, 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298802+0000", 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.869e-06 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302934+0000", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041324459999999997 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302962+0000", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7302000000000001e-05 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302975+0000", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3349999999999999e-05 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303059+0000", 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3782999999999994e-05 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303086+0000", 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7436999999999998e-05 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313460+0000", 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010373408000000001 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313519+0000", 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8884000000000001e-05 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2161 3.12 3:4ba64ee9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.724206931000001, 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016255067000000002, 2024-04-23T19:01:53.115 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2161 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340390+0000", 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.455e-06 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342958+0000", 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025682109999999999 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342988+0000", 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0199999999999999e-05 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343002+0000", 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3769e-05 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343083+0000", 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0687999999999997e-05 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343237+0000", 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015475600000000001 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343340+0000", 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102834 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.349457+0000", 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061166229999999999 2024-04-23T19:01:53.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356502+0000", 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070452609999999997 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356576+0000", 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3526e-05 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356641+0000", 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5743999999999999e-05 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.149841477999999, 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.121 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:01:53.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:01:53.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:01:53.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2215 3.b e56/20 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:53.126 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:53.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.054534056000001, 2024-04-23T19:01:53.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015142766, 2024-04-23T19:01:53.127 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.127 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010061+0000", 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2520000000000002e-06 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013225+0000", 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003163622 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013274+0000", 2024-04-23T19:01:53.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9471000000000001e-05 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013298+0000", 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3628000000000001e-05 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013434+0000", 2024-04-23T19:01:53.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013560699999999999 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013475+0000", 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0938e-05 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025068+0000", 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011593440999999999 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025202+0000", 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133807 2024-04-23T19:01:53.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.019678648999999, 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.133 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:53.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:01:53.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:01:53.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:01:53.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:01:53.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:01:53.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:53.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:01:53.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2233 3.3a e57/20 3:5c6ef8e1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_122:head v 57'3, mlcod=53'1)", 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:53.143 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.812601426000001, 2024-04-23T19:01:53.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014404780000000001, 2024-04-23T19:01:53.144 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.144 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.144 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.144 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251994+0000", 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.784e-06 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255871+0000", 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00387762 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255901+0000", 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9901000000000001e-05 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255914+0000", 2024-04-23T19:01:53.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.328e-05 2024-04-23T19:01:53.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256041+0000", 2024-04-23T19:01:53.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012621299999999999 2024-04-23T19:01:53.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256080+0000", 2024-04-23T19:01:53.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9245000000000001e-05 2024-04-23T19:01:53.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266324+0000", 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010244659999999999 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266397+0000", 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2076999999999994e-05 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.150 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.682170094, 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.151 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:01:53.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:01:53.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2251 3.32 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:53.155 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.597931699, 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015905636000000001, 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2251 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466664+0000", 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469135+0000", 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002470164 2024-04-23T19:01:53.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469164+0000", 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9115000000000002e-05 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469182+0000", 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8726999999999999e-05 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469306+0000", 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012313600000000001 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469497+0000", 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019168399999999999 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469679+0000", 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018196600000000001 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.476311+0000", 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066314629999999998 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482438+0000", 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061275449999999999 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482508+0000", 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9795999999999994e-05 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482567+0000", 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9166999999999998e-05 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2265 3.32 3:4d8b1756:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.399471037000001, 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013967738, 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2265 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665125+0000", 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1769999999999998e-06 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667169+0000", 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020441040000000001 2024-04-23T19:01:53.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667217+0000", 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7262000000000003e-05 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667245+0000", 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7888000000000001e-05 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667343+0000", 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8782000000000004e-05 2024-04-23T19:01:53.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667487+0000", 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143597 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667644+0000", 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697700000000001 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678434+0000", 2024-04-23T19:01:53.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010789801 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678995+0000", 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000560802 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679045+0000", 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0868000000000002e-05 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679090+0000", 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4480000000000001e-05 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.995047124999999, 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.167 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:01:53.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:01:53.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:01:53.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2298 3.3e e57/20 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.963775901999998, 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015216608, 2024-04-23T19:01:53.173 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:53.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100819+0000", 2024-04-23T19:01:53.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.672e-06 2024-04-23T19:01:53.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102788+0000", 2024-04-23T19:01:53.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019685979999999998 2024-04-23T19:01:53.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102812+0000", 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4012e-05 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102825+0000", 2024-04-23T19:01:53.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3288999999999999e-05 2024-04-23T19:01:53.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102919+0000", 2024-04-23T19:01:53.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4561000000000005e-05 2024-04-23T19:01:53.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102950+0000", 2024-04-23T19:01:53.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0434e-05 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.115979+0000", 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013028889 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116034+0000", 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5152999999999999e-05 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2304 3.12 3:4b60d7e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 16.901799972999999, 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014756422, 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2304 2024-04-23T19:01:53.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162794+0000", 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2449999999999999e-06 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164305+0000", 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015100770000000001 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164334+0000", 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9132000000000002e-05 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164348+0000", 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4378e-05 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164439+0000", 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0886999999999999e-05 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164635+0000", 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019567799999999999 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164810+0000", 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175448 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.171513+0000", 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067025660000000001 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177452+0000", 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059398400000000001 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177497+0000", 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4282000000000001e-05 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177550+0000", 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2889000000000001e-05 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.187 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:53.188 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:53.189 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:53.185+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:53.192 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:01:53.289 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:53.291+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:53.322 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:53.322 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:53.322 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:53.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:53.390 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:53.389+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:53.490 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:53.491+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:53.498 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:53.498 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:53.499 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:53.513 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:53.601 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:53.603+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:53.683 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 94.395111114000002, 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:53.684 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2123 3.0 3:0261d0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.741908614, 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015185707999999999, 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2123 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.689 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942998+0000", 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8210000000000002e-06 2024-04-23T19:01:53.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944838+0000", 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018401769999999999 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944863+0000", 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4899999999999999e-05 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944874+0000", 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0926e-05 2024-04-23T19:01:53.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944942+0000", 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7428999999999994e-05 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945070+0000", 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012833899999999999 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945175+0000", 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010466100000000001 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.957371+0000", 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012196864 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958106+0000", 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00073463499999999998 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958147+0000", 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0506000000000001e-05 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958181+0000", 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4449999999999997e-05 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:53.694 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.432509422999999, 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:53.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:01:53.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:01:53.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:01:53.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2162 3.25 3:a68bdb79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.334661070999999, 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014496184, 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.700 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2162 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350245+0000", 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6249999999999999e-06 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351950+0000", 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001704721 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351984+0000", 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352000+0000", 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5662e-05 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352094+0000", 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3715999999999995e-05 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352285+0000", 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019128799999999999 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352456+0000", 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017101200000000001 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364058+0000", 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011602128 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364650+0000", 2024-04-23T19:01:53.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059187900000000002 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364688+0000", 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7515999999999998e-05 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364739+0000", 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1412999999999997e-05 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.705 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2171 3.31 3:8c201035:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.229410358999999, 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015626368000000002, 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2171 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.706 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455496+0000", 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8949999999999998e-06 2024-04-23T19:01:53.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457275+0000", 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017788330000000001 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457301+0000", 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6024999999999999e-05 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457313+0000", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1877e-05 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457386+0000", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3109999999999996e-05 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457527+0000", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014033399999999999 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457656+0000", 2024-04-23T19:01:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129789 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.464144+0000", 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064880069999999996 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471010+0000", 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068660070000000004 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471056+0000", 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5943999999999999e-05 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471120+0000", 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3547000000000007e-05 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2187 3.1f 3:fb7660b3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.161523857999999, 2024-04-23T19:01:53.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014170726, 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2187 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523384+0000", 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8530000000000002e-06 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525403+0000", 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020189000000000001 2024-04-23T19:01:53.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525440+0000", 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6979e-05 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525453+0000", 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3005e-05 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525563+0000", 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109985 2024-04-23T19:01:53.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525789+0000", 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022658800000000001 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525988+0000", 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000198409 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536623+0000", 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010635109 2024-04-23T19:01:53.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537400+0000", 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077722900000000005 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537466+0000", 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5518999999999994e-05 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537551+0000", 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5149999999999996e-05 2024-04-23T19:01:53.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.117896758000001, 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.717 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.722 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2200 3.1a e56/20 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head v 56'3, mlcod=52'1)", 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.976649348999999, 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016149459000000001, 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708257+0000", 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.666e-06 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712912+0000", 2024-04-23T19:01:53.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004654661 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712947+0000", 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5612999999999999e-05 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712965+0000", 2024-04-23T19:01:53.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-05 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713105+0000", 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140264 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713170+0000", 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4974999999999994e-05 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724310+0000", 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011139935 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724404+0000", 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4005000000000005e-05 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.826284073, 2024-04-23T19:01:53.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:53.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.749335300999999, 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:01:53.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2229 3.31 3:8ced272b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.480642417999999, 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012661527000000001, 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2229 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.738 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204264+0000", 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6649999999999999e-06 2024-04-23T19:01:53.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205798+0000", 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001534349 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205838+0000", 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9258000000000003e-05 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205855+0000", 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7532000000000001e-05 2024-04-23T19:01:53.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205962+0000", 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010679 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206143+0000", 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000180559 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206304+0000", 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016126500000000001 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.213214+0000", 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069100849999999998 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216772+0000", 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035580210000000002 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216855+0000", 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2996000000000003e-05 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216923+0000", 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8007000000000001e-05 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2243 3.25 3:a47da34a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.317037037999999, 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016498994999999999, 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.743 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2243 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:53.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367870+0000", 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4479999999999999e-06 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370547+0000", 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026765270000000002 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370583+0000", 2024-04-23T19:01:53.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5710999999999997e-05 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370598+0000", 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5726000000000002e-05 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370683+0000", 2024-04-23T19:01:53.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4819000000000002e-05 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370832+0000", 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014911899999999999 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370992+0000", 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159815 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381097+0000", 2024-04-23T19:01:53.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010105042999999999 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384082+0000", 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029852009999999998 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384244+0000", 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016155999999999999 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384366+0000", 2024-04-23T19:01:53.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122026 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2245 3.0 3:03deb7e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.294902759999999, 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015195145, 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.749 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2245 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390004+0000", 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9679999999999998e-06 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392079+0000", 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020753759999999999 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392103+0000", 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3479e-05 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392116+0000", 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2761e-05 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392224+0000", 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107904 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392428+0000", 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000204186 2024-04-23T19:01:53.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392635+0000", 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020687200000000001 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404314+0000", 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011679144000000001 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405073+0000", 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075964499999999998 2024-04-23T19:01:53.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405143+0000", 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9394999999999995e-05 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405196+0000", 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3415000000000003e-05 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2251 3.32 e57/20 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head v 57'2, mlcod=0'0)", 2024-04-23T19:01:53.754 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.215059146000002, 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012365898, 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:53.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.44e-07 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471716+0000", 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018707960000000001 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471751+0000", 2024-04-23T19:01:53.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622999999999997e-05 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471769+0000", 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8508e-05 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471919+0000", 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149853 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471968+0000", 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9066000000000001e-05 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482090+0000", 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122160999999999 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482211+0000", 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120347 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2254 3.1a e57/20 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head v 57'5, mlcod=56'3)", 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.164751015, 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016447765, 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.759 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520156+0000", 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6429999999999999e-06 2024-04-23T19:01:53.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524703+0000", 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045476930000000002 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524732+0000", 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8551000000000002e-05 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524745+0000", 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3124e-05 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524844+0000", 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8721999999999994e-05 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524878+0000", 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4839000000000003e-05 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536495+0000", 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011616912 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536601+0000", 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105281 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2278 3.8 e57/20 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:53.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.832077056999999, 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016293365000000001, 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852829+0000", 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9549999999999999e-06 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855964+0000", 2024-04-23T19:01:53.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003135035 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855993+0000", 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9369999999999998e-05 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856007+0000", 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3696999999999999e-05 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856132+0000", 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125313 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856188+0000", 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6164e-05 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.868860+0000", 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012671319 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869120+0000", 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026051200000000002 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:53.768 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.823649360000001, 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:01:53.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:01:53.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.772 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2280 3.25 3:a4e9d83c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.808054667, 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014342169, 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.774 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2280 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:53.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:53.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876852+0000", 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.305e-06 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878784+0000", 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001932465 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878822+0000", 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7654999999999998e-05 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878844+0000", 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2124999999999999e-05 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878935+0000", 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1154000000000002e-05 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879107+0000", 2024-04-23T19:01:53.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172199 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879257+0000", 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015013200000000001 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.889696+0000", 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010438523999999999 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891118+0000", 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014217640000000001 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891156+0000", 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8597000000000003e-05 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891191+0000", 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5249000000000001e-05 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.783 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.586364465999999, 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.784 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2300 3.25 3:a433329a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:53.789 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 17.561865135000001, 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012342531, 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2300 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:53.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123042+0000", 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2289999999999999e-06 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:53.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125053+0000", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020108349999999999 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125088+0000", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5472000000000002e-05 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125106+0000", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7207e-05 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125188+0000", 2024-04-23T19:01:53.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2473999999999997e-05 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125327+0000", 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013878299999999999 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125436+0000", 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010893200000000001 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:53.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.134793+0000", 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0093574209999999994 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135267+0000", 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047370000000000002 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135330+0000", 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:53.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135381+0000", 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1567000000000003e-05 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:53.795 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:53.797 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:53.798 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:53.793+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:53.898 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:53.897+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:53.963 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:53.963 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:53.963 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:53.963 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:53.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:54.025 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:54.026+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:54.100 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:54.098+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:54.104 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:54.104 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:54.104 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:54.104 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:54.104 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:54.119 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:54.201 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:54.197+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2128 3.9 e56/20 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.285860146000001, 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015323256, 2024-04-23T19:01:54.285 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000715+0000", 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.477e-06 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004783+0000", 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040687689999999999 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004810+0000", 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6999999999999999e-05 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004822+0000", 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1768e-05 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004888+0000", 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6135000000000003e-05 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004905+0000", 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7201e-05 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.015977+0000", 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011072039000000001 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.016036+0000", 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8866999999999997e-05 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2138 3.9 e56/20 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.177283434, 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015486679999999999, 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:01:54.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109292+0000", 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1639999999999999e-06 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113331+0000", 2024-04-23T19:01:54.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040388969999999996 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113352+0000", 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1520000000000001e-05 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113364+0000", 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1548e-05 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113429+0000", 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5455000000000003e-05 2024-04-23T19:01:54.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113451+0000", 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1393999999999999e-05 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124722+0000", 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011271458999999999 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124776+0000", 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4243000000000002e-05 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.293 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2139 3.13 3:cab0dc9f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.176402302, 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016204007999999999, 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.294 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2139 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:01:54.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110173+0000", 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.503e-06 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112023+0000", 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018492490000000001 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112057+0000", 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4360999999999998e-05 2024-04-23T19:01:54.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112071+0000", 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4449e-05 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112162+0000", 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0484999999999998e-05 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112315+0000", 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015275 2024-04-23T19:01:54.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112433+0000", 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118003 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124291+0000", 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011858153999999999 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126259+0000", 2024-04-23T19:01:54.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019684889999999999 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126318+0000", 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9098000000000002e-05 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126375+0000", 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6467e-05 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2153 3.4 e56/20 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.032021092000001, 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014484469999999999, 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254554+0000", 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.767e-06 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256112+0000", 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015583979999999999 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256137+0000", 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4689999999999999e-05 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256149+0000", 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1722999999999999e-05 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256214+0000", 2024-04-23T19:01:54.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5364000000000006e-05 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256239+0000", 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4754000000000001e-05 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.268971+0000", 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012732647 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269037+0000", 2024-04-23T19:01:54.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5127000000000002e-05 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.700964006, 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.304 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:01:54.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:01:54.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:01:54.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.309 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2198 3.2d e56/20 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head v 56'3, mlcod=56'1)", 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.606980216, 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014321115000000001, 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679595+0000", 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1220000000000002e-06 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683327+0000", 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037316139999999999 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683358+0000", 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1183000000000003e-05 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683373+0000", 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.469e-05 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683506+0000", 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013350999999999999 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683550+0000", 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4056e-05 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693802+0000", 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010251532000000001 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693914+0000", 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112408 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2205 3.2d e56/20 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.482782474, 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015864357999999999, 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803793+0000", 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5799999999999999e-06 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807684+0000", 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038911620000000001 2024-04-23T19:01:54.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807718+0000", 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3673000000000001e-05 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807734+0000", 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5913000000000002e-05 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807877+0000", 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014260499999999999 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807927+0000", 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9938999999999997e-05 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819494+0000", 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011567365 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819655+0000", 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112099999999999 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.422250429000002, 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.318 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:54.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2217 3.3d e57/20 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.226697432000002, 2024-04-23T19:01:54.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013378533, 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3799999999999997e-07 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064170+0000", 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042934480000000001 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064200+0000", 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0429e-05 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064214+0000", 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3986e-05 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064305+0000", 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1048e-05 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064327+0000", 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2195e-05 2024-04-23T19:01:54.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073180+0000", 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088524520000000002 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073254+0000", 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4437000000000006e-05 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.327 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2247 3.2e 3:77104512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.876117122, 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018591723000000001, 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2247 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410459+0000", 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.004e-06 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412345+0000", 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001885723 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412378+0000", 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3494999999999997e-05 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412390+0000", 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1402e-05 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412535+0000", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014549699999999999 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412841+0000", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306068 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.413048+0000", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020667600000000001 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.426308+0000", 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013260532 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428861+0000", 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025528600000000001 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428950+0000", 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9124999999999998e-05 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.429048+0000", 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7341000000000002e-05 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2248 3.13 3:cafccc7d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.864827306999999, 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017780271, 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.333 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2248 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421748+0000", 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423913+0000", 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165391 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423945+0000", 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2002000000000003e-05 2024-04-23T19:01:54.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423964+0000", 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8745000000000001e-05 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424049+0000", 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4913999999999994e-05 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424212+0000", 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016343400000000001 2024-04-23T19:01:54.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424325+0000", 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113235 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.431161+0000", 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068358630000000002 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439339+0000", 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081775819999999992 2024-04-23T19:01:54.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439449+0000", 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109744 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439526+0000", 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7498999999999998e-05 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2250 3.21 3:87aecc51:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.834608947, 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017023829000000001, 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2250 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451968+0000", 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5310000000000002e-06 2024-04-23T19:01:54.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454099+0000", 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021313209999999998 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454141+0000", 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2363000000000001e-05 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454163+0000", 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2002999999999999e-05 2024-04-23T19:01:54.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454276+0000", 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112453 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454479+0000", 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020322 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454667+0000", 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018758100000000001 2024-04-23T19:01:54.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.463497+0000", 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008830582 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468850+0000", 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053529809999999997 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468928+0000", 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7832999999999998e-05 2024-04-23T19:01:54.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468988+0000", 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9960999999999997e-05 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2256 3.21 3:849d8eb6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.740185509, 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015796782999999998, 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.344 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2256 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546390+0000", 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.706e-06 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548597+0000", 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022068180000000001 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548634+0000", 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7228999999999999e-05 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548651+0000", 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886999999999999e-05 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548767+0000", 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115738 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548955+0000", 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018769199999999999 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.549161+0000", 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020635799999999999 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.557911+0000", 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087494389999999995 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562055+0000", 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041443369999999997 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562125+0000", 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0090000000000001e-05 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562184+0000", 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9488999999999999e-05 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2259 3.13 3:cbd3cfdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.690613955, 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016674984, 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2259 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595963+0000", 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.597e-06 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598044+0000", 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002080798 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598095+0000", 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848999999999998e-05 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598125+0000", 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9549000000000001e-05 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598276+0000", 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151197 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598667+0000", 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039116800000000001 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598963+0000", 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029514 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.607659+0000", 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008696723 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612305+0000", 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046458209999999996 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612500+0000", 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000194649 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612634+0000", 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013449299999999999 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2264 3.13 3:ca21246b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.632363609999999, 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01879832, 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.355 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2264 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:01:54.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654213+0000", 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1319999999999998e-06 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656725+0000", 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025118319999999999 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656773+0000", 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8641999999999999e-05 2024-04-23T19:01:54.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656802+0000", 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9232999999999999e-05 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656939+0000", 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013616400000000001 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657129+0000", 2024-04-23T19:01:54.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190077 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657315+0000", 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018593700000000001 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.670726+0000", 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013411809 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672902+0000", 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021760220000000001 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672952+0000", 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9243000000000003e-05 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.673008+0000", 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6229e-05 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.475973673999999, 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:01:54.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:01:54.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2283 3.2f 3:f4b34eeb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.365904581999999, 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016414225000000001, 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2283 2024-04-23T19:01:54.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920671+0000", 2024-04-23T19:01:54.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6579999999999998e-06 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922521+0000", 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001849304 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922556+0000", 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5567e-05 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922585+0000", 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8945000000000002e-05 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922689+0000", 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103657 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922794+0000", 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105377 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:54.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922883+0000", 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9029000000000004e-05 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.928429+0000", 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055458039999999997 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937001+0000", 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085721329999999991 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937045+0000", 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3551999999999999e-05 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937083+0000", 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8198999999999998e-05 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.321417905000001, 2024-04-23T19:01:54.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:01:54.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2291 3.2f 3:f4447ec0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.261984007999999, 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018374181999999999, 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.376 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2291 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024592+0000", 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026818+0000", 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002225875 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026846+0000", 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8011999999999999e-05 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026861+0000", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5257e-05 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026959+0000", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7923000000000004e-05 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027146+0000", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187033 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:54.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027316+0000", 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170075 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.033411+0000", 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060947110000000001 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042837+0000", 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094266430000000002 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042908+0000", 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0859999999999996e-05 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042963+0000", 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.112234046000001, 2024-04-23T19:01:54.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:01:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:01:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.387 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:54.388 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:54.389 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:54.389+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:54.489 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:54.485+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:54.519 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:54.519 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:54.519 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:54.520 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:54.533 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:54.591 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:54.589+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:54.653 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:54.653 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:54.653 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:54.667 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:54.713 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:54.714+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:54.763 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:54.788 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:54.788 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:54.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:54.788 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:54.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2132 3.28 e56/20 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head v 56'7, mlcod=52'5)", 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.747310810999998, 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016380967, 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041361+0000", 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3179999999999999e-06 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045289+0000", 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003928132 2024-04-23T19:01:54.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045314+0000", 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4932000000000001e-05 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045327+0000", 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2825e-05 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045395+0000", 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8508000000000002e-05 2024-04-23T19:01:54.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045417+0000", 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057670+0000", 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012252732000000001 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057741+0000", 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1099999999999994e-05 2024-04-23T19:01:54.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2150 3.5 e56/20 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head v 56'3, mlcod=52'1)", 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.560665265000001, 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016970147000000001, 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228010+0000", 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2000000000000002e-06 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232131+0000", 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041208140000000004 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232164+0000", 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2991000000000003e-05 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232180+0000", 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5773999999999998e-05 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232266+0000", 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5572e-05 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232294+0000", 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.798e-05 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244931+0000", 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012637084999999999 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244975+0000", 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4731000000000003e-05 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.556227371999999, 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.797 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:01:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:01:54.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2188 3.2 3:4067ff17:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.254569909000001, 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016815175000000002, 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2188 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534104+0000", 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3890000000000001e-06 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536507+0000", 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024034410000000001 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536542+0000", 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4332999999999998e-05 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536560+0000", 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8481000000000001e-05 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536656+0000", 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5533999999999997e-05 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536831+0000", 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175575 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536999+0000", 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016784800000000001 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.543634+0000", 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066347109999999997 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550835+0000", 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0072007310000000001 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550877+0000", 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999997e-05 2024-04-23T19:01:54.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550916+0000", 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8751999999999998e-05 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.231241107999999, 2024-04-23T19:01:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.815 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2207 3.1e 3:780a1068:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.960219257999999, 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018197270000000001, 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2207 2024-04-23T19:01:54.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828455+0000", 2024-04-23T19:01:54.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.512e-06 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831640+0000", 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003185252 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831706+0000", 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5549000000000005e-05 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831733+0000", 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7809000000000001e-05 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831892+0000", 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159097 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832226+0000", 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033322000000000001 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:54.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832553+0000", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032690300000000002 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.843688+0000", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011135541000000001 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846344+0000", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026557830000000001 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846510+0000", 2024-04-23T19:01:54.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165766 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846648+0000", 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013883799999999999 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.829705199999999, 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:01:54.821 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.826 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.782730733000001, 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.827 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:01:54.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:01:54.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:54.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:01:54.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.722550943000002, 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:01:54.832 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:01:54.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.836 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2237 3.2 3:428ac9ed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.489228284999999, 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016445471, 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2237 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299446+0000", 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1520000000000002e-06 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.838 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302644+0000", 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031979460000000001 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302685+0000", 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0525000000000002e-05 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302702+0000", 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6877000000000001e-05 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302823+0000", 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121805 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303049+0000", 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022504799999999999 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303364+0000", 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031515900000000002 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.311910+0000", 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085464210000000002 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315716+0000", 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038055810000000002 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315812+0000", 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6458000000000004e-05 2024-04-23T19:01:54.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315888+0000", 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499000000000003e-05 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.410058036999999, 2024-04-23T19:01:54.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:01:54.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:01:54.847 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2258 3.29 3:94133d0c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.215061290000001, 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016616373, 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.848 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2258 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573613+0000", 2024-04-23T19:01:54.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.45e-06 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575917+0000", 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023045840000000001 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575976+0000", 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8556e-05 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575997+0000", 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0761999999999999e-05 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576108+0000", 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111972 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576302+0000", 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019340899999999999 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.851 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576488+0000", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018585800000000001 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.584483+0000", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079952800000000004 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590103+0000", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056203709999999999 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590172+0000", 2024-04-23T19:01:54.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8613000000000002e-05 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590226+0000", 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3517999999999998e-05 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.169231711999998, 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:01:54.853 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.858 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.140833916999998, 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.862 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.067843071999999, 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.864 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.865 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:01:54.866 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:01:54.867 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.938481930000002, 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.868 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.869 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.870 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.871 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.872 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.873 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2292 3.38 3:1e95effa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.752025195000002, 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017689090000000001, 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2292 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.874 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036648+0000", 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.875 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038325+0000", 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00167702 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038352+0000", 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7027000000000001e-05 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038362+0000", 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0185e-05 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.876 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038440+0000", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8004999999999996e-05 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038621+0000", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018072499999999999 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038783+0000", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016250999999999999 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.877 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.050696+0000", 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011913105 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054217+0000", 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035209099999999999 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054283+0000", 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5506000000000006e-05 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.878 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054334+0000", 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1743000000000002e-05 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.732571775, 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.879 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.880 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.881 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.882 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.883 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2306 3.3c e57/20 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head v 57'6, mlcod=57'4)", 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:01:54.884 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.59821195, 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016887030000000001, 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.885 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190460+0000", 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.519e-06 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194624+0000", 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041640540000000004 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194650+0000", 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6041e-05 2024-04-23T19:01:54.886 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194663+0000", 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2986000000000001e-05 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194742+0000", 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8827999999999998e-05 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194774+0000", 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2500999999999999e-05 2024-04-23T19:01:54.887 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207187+0000", 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012412309 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207346+0000", 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015879199999999999 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.888 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2307 3.29 3:9750f0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.594830013999999, 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016969273, 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2307 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:54.889 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193844+0000", 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2140000000000001e-06 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:54.890 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195694+0000", 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018506519999999999 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195714+0000", 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9213000000000001e-05 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195726+0000", 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2221999999999999e-05 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:54.891 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195803+0000", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7183999999999998e-05 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195935+0000", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013161299999999999 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.196030+0000", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5032999999999996e-05 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207642+0000", 2024-04-23T19:01:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011612788000000001 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210690+0000", 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030474299999999998 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210758+0000", 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8514000000000002e-05 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210810+0000", 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1409999999999997e-05 2024-04-23T19:01:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:54.894 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:54.895 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:54.896 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:54.894+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:54.905 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:54.906 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:54.923 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:54.923 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:54.939 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:54.939 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:54.955 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:54.955 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:54.976 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:54.976 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:54.996 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:54.994+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:54.996 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:54.996 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:55.017 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:55.017 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:55.026 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:55.026 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:55.036 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:55.036 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:55.041 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:55.101 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:55.102+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:55.163 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:55.163 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:55.177 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:55.222 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:55.221+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:55.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:01:55.297 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:55.297 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:55.297 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:55.298+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:55.312 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:55.402 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:55.401+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:55.476 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:55.476 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:55.491 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:55.534 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:55.533+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:55.600 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:55.597+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:55.658 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:55.659 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:55.672 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:01:55.718 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:55.717+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:55.803 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:55.801+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:55.834 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:55.834 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:55.849 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:01:55.904 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:55.902+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:56.004 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:56.001+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:56.006 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:56.006 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:56.021 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:01:56.106 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:56.105+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:56.172 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:56.173 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:56.185 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:01:56.207 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:56.206+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:56.221 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:01:56.307 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:56.305+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:56.349 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:56.349 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:56.363 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:01:56.408 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:56.405+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:56.509 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:56.505+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:56.529 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:56.529 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:56.543 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:01:56.634 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:56.633+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:56.701 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:56.701 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:56.711 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:56.710+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:56.713 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:01:56.812 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:56.809+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:56.874 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:56.874 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:56.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:01:56.930 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:56.929+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:57.014 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:57.014+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:57.022 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:57.023 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:57.037 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:01:57.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:01:57.115 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:57.113+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:57.209 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:57.210 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:57.216 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:57.213+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:57.227 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:01:57.234 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:57.234 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:57.253 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:57.254 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:57.284 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:57.285 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:57.307 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:57.307 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:57.316 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:57.313+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:57.328 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:57.328 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:57.349 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:57.349 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:1243 3.2b 3:d4dc8264:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.2__shadow_.BjXkXaByl6qrihWGgdj-cya8HHvCr3t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:01:57.360 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.540029277999999, 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016938254999999999, 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 1243 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821416+0000", 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.821419+0000", 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9289999999999998e-06 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824120+0000", 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0027012009999999999 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824153+0000", 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2663999999999998e-05 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824168+0000", 2024-04-23T19:01:57.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5747999999999999e-05 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824249+0000", 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0492000000000001e-05 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824367+0000", 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117768 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.824480+0000", 2024-04-23T19:01:57.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011374699999999999 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.836387+0000", 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011906699999999999 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838288+0000", 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001900606 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838322+0000", 2024-04-23T19:01:57.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4363000000000003e-05 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:21.838354+0000", 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2036999999999998e-05 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.535594618000001, 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:01:57.366 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:01:57.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:01:57.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:01:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:01:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:01:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:01:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2114 3.1 3:8002664d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.506456378999999, 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017114279, 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.374 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2114 2024-04-23T19:01:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854989+0000", 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.854992+0000", 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5080000000000001e-06 2024-04-23T19:01:57.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856342+0000", 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001349299 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856377+0000", 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5281000000000003e-05 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856392+0000", 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4739999999999999e-05 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856485+0000", 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3214999999999994e-05 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856617+0000", 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013243099999999999 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.856748+0000", 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013113799999999999 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.862501+0000", 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057523319999999998 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871755+0000", 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092546959999999998 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.871911+0000", 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015593700000000001 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.872103+0000", 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191702 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2117 3.12 3:4a6ac759:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.381 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.476918183999999, 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013830090999999999, 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2117 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:57.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884527+0000", 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.884530+0000", 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9040000000000001e-06 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886120+0000", 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001589823 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886143+0000", 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159999999999998e-05 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886152+0000", 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3409999999999992e-06 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886218+0000", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6157999999999999e-05 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886341+0000", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012245100000000001 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.886461+0000", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120381 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.892686+0000", 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062244099999999997 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898130+0000", 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054443349999999998 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898186+0000", 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6199999999999997e-05 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.898357+0000", 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017092799999999999 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2121 3.12 3:4ab0d216:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.438820247999999, 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015267064, 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.387 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2121 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922625+0000", 2024-04-23T19:01:57.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.922628+0000", 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6639999999999998e-06 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924374+0000", 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017465239999999999 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924405+0000", 2024-04-23T19:01:57.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1035999999999999e-05 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924420+0000", 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4552000000000001e-05 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924517+0000", 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6953999999999994e-05 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924704+0000", 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187073 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.924878+0000", 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017427299999999999 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.933464+0000", 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085861029999999994 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937770+0000", 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043062389999999999 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937839+0000", 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8887999999999995e-05 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.937892+0000", 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2757999999999999e-05 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2127 3.12 3:49e657d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.375493308999999, 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014820902, 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2127 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.393 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985952+0000", 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.985954+0000", 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4169999999999999e-06 2024-04-23T19:01:57.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987681+0000", 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001726265 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987709+0000", 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8496e-05 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987723+0000", 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4433000000000001e-05 2024-04-23T19:01:57.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987794+0000", 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0783000000000003e-05 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.987915+0000", 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120518 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.988028+0000", 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113268 2024-04-23T19:01:57.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.994241+0000", 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062126689999999997 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000685+0000", 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064444890000000003 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000731+0000", 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5562999999999997e-05 2024-04-23T19:01:57.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000773+0000", 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2001e-05 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2143 3.1 3:818c3cf4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.211364322000001, 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014844245000000001, 2024-04-23T19:01:57.398 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2143 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150081+0000", 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.150084+0000", 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2600000000000001e-06 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151570+0000", 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014861189999999999 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151604+0000", 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151621+0000", 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6144e-05 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151697+0000", 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6377000000000004e-05 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151869+0000", 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017231000000000001 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.151968+0000", 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8455999999999994e-05 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.159112+0000", 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071439989999999998 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164808+0000", 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005696301 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164872+0000", 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3615999999999995e-05 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.164925+0000", 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3439000000000001e-05 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.403 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2144 3.1 3:822f1bc9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.201377528999998, 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01381895, 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.404 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2144 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160068+0000", 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.160069+0000", 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8679999999999999e-06 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161620+0000", 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015505709999999999 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161644+0000", 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4269000000000001e-05 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161655+0000", 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161722+0000", 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7409000000000005e-05 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161859+0000", 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013668099999999999 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:57.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.161961+0000", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102273 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.168267+0000", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063061339999999997 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173766+0000", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054986849999999997 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173835+0000", 2024-04-23T19:01:57.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9140999999999994e-05 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.173887+0000", 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1480999999999997e-05 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2157 3.10 e56/20 3:0839e1f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_56:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.062644992999999, 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014718479, 2024-04-23T19:01:57.409 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298800+0000", 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.298802+0000", 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.869e-06 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302934+0000", 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041324459999999997 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302962+0000", 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7302000000000001e-05 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.302975+0000", 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3349999999999999e-05 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303059+0000", 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3782999999999994e-05 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.303086+0000", 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7436999999999998e-05 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313460+0000", 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010373408000000001 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.313519+0000", 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8884000000000001e-05 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2161 3.12 3:4ba64ee9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.413 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.021058886999999, 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016255067000000002, 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2161 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340386+0000", 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.340390+0000", 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.455e-06 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342958+0000", 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025682109999999999 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.342988+0000", 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0199999999999999e-05 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343002+0000", 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3769e-05 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343083+0000", 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0687999999999997e-05 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343237+0000", 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015475600000000001 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.343340+0000", 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000102834 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.349457+0000", 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061166229999999999 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356502+0000", 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070452609999999997 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356576+0000", 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3526e-05 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.356641+0000", 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5743999999999999e-05 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.446693434, 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.419 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:01:57.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:01:57.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:01:57.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2215 3.b e56/20 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.351386011999999, 2024-04-23T19:01:57.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015142766, 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010059+0000", 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.010061+0000", 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2520000000000002e-06 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013225+0000", 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003163622 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013274+0000", 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9471000000000001e-05 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013298+0000", 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3628000000000001e-05 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013434+0000", 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013560699999999999 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.013475+0000", 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0938e-05 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025068+0000", 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011593440999999999 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025202+0000", 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000133807 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.427 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.316530605000001, 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:01:57.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:01:57.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:01:57.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2233 3.3a e57/20 3:5c6ef8e1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_122:head v 57'3, mlcod=53'1)", 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.109453382000002, 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014404780000000001, 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251992+0000", 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.251994+0000", 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.784e-06 2024-04-23T19:01:57.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255871+0000", 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00387762 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255901+0000", 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9901000000000001e-05 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.255914+0000", 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.328e-05 2024-04-23T19:01:57.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256041+0000", 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012621299999999999 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.256080+0000", 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9245000000000001e-05 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266324+0000", 2024-04-23T19:01:57.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010244659999999999 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.266397+0000", 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2076999999999994e-05 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:57.438 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.979022050000001, 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:01:57.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2251 3.32 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.894783655000001, 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015905636000000001, 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.443 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2251 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466662+0000", 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.466664+0000", 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469135+0000", 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002470164 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469164+0000", 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9115000000000002e-05 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469182+0000", 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8726999999999999e-05 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469306+0000", 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012313600000000001 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469497+0000", 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019168399999999999 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469679+0000", 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018196600000000001 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.476311+0000", 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066314629999999998 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482438+0000", 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061275449999999999 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482508+0000", 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9795999999999994e-05 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482567+0000", 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9166999999999998e-05 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2265 3.32 3:4d8b1756:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.696322992999999, 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013967738, 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2265 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665122+0000", 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.665125+0000", 2024-04-23T19:01:57.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1769999999999998e-06 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667169+0000", 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020441040000000001 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667217+0000", 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7262000000000003e-05 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667245+0000", 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7888000000000001e-05 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667343+0000", 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8782000000000004e-05 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667487+0000", 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143597 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.667644+0000", 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697700000000001 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678434+0000", 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010789801 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.678995+0000", 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000560802 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679045+0000", 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0868000000000002e-05 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.679090+0000", 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4480000000000001e-05 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.454 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.291899081, 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.455 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.460 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2298 3.3e e57/20 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.260627857999999, 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015216608, 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100817+0000", 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100819+0000", 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.672e-06 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102788+0000", 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019685979999999998 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102812+0000", 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4012e-05 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102825+0000", 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3288999999999999e-05 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102919+0000", 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4561000000000005e-05 2024-04-23T19:01:57.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.102950+0000", 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0434e-05 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.115979+0000", 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013028889 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116034+0000", 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5152999999999999e-05 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2304 3.12 3:4b60d7e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.198651929, 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014756422, 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.465 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2304 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162793+0000", 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.162794+0000", 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2449999999999999e-06 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164305+0000", 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015100770000000001 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164334+0000", 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9132000000000002e-05 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164348+0000", 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4378e-05 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164439+0000", 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0886999999999999e-05 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164635+0000", 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019567799999999999 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.164810+0000", 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175448 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.171513+0000", 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067025660000000001 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177452+0000", 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0059398400000000001 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177497+0000", 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4282000000000001e-05 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.177550+0000", 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2889000000000001e-05 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.470 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.471 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.471 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:57.472 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:57.472 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:57.473 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:01:57.473 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:57.474 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:57.474 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:57.470+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:57.573 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:57.574+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:57.648 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:57.648 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:57.648 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:57.659 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records in 2024-04-23T19:01:57.659 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records out 2024-04-23T19:01:57.659 INFO:tasks.workunit.client.0.smithi169.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 20.2859 s, 103 MB/s 2024-04-23T19:01:57.662 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:01:57.705 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:57.706+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:57.777 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:57.773+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:57.837 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:57.837 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:57.837 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:57.837 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:57.837 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:57.841 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_01_57 2024-04-23T19:01:57.852 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:01:57.878 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:57.877+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:57.978 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:01:57.978+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:01:57.979 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:57.979 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 98.691092960999995, 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:01:57.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:01:57.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:01:57.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2123 3.0 3:0261d0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.037890461, 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015185707999999999, 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2123 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.985 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942998+0000", 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8210000000000002e-06 2024-04-23T19:01:57.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944838+0000", 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018401769999999999 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944863+0000", 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4899999999999999e-05 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944874+0000", 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0926e-05 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944942+0000", 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7428999999999994e-05 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945070+0000", 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012833899999999999 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945175+0000", 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010466100000000001 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.957371+0000", 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012196864 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958106+0000", 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00073463499999999998 2024-04-23T19:01:57.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958147+0000", 2024-04-23T19:01:57.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0506000000000001e-05 2024-04-23T19:01:57.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958181+0000", 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4449999999999997e-05 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.728491269999999, 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.991 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:01:57.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:57.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:57.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:57.996 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2162 3.25 3:a68bdb79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.630642917999999, 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014496184, 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2162 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.997 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:57.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350245+0000", 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6249999999999999e-06 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351950+0000", 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001704721 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351984+0000", 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:57.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352000+0000", 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5662e-05 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352094+0000", 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3715999999999995e-05 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352285+0000", 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019128799999999999 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:58.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352456+0000", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017101200000000001 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364058+0000", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011602128 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364650+0000", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059187900000000002 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364688+0000", 2024-04-23T19:01:58.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7515999999999998e-05 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364739+0000", 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1412999999999997e-05 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2171 3.31 3:8c201035:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.525392205999999, 2024-04-23T19:01:58.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015626368000000002, 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2171 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455496+0000", 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8949999999999998e-06 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457275+0000", 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017788330000000001 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457301+0000", 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6024999999999999e-05 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457313+0000", 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1877e-05 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457386+0000", 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3109999999999996e-05 2024-04-23T19:01:58.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457527+0000", 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014033399999999999 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457656+0000", 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129789 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.464144+0000", 2024-04-23T19:01:58.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064880069999999996 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471010+0000", 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068660070000000004 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471056+0000", 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5943999999999999e-05 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471120+0000", 2024-04-23T19:01:58.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3547000000000007e-05 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2187 3.1f 3:fb7660b3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.457505704999999, 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014170726, 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.008 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2187 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523384+0000", 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8530000000000002e-06 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525403+0000", 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020189000000000001 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525440+0000", 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6979e-05 2024-04-23T19:01:58.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525453+0000", 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3005e-05 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525563+0000", 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109985 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525789+0000", 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022658800000000001 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525988+0000", 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000198409 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536623+0000", 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010635109 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537400+0000", 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077722900000000005 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537466+0000", 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5518999999999994e-05 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537551+0000", 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5149999999999996e-05 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:58.013 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.413878605000001, 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.018 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2200 3.1a e56/20 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head v 56'3, mlcod=52'1)", 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.272631195999999, 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016149459000000001, 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708257+0000", 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.666e-06 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712912+0000", 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004654661 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712947+0000", 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5612999999999999e-05 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712965+0000", 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-05 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713105+0000", 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140264 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713170+0000", 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4974999999999994e-05 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724310+0000", 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011139935 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724404+0000", 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4005000000000005e-05 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.12226592, 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:01:58.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:01:58.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.045317147999999, 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:01:58.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:01:58.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:01:58.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2229 3.31 3:8ced272b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.776624264999999, 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012661527000000001, 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2229 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204264+0000", 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6649999999999999e-06 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205798+0000", 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001534349 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205838+0000", 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9258000000000003e-05 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205855+0000", 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7532000000000001e-05 2024-04-23T19:01:58.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205962+0000", 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010679 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206143+0000", 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000180559 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206304+0000", 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016126500000000001 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.213214+0000", 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069100849999999998 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216772+0000", 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035580210000000002 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216855+0000", 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2996000000000003e-05 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216923+0000", 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8007000000000001e-05 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2243 3.25 3:a47da34a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.613018884999999, 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016498994999999999, 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.038 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2243 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367870+0000", 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4479999999999999e-06 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370547+0000", 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026765270000000002 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370583+0000", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5710999999999997e-05 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370598+0000", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5726000000000002e-05 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370683+0000", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4819000000000002e-05 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370832+0000", 2024-04-23T19:01:58.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014911899999999999 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370992+0000", 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159815 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381097+0000", 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010105042999999999 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384082+0000", 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029852009999999998 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384244+0000", 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016155999999999999 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384366+0000", 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122026 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2245 3.0 3:03deb7e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.590884607, 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015195145, 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.044 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2245 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390004+0000", 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9679999999999998e-06 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392079+0000", 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020753759999999999 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392103+0000", 2024-04-23T19:01:58.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3479e-05 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392116+0000", 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2761e-05 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392224+0000", 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107904 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392428+0000", 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000204186 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392635+0000", 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020687200000000001 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404314+0000", 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011679144000000001 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405073+0000", 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075964499999999998 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405143+0000", 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9394999999999995e-05 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405196+0000", 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3415000000000003e-05 2024-04-23T19:01:58.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2251 3.32 e57/20 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head v 57'2, mlcod=0'0)", 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.511040993000002, 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012365898, 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:01:58.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.44e-07 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471716+0000", 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018707960000000001 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471751+0000", 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622999999999997e-05 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471769+0000", 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8508e-05 2024-04-23T19:01:58.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471919+0000", 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149853 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471968+0000", 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9066000000000001e-05 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482090+0000", 2024-04-23T19:01:58.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122160999999999 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482211+0000", 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120347 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2254 3.1a e57/20 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head v 57'5, mlcod=56'3)", 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.460732862, 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016447765, 2024-04-23T19:01:58.054 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520156+0000", 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6429999999999999e-06 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524703+0000", 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045476930000000002 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524732+0000", 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8551000000000002e-05 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524745+0000", 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3124e-05 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524844+0000", 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8721999999999994e-05 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524878+0000", 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4839000000000003e-05 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536495+0000", 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011616912 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536601+0000", 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105281 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2278 3.8 e57/20 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head v 57'3, mlcod=56'1)", 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.128058904, 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016293365000000001, 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852829+0000", 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9549999999999999e-06 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855964+0000", 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003135035 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855993+0000", 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9369999999999998e-05 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856007+0000", 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3696999999999999e-05 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856132+0000", 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125313 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856188+0000", 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6164e-05 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.868860+0000", 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012671319 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869120+0000", 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026051200000000002 2024-04-23T19:01:58.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.119631207000001, 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2280 3.25 3:a4e9d83c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.104036514000001, 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014342169, 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2280 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.069 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876852+0000", 2024-04-23T19:01:58.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.305e-06 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878784+0000", 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001932465 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878822+0000", 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7654999999999998e-05 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878844+0000", 2024-04-23T19:01:58.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2124999999999999e-05 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878935+0000", 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1154000000000002e-05 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879107+0000", 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172199 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879257+0000", 2024-04-23T19:01:58.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015013200000000001 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.889696+0000", 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010438523999999999 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891118+0000", 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014217640000000001 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891156+0000", 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8597000000000003e-05 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891191+0000", 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5249000000000001e-05 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:58.074 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.882346312999999, 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:58.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2300 3.25 3:a433329a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 21.857846982000002, 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012342531, 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2300 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123042+0000", 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2289999999999999e-06 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125053+0000", 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020108349999999999 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125088+0000", 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5472000000000002e-05 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125106+0000", 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7207e-05 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125188+0000", 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2473999999999997e-05 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125327+0000", 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013878299999999999 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125436+0000", 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010893200000000001 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.134793+0000", 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0093574209999999994 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135267+0000", 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047370000000000002 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135330+0000", 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135381+0000", 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1567000000000003e-05 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.086 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:58.087 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:01:58.088 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:01:58.085+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:01:58.144 INFO:tasks.workunit.client.0.smithi169.stdout:bucket quota max size set for the given user: buck_2024_03_23_19_01_57 2024-04-23T19:01:58.188 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:58.185+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:58.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:01:58.259 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.5700.0:54 7.3 e69/28 7:c609908c:::notify.5:head v 69'102, mlcod=69'100)", 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:58.262422+0000", 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.2198000000000001e-05, 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116999, 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262422+0000", 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262422+0000", 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262423+0000", 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7599999999999996e-07 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262428+0000", 2024-04-23T19:01:58.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0350000000000001e-06 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262437+0000", 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1069999999999994e-06 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262441+0000", 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3409999999999996e-06 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262492+0000", 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0696999999999999e-05 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:58.262515+0000", 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2690000000000001e-05 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 1 2024-04-23T19:01:58.263 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:58.279 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:01:58.321 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:58.322+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:58.390 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:58.389+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:58.431 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:58.431 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:58.431 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:58.431 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:58.432 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:58.445 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:01:58.491 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:58.490+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:58.555 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:58.555 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2128 3.9 e56/20 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.556031376, 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015323256, 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000715+0000", 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.477e-06 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004783+0000", 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040687689999999999 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004810+0000", 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6999999999999999e-05 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004822+0000", 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1768e-05 2024-04-23T19:01:58.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004888+0000", 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6135000000000003e-05 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004905+0000", 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7201e-05 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.015977+0000", 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011072039000000001 2024-04-23T19:01:58.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.016036+0000", 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8866999999999997e-05 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2138 3.9 e56/20 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head v 56'2, mlcod=0'0)", 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.447454663999999, 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015486679999999999, 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.560 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109292+0000", 2024-04-23T19:01:58.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1639999999999999e-06 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113331+0000", 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040388969999999996 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113352+0000", 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1520000000000001e-05 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113364+0000", 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1548e-05 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113429+0000", 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5455000000000003e-05 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113451+0000", 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1393999999999999e-05 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124722+0000", 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011271458999999999 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124776+0000", 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4243000000000002e-05 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2139 3.13 3:cab0dc9f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.446573531999999, 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016204007999999999, 2024-04-23T19:01:58.564 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2139 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110173+0000", 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.503e-06 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112023+0000", 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018492490000000001 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112057+0000", 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4360999999999998e-05 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112071+0000", 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4449e-05 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112162+0000", 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0484999999999998e-05 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112315+0000", 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015275 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112433+0000", 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118003 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124291+0000", 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011858153999999999 2024-04-23T19:01:58.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126259+0000", 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019684889999999999 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126318+0000", 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9098000000000002e-05 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126375+0000", 2024-04-23T19:01:58.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6467e-05 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2153 3.4 e56/20 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head v 56'1, mlcod=0'0)", 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.302192322, 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014484469999999999, 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254554+0000", 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.767e-06 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256112+0000", 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015583979999999999 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256137+0000", 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4689999999999999e-05 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256149+0000", 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1722999999999999e-05 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256214+0000", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5364000000000006e-05 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256239+0000", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4754000000000001e-05 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.268971+0000", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012732647 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269037+0000", 2024-04-23T19:01:58.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5127000000000002e-05 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.971135235999999, 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.574 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2198 3.2d e56/20 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head v 56'3, mlcod=56'1)", 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.877151445999999, 2024-04-23T19:01:58.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014321115000000001, 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679595+0000", 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1220000000000002e-06 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683327+0000", 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037316139999999999 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683358+0000", 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1183000000000003e-05 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683373+0000", 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.469e-05 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683506+0000", 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013350999999999999 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683550+0000", 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4056e-05 2024-04-23T19:01:58.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693802+0000", 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010251532000000001 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693914+0000", 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112408 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2205 3.2d e56/20 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:58.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.752953703999999, 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015864357999999999, 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803793+0000", 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5799999999999999e-06 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807684+0000", 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038911620000000001 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807718+0000", 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3673000000000001e-05 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807734+0000", 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5913000000000002e-05 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807877+0000", 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014260499999999999 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807927+0000", 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9938999999999997e-05 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819494+0000", 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011567365 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819655+0000", 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112099999999999 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.587 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.692421659000001, 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:01:58.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:01:58.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:01:58.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:01:58.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2217 3.3d e57/20 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.496868662000001, 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013378533, 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3799999999999997e-07 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064170+0000", 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042934480000000001 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064200+0000", 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0429e-05 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064214+0000", 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3986e-05 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064305+0000", 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1048e-05 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064327+0000", 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2195e-05 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073180+0000", 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088524520000000002 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073254+0000", 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4437000000000006e-05 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2247 3.2e 3:77104512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.146288351999999, 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018591723000000001, 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.597 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2247 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410459+0000", 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.004e-06 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412345+0000", 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001885723 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412378+0000", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3494999999999997e-05 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412390+0000", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1402e-05 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412535+0000", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014549699999999999 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412841+0000", 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306068 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.413048+0000", 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020667600000000001 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.426308+0000", 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013260532 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428861+0000", 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025528600000000001 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428950+0000", 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9124999999999998e-05 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.429048+0000", 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7341000000000002e-05 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.602 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2248 3.13 3:cafccc7d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.134998537000001, 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017780271, 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2248 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.603 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421748+0000", 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423913+0000", 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165391 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423945+0000", 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2002000000000003e-05 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423964+0000", 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8745000000000001e-05 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424049+0000", 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4913999999999994e-05 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424212+0000", 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016343400000000001 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424325+0000", 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113235 2024-04-23T19:01:58.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.431161+0000", 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068358630000000002 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439339+0000", 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081775819999999992 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439449+0000", 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109744 2024-04-23T19:01:58.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439526+0000", 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7498999999999998e-05 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2250 3.21 3:87aecc51:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.104780176999999, 2024-04-23T19:01:58.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017023829000000001, 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2250 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451968+0000", 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5310000000000002e-06 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454099+0000", 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021313209999999998 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454141+0000", 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2363000000000001e-05 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454163+0000", 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2002999999999999e-05 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454276+0000", 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112453 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454479+0000", 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020322 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454667+0000", 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018758100000000001 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.463497+0000", 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008830582 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468850+0000", 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053529809999999997 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468928+0000", 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7832999999999998e-05 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468988+0000", 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9960999999999997e-05 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.613 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2256 3.21 3:849d8eb6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.010356738999999, 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015796782999999998, 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2256 2024-04-23T19:01:58.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546390+0000", 2024-04-23T19:01:58.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.706e-06 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548597+0000", 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022068180000000001 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548634+0000", 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7228999999999999e-05 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548651+0000", 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886999999999999e-05 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548767+0000", 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115738 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548955+0000", 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018769199999999999 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.549161+0000", 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020635799999999999 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.557911+0000", 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087494389999999995 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562055+0000", 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041443369999999997 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562125+0000", 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0090000000000001e-05 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562184+0000", 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9488999999999999e-05 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.619 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2259 3.13 3:cbd3cfdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.960785184999999, 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016674984, 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2259 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595963+0000", 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.597e-06 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598044+0000", 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002080798 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598095+0000", 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848999999999998e-05 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598125+0000", 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9549000000000001e-05 2024-04-23T19:01:58.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598276+0000", 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151197 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598667+0000", 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039116800000000001 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598963+0000", 2024-04-23T19:01:58.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029514 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.607659+0000", 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008696723 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612305+0000", 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046458209999999996 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612500+0000", 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000194649 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612634+0000", 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013449299999999999 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2264 3.13 3:ca21246b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.902534840000001, 2024-04-23T19:01:58.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01879832, 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2264 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:01:58.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654213+0000", 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1319999999999998e-06 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656725+0000", 2024-04-23T19:01:58.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025118319999999999 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656773+0000", 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8641999999999999e-05 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656802+0000", 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9232999999999999e-05 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656939+0000", 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013616400000000001 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657129+0000", 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190077 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657315+0000", 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018593700000000001 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.670726+0000", 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013411809 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672902+0000", 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021760220000000001 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672952+0000", 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9243000000000003e-05 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.673008+0000", 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6229e-05 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.746144904000001, 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:01:58.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:01:58.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2283 3.2f 3:f4b34eeb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.636075812000001, 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016414225000000001, 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.635 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2283 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920671+0000", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6579999999999998e-06 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922521+0000", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001849304 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922556+0000", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5567e-05 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922585+0000", 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8945000000000002e-05 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922689+0000", 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103657 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922794+0000", 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105377 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922883+0000", 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9029000000000004e-05 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.928429+0000", 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055458039999999997 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937001+0000", 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085721329999999991 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937045+0000", 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3551999999999999e-05 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937083+0000", 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8198999999999998e-05 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.640 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.591589135, 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:01:58.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2291 3.2f 3:f4447ec0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.532155238000001, 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018374181999999999, 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.646 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2291 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024592+0000", 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026818+0000", 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002225875 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026846+0000", 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8011999999999999e-05 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026861+0000", 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5257e-05 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026959+0000", 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7923000000000004e-05 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027146+0000", 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187033 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027316+0000", 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170075 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.033411+0000", 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060947110000000001 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042837+0000", 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094266430000000002 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042908+0000", 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0859999999999996e-05 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042963+0000", 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.651 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.382405276, 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:01:58.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:01:58.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:01:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:01:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:01:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:58.657 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:58.659 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:01:58.659 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:58.658+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:58.759 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:58.761+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:58.814 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:58.814 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:01:58.814 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:58.827 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:01:58.860 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:58.861+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:58.947 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:58.947 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:01:58.947 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:01:58.947 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:01:58.947 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:58.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:01:58.962 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:01:58.957+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:01:59.061 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:01:59.062+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:01:59.072 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2132 3.28 e56/20 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head v 56'7, mlcod=52'5)", 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 25.032669165000001, 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016380967, 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.073 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041361+0000", 2024-04-23T19:01:59.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3179999999999999e-06 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045289+0000", 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003928132 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045314+0000", 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4932000000000001e-05 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045327+0000", 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2825e-05 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045395+0000", 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8508000000000002e-05 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045417+0000", 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057670+0000", 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012252732000000001 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057741+0000", 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1099999999999994e-05 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2150 3.5 e56/20 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head v 56'3, mlcod=52'1)", 2024-04-23T19:01:59.077 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.846023619, 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016970147000000001, 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228010+0000", 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2000000000000002e-06 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232131+0000", 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041208140000000004 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232164+0000", 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2991000000000003e-05 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232180+0000", 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5773999999999998e-05 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232266+0000", 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5572e-05 2024-04-23T19:01:59.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232294+0000", 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.798e-05 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244931+0000", 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012637084999999999 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244975+0000", 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4731000000000003e-05 2024-04-23T19:01:59.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.841585726000002, 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2188 3.2 3:4067ff17:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.539928263, 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016815175000000002, 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2188 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534104+0000", 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3890000000000001e-06 2024-04-23T19:01:59.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536507+0000", 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024034410000000001 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536542+0000", 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4332999999999998e-05 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536560+0000", 2024-04-23T19:01:59.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8481000000000001e-05 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536656+0000", 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5533999999999997e-05 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536831+0000", 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175575 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536999+0000", 2024-04-23T19:01:59.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016784800000000001 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.543634+0000", 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066347109999999997 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550835+0000", 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0072007310000000001 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550877+0000", 2024-04-23T19:01:59.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999997e-05 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550916+0000", 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8751999999999998e-05 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.516599461999999, 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:01:59.093 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:01:59.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:01:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2207 3.1e 3:780a1068:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.245577612000002, 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018197270000000001, 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.099 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2207 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828455+0000", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.512e-06 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831640+0000", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003185252 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831706+0000", 2024-04-23T19:01:59.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5549000000000005e-05 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831733+0000", 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7809000000000001e-05 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831892+0000", 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159097 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832226+0000", 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033322000000000001 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832553+0000", 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032690300000000002 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.843688+0000", 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011135541000000001 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846344+0000", 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026557830000000001 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846510+0000", 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165766 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846648+0000", 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013883799999999999 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.115063553999999, 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:01:59.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:01:59.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:01:59.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:01:59.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.068089087000001, 2024-04-23T19:01:59.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:01:59.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:01:59.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.007909297000001, 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2237 3.2 3:428ac9ed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.120 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.774586638999999, 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016445471, 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2237 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299446+0000", 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1520000000000002e-06 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302644+0000", 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031979460000000001 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302685+0000", 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0525000000000002e-05 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302702+0000", 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6877000000000001e-05 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302823+0000", 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121805 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303049+0000", 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022504799999999999 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303364+0000", 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031515900000000002 2024-04-23T19:01:59.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.311910+0000", 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085464210000000002 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315716+0000", 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038055810000000002 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315812+0000", 2024-04-23T19:01:59.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6458000000000004e-05 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315888+0000", 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499000000000003e-05 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.695416390999998, 2024-04-23T19:01:59.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:01:59.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:01:59.131 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2258 3.29 3:94133d0c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.500419644000001, 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016616373, 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.132 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2258 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573613+0000", 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.45e-06 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575917+0000", 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023045840000000001 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575976+0000", 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8556e-05 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575997+0000", 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0761999999999999e-05 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576108+0000", 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111972 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576302+0000", 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019340899999999999 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576488+0000", 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018585800000000001 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.584483+0000", 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079952800000000004 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590103+0000", 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056203709999999999 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590172+0000", 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8613000000000002e-05 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590226+0000", 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3517999999999998e-05 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.137 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.454590066000002, 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.426192271000001, 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.143 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:01:59.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:01:59.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:01:59.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.353201425999998, 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:01:59.147 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:01:59.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.152 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.223840284000001, 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.153 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:01:59.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:01:59.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2292 3.38 3:1e95effa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.037383549000001, 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017689090000000001, 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2292 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036648+0000", 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038325+0000", 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00167702 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038352+0000", 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7027000000000001e-05 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038362+0000", 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0185e-05 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038440+0000", 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8004999999999996e-05 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038621+0000", 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018072499999999999 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038783+0000", 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016250999999999999 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.050696+0000", 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011913105 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054217+0000", 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035209099999999999 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054283+0000", 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5506000000000006e-05 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054334+0000", 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1743000000000002e-05 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.017930129, 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.164 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:01:59.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:01:59.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:01:59.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2306 3.3c e57/20 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head v 57'6, mlcod=57'4)", 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.883570303999999, 2024-04-23T19:01:59.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016887030000000001, 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190460+0000", 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.519e-06 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194624+0000", 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041640540000000004 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194650+0000", 2024-04-23T19:01:59.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6041e-05 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194663+0000", 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2986000000000001e-05 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194742+0000", 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8827999999999998e-05 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194774+0000", 2024-04-23T19:01:59.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2500999999999999e-05 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207187+0000", 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012412309 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207346+0000", 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015879199999999999 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2307 3.29 3:9750f0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.880188367999999, 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016969273, 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2307 2024-04-23T19:01:59.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:01:59.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193844+0000", 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2140000000000001e-06 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195694+0000", 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018506519999999999 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195714+0000", 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9213000000000001e-05 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195726+0000", 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2221999999999999e-05 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195803+0000", 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7183999999999998e-05 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195935+0000", 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013161299999999999 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.196030+0000", 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5032999999999996e-05 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207642+0000", 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011612788000000001 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210690+0000", 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030474299999999998 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210758+0000", 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8514000000000002e-05 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210810+0000", 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1409999999999997e-05 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:01:59.180 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:01:59.182 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:01:59.183 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:59.182+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:59.241 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:01:59.282 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:59.282+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:01:59.317 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:59.317 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:59.317 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:01:59.318 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:59.333 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:01:59.384 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:59.381+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:59.459 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:59.459 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:01:59.459 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:01:59.459 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:01:59.459 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:59.473 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:01:59.475 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:01:59.514 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:01:59.513+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:01:59.585 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:59.581+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:59.616 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:01:59.617 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:01:59.632 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:01:59.632 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.642 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 25.737205772999999, 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:01:59.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:01:59.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:01:59.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2125 3.3 3:c08a0c87:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.648 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 25.676652462, 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017529118, 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2125 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964246+0000", 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1480000000000002e-06 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969234+0000", 2024-04-23T19:01:59.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049879829999999997 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969264+0000", 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9864000000000001e-05 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969278+0000", 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4243999999999999e-05 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969362+0000", 2024-04-23T19:01:59.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4275000000000002e-05 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969503+0000", 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014088100000000001 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969621+0000", 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117854 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.978059+0000", 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084378890000000005 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981693+0000", 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036344250000000002 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981734+0000", 2024-04-23T19:01:59.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1012e-05 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981772+0000", 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2128 3.9 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 25.645292304000002, 2024-04-23T19:01:59.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020104940000000002, 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2128 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:01:59.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995606+0000", 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9859999999999999e-06 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999480+0000", 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038744750000000001 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999507+0000", 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7229999999999998e-05 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999519+0000", 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1404e-05 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999601+0000", 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1922000000000006e-05 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999767+0000", 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016648699999999999 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999903+0000", 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013553799999999999 2024-04-23T19:01:59.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.006027+0000", 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061242520000000002 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015614+0000", 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009586542 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015664+0000", 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0865999999999997e-05 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015708+0000", 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3238000000000002e-05 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2137 3.34 3:2fdd6a5a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.660 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 25.551270729999999, 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017293260000000001, 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2137 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089627+0000", 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.993e-06 2024-04-23T19:01:59.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094388+0000", 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047608260000000001 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094423+0000", 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4465999999999998e-05 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094449+0000", 2024-04-23T19:01:59.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6463000000000001e-05 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094561+0000", 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011229 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094698+0000", 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013688400000000001 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:59.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094813+0000", 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114623 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.101380+0000", 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065671419999999998 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106765+0000", 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053846240000000002 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106848+0000", 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3287000000000004e-05 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106918+0000", 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9661999999999998e-05 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 25.540815168999998, 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:01:59.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:01:59.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.672 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 25.428006475, 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:01:59.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.939434108, 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.679 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:01:59.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2204 3.14 3:2b7a418a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.684 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.853132809999998, 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018374023, 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2204 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787765+0000", 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9299999999999999e-06 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792512+0000", 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047467719999999998 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792548+0000", 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6170000000000001e-05 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792565+0000", 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6617e-05 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792637+0000", 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1826e-05 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792754+0000", 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117892 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792849+0000", 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4722999999999994e-05 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.800408+0000", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075589489999999997 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806000+0000", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055916009999999999 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806059+0000", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9684e-05 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806136+0000", 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6859000000000004e-05 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.789127889, 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.690 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.678678856000001, 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:01:59.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.126753212000001, 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.700 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:01:59.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:01:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.931254636999999, 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.707 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:01:59.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:01:59.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:01:59.712 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2272 3.f e57/20 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head v 57'1, mlcod=0'0)", 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.870452163, 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018222453, 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770446+0000", 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2440000000000002e-06 2024-04-23T19:01:59.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773167+0000", 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027208039999999998 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773220+0000", 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2985999999999997e-05 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773244+0000", 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3876999999999999e-05 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773419+0000", 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017479799999999999 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773480+0000", 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1945000000000004e-05 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788495+0000", 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015014883999999999 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788665+0000", 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169915 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.717 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.837439419999999, 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:01:59.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2279 3.31 e57/20 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head v 57'4, mlcod=56'2)", 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.775245911999999, 2024-04-23T19:01:59.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017397382999999999, 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865651+0000", 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3159999999999999e-06 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870481+0000", 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048299570000000002 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870515+0000", 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4050000000000001e-05 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870531+0000", 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5665999999999999e-05 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870700+0000", 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169178 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870773+0000", 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2992999999999997e-05 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.882908+0000", 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012134725000000001 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.883046+0000", 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138498 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2284 3.1a 3:5a62ea4e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.704794665000001, 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018303172999999999, 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2284 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:01:59.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936104+0000", 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4539999999999999e-06 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940422+0000", 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043180930000000003 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940468+0000", 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5915999999999999e-05 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940486+0000", 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940613+0000", 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127816 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940870+0000", 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256297 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.941130+0000", 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026009999999999998 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.947876+0000", 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067462779999999996 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954125+0000", 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0062487590000000004 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954282+0000", 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157262 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954404+0000", 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012147200000000001 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.694778507999999, 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.734 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:01:59.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:01:59.740 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.673759967999999, 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:01:59.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.563414912999999, 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.745 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:01:59.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.750 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.509353278999999, 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:01:59.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:01:59.756 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:01:59.757 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:01:59.757 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:01:59.758 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:01:59.759 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:01:59.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:01:59.759 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:01:59.753+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:01:59.760 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:01:59.760 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:01:59.760 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:01:59.760 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:01:59.761 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:01:59.761 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:01:59.761 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:01:59.762 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:01:59.858 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:01:59.858+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:01:59.934 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:01:59.934 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:01:59.950 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:01:59.959 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:01:59.958+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:00.060 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:00.057+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:00.075 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:00.075 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:00.089 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:00.178 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:00.177+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:00.256 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:00.256 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:00.262 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:00.262+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:00.270 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:00.362 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:00.362+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:00.439 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:00.439 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:00.453 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:00.463 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:00.462+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:00.563 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:00.562+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:00.568 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:00.568 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:00.582 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:00.664 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:00.661+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:00.704 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:00.704 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:00.718 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:00.765 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:00.766+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:00.866 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:00.866+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:00.887 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:00.887 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:00.902 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:00.967 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:00.966+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:01.021 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:01.021 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:01.035 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:01.068 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:01.066+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:01.157 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:01.158 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:01.169 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:01.165+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:01.172 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:01.267 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:02:01.270 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:01.269+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:01.293 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:01.293 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:01.310 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:01.397 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:01.398+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:01.466 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:01.466 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:01.471 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:01.470+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:01.480 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:01.572 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:01.570+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:01.637 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:02:01.638 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:01.638 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:01.656 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:01.674 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:01.673+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:01.763 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:01.809 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:01.810+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:01.817 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:01.817 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:01.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:01.874 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:01.873+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:01.906 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:01.906 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:01.923 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:01.923 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:01.940 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:01.940 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:01.957 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:01.957 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:01.976 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:01.974+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:01.977 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:01.977 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:01.985 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:01.986 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:01.986 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:01.986 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:01.986 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:01.997 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:01.997 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:01.999 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:02.017 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:02.018 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:02.038 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:02.038 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:02.097 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:02.098+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:02:02.140 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 102.851826046, 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:02:02.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2123 3.0 3:0261d0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:02:02.145 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.198623546, 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015185707999999999, 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2123 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942998+0000", 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8210000000000002e-06 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944838+0000", 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018401769999999999 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944863+0000", 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4899999999999999e-05 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944874+0000", 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0926e-05 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.148 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944942+0000", 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7428999999999994e-05 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945070+0000", 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012833899999999999 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945175+0000", 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010466100000000001 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.957371+0000", 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012196864 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958106+0000", 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00073463499999999998 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958147+0000", 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0506000000000001e-05 2024-04-23T19:02:02.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958181+0000", 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4449999999999997e-05 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.889224355, 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:02:02.151 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:02:02.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:02:02.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:02:02.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2162 3.25 3:a68bdb79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.791376003, 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014496184, 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2162 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:02:02.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350245+0000", 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6249999999999999e-06 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351950+0000", 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001704721 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351984+0000", 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352000+0000", 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5662e-05 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352094+0000", 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3715999999999995e-05 2024-04-23T19:02:02.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352285+0000", 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019128799999999999 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352456+0000", 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017101200000000001 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364058+0000", 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011602128 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364650+0000", 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059187900000000002 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364688+0000", 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7515999999999998e-05 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364739+0000", 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1412999999999997e-05 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2171 3.31 3:8c201035:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.166 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.686125291, 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015626368000000002, 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2171 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:02:02.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455496+0000", 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8949999999999998e-06 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457275+0000", 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017788330000000001 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457301+0000", 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6024999999999999e-05 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457313+0000", 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1877e-05 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457386+0000", 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3109999999999996e-05 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457527+0000", 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014033399999999999 2024-04-23T19:02:02.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457656+0000", 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129789 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.464144+0000", 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064880069999999996 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471010+0000", 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068660070000000004 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471056+0000", 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5943999999999999e-05 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471120+0000", 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3547000000000007e-05 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.173 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2187 3.1f 3:fb7660b3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.618238789999999, 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014170726, 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.174 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2187 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523384+0000", 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8530000000000002e-06 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525403+0000", 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020189000000000001 2024-04-23T19:02:02.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525440+0000", 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6979e-05 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525453+0000", 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3005e-05 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525563+0000", 2024-04-23T19:02:02.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109985 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525789+0000", 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022658800000000001 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525988+0000", 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000198409 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536623+0000", 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010635109 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537400+0000", 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077722900000000005 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537466+0000", 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5518999999999994e-05 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537551+0000", 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5149999999999996e-05 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.180 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.574611690000001, 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.181 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:02:02.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:02:02.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2200 3.1a e56/20 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head v 56'3, mlcod=52'1)", 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:02:02.187 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.433364280999999, 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016149459000000001, 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:02:02.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708257+0000", 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.666e-06 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712912+0000", 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004654661 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712947+0000", 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5612999999999999e-05 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712965+0000", 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-05 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713105+0000", 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140264 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713170+0000", 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4974999999999994e-05 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724310+0000", 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011139935 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724404+0000", 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4005000000000005e-05 2024-04-23T19:02:02.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.282999005000001, 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:02:02.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:02:02.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:02.196 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.206050232999999, 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:02.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:02:02.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2229 3.31 3:8ced272b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.937357349999999, 2024-04-23T19:02:02.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012661527000000001, 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2229 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204264+0000", 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6649999999999999e-06 2024-04-23T19:02:02.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205798+0000", 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001534349 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205838+0000", 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9258000000000003e-05 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205855+0000", 2024-04-23T19:02:02.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7532000000000001e-05 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205962+0000", 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010679 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206143+0000", 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000180559 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206304+0000", 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016126500000000001 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.213214+0000", 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069100849999999998 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216772+0000", 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035580210000000002 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216855+0000", 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2996000000000003e-05 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216923+0000", 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8007000000000001e-05 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2243 3.25 3:a47da34a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.773751969999999, 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016498994999999999, 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2243 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367870+0000", 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4479999999999999e-06 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370547+0000", 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026765270000000002 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370583+0000", 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5710999999999997e-05 2024-04-23T19:02:02.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370598+0000", 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5726000000000002e-05 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370683+0000", 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4819000000000002e-05 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370832+0000", 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014911899999999999 2024-04-23T19:02:02.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370992+0000", 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159815 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381097+0000", 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010105042999999999 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384082+0000", 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029852009999999998 2024-04-23T19:02:02.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384244+0000", 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016155999999999999 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384366+0000", 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122026 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2245 3.0 3:03deb7e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.751617692, 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015195145, 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2245 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390004+0000", 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9679999999999998e-06 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392079+0000", 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020753759999999999 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392103+0000", 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3479e-05 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392116+0000", 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2761e-05 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392224+0000", 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107904 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392428+0000", 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000204186 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392635+0000", 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020687200000000001 2024-04-23T19:02:02.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404314+0000", 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011679144000000001 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405073+0000", 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075964499999999998 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405143+0000", 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9394999999999995e-05 2024-04-23T19:02:02.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405196+0000", 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3415000000000003e-05 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2251 3.32 e57/20 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.671774077999999, 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012365898, 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.220 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:02.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.44e-07 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471716+0000", 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018707960000000001 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471751+0000", 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622999999999997e-05 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471769+0000", 2024-04-23T19:02:02.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8508e-05 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471919+0000", 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149853 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471968+0000", 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9066000000000001e-05 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482090+0000", 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122160999999999 2024-04-23T19:02:02.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482211+0000", 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120347 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2254 3.1a e57/20 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head v 57'5, mlcod=56'3)", 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.621465947000001, 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016447765, 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.224 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520156+0000", 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6429999999999999e-06 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524703+0000", 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045476930000000002 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524732+0000", 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8551000000000002e-05 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524745+0000", 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3124e-05 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524844+0000", 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8721999999999994e-05 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524878+0000", 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4839000000000003e-05 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536495+0000", 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011616912 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536601+0000", 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105281 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2278 3.8 e57/20 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.288791989, 2024-04-23T19:02:02.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016293365000000001, 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852829+0000", 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9549999999999999e-06 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855964+0000", 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003135035 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855993+0000", 2024-04-23T19:02:02.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9369999999999998e-05 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856007+0000", 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3696999999999999e-05 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856132+0000", 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125313 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856188+0000", 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6164e-05 2024-04-23T19:02:02.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.868860+0000", 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012671319 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869120+0000", 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026051200000000002 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.280364292000002, 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2280 3.25 3:a4e9d83c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.264769599000001, 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014342169, 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.238 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2280 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876852+0000", 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.305e-06 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878784+0000", 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001932465 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878822+0000", 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7654999999999998e-05 2024-04-23T19:02:02.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878844+0000", 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2124999999999999e-05 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878935+0000", 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1154000000000002e-05 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879107+0000", 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172199 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879257+0000", 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015013200000000001 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.889696+0000", 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010438523999999999 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891118+0000", 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014217640000000001 2024-04-23T19:02:02.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891156+0000", 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8597000000000003e-05 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891191+0000", 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5249000000000001e-05 2024-04-23T19:02:02.243 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.043079398, 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.244 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2300 3.25 3:a433329a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:02:02.249 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.018580066999998, 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012342531, 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2300 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123042+0000", 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2289999999999999e-06 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125053+0000", 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020108349999999999 2024-04-23T19:02:02.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125088+0000", 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5472000000000002e-05 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125106+0000", 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7207e-05 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125188+0000", 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2473999999999997e-05 2024-04-23T19:02:02.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125327+0000", 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013878299999999999 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125436+0000", 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010893200000000001 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.134793+0000", 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0093574209999999994 2024-04-23T19:02:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135267+0000", 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047370000000000002 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135330+0000", 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135381+0000", 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1567000000000003e-05 2024-04-23T19:02:02.254 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.255 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:02.256 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:02.257 INFO:tasks.workunit.client.0.smithi169.stdout:quota enabled for the bucket: buck_2024_03_23_19_01_57 2024-04-23T19:02:02.257 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 2Gb. 2024-04-23T19:02:02.257 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:02:02.257 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-04-23T19:02:02.257 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:02:02.257 INFO:tasks.workunit.client.0.smithi169.stdout:delete objects successful 2024-04-23T19:02:02.257 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:02.254+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:02.357 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:02.358+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:02.428 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:02.428 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:02.428 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:02.428 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:02.446 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:02.458 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:02.461+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:02.559 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:02.561+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:02.609 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:02.610 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:02.610 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:02.610 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:02.610 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:02.627 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:02.660 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:02.657+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:02.745 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:02.745 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:02.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:02.745 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:02.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.745 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2128 3.9 e56/20 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.745356701999999, 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015323256, 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000715+0000", 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.477e-06 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004783+0000", 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040687689999999999 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004810+0000", 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6999999999999999e-05 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004822+0000", 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1768e-05 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004888+0000", 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6135000000000003e-05 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004905+0000", 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7201e-05 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.015977+0000", 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011072039000000001 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.016036+0000", 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8866999999999997e-05 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.749 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2138 3.9 e56/20 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head v 56'2, mlcod=0'0)", 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.636779990000001, 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015486679999999999, 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:02.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109292+0000", 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1639999999999999e-06 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113331+0000", 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040388969999999996 2024-04-23T19:02:02.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113352+0000", 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1520000000000001e-05 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113364+0000", 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1548e-05 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113429+0000", 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5455000000000003e-05 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113451+0000", 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1393999999999999e-05 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124722+0000", 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011271458999999999 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124776+0000", 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4243000000000002e-05 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.753 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2139 3.13 3:cab0dc9f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.635898858000001, 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016204007999999999, 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2139 2024-04-23T19:02:02.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110173+0000", 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.503e-06 2024-04-23T19:02:02.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112023+0000", 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018492490000000001 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112057+0000", 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4360999999999998e-05 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112071+0000", 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4449e-05 2024-04-23T19:02:02.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112162+0000", 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0484999999999998e-05 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112315+0000", 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015275 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112433+0000", 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118003 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124291+0000", 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011858153999999999 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126259+0000", 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019684889999999999 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126318+0000", 2024-04-23T19:02:02.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9098000000000002e-05 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126375+0000", 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6467e-05 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2153 3.4 e56/20 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.491517647999999, 2024-04-23T19:02:02.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014484469999999999, 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254554+0000", 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.767e-06 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256112+0000", 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015583979999999999 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256137+0000", 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4689999999999999e-05 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256149+0000", 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1722999999999999e-05 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256214+0000", 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5364000000000006e-05 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256239+0000", 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4754000000000001e-05 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.268971+0000", 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012732647 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269037+0000", 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5127000000000002e-05 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:02.763 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.160460562000001, 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.766 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.768 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2198 3.2d e56/20 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head v 56'3, mlcod=56'1)", 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.066476772000001, 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014321115000000001, 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679595+0000", 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1220000000000002e-06 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683327+0000", 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037316139999999999 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683358+0000", 2024-04-23T19:02:02.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1183000000000003e-05 2024-04-23T19:02:02.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683373+0000", 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.469e-05 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683506+0000", 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013350999999999999 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683550+0000", 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4056e-05 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693802+0000", 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010251532000000001 2024-04-23T19:02:02.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693914+0000", 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112408 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2205 3.2d e56/20 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:02.775 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.942279030000002, 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015864357999999999, 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803793+0000", 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5799999999999999e-06 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807684+0000", 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038911620000000001 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807718+0000", 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3673000000000001e-05 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807734+0000", 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5913000000000002e-05 2024-04-23T19:02:02.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807877+0000", 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014260499999999999 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807927+0000", 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9938999999999997e-05 2024-04-23T19:02:02.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819494+0000", 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011567365 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819655+0000", 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112099999999999 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.881746984999999, 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.781 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.783 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:02:02.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:02:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2217 3.3d e57/20 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:02.787 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.686193987999999, 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013378533, 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3799999999999997e-07 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064170+0000", 2024-04-23T19:02:02.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042934480000000001 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064200+0000", 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0429e-05 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064214+0000", 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3986e-05 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064305+0000", 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1048e-05 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064327+0000", 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2195e-05 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073180+0000", 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088524520000000002 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073254+0000", 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4437000000000006e-05 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2247 3.2e 3:77104512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.792 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.335613678000001, 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018591723000000001, 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2247 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410459+0000", 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.004e-06 2024-04-23T19:02:02.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412345+0000", 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001885723 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412378+0000", 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3494999999999997e-05 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412390+0000", 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1402e-05 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412535+0000", 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014549699999999999 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412841+0000", 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306068 2024-04-23T19:02:02.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.413048+0000", 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020667600000000001 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.426308+0000", 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013260532 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428861+0000", 2024-04-23T19:02:02.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025528600000000001 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428950+0000", 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9124999999999998e-05 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.429048+0000", 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7341000000000002e-05 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.798 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2248 3.13 3:cafccc7d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.324323863, 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017780271, 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.799 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2248 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421748+0000", 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423913+0000", 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165391 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423945+0000", 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2002000000000003e-05 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423964+0000", 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8745000000000001e-05 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424049+0000", 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4913999999999994e-05 2024-04-23T19:02:02.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424212+0000", 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016343400000000001 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424325+0000", 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113235 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.803 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.431161+0000", 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068358630000000002 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439339+0000", 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081775819999999992 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439449+0000", 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109744 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439526+0000", 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7498999999999998e-05 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2250 3.21 3:87aecc51:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.294105503000001, 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017023829000000001, 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.806 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2250 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:02.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451968+0000", 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5310000000000002e-06 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454099+0000", 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021313209999999998 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454141+0000", 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2363000000000001e-05 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454163+0000", 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2002999999999999e-05 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454276+0000", 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112453 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454479+0000", 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020322 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454667+0000", 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018758100000000001 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.463497+0000", 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008830582 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468850+0000", 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053529809999999997 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468928+0000", 2024-04-23T19:02:02.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7832999999999998e-05 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468988+0000", 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9960999999999997e-05 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2256 3.21 3:849d8eb6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.199682065000001, 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015796782999999998, 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2256 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546390+0000", 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.706e-06 2024-04-23T19:02:02.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548597+0000", 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022068180000000001 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548634+0000", 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7228999999999999e-05 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548651+0000", 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886999999999999e-05 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548767+0000", 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115738 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548955+0000", 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018769199999999999 2024-04-23T19:02:02.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.549161+0000", 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020635799999999999 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.557911+0000", 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087494389999999995 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562055+0000", 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041443369999999997 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562125+0000", 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0090000000000001e-05 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562184+0000", 2024-04-23T19:02:02.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9488999999999999e-05 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2259 3.13 3:cbd3cfdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.150110511000001, 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016674984, 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.819 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2259 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595963+0000", 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.597e-06 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598044+0000", 2024-04-23T19:02:02.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002080798 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598095+0000", 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848999999999998e-05 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598125+0000", 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9549000000000001e-05 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598276+0000", 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151197 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598667+0000", 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039116800000000001 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598963+0000", 2024-04-23T19:02:02.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029514 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.607659+0000", 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008696723 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612305+0000", 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046458209999999996 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.824 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612500+0000", 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000194649 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612634+0000", 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013449299999999999 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.825 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2264 3.13 3:ca21246b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.091860166, 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01879832, 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2264 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.826 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.827 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654213+0000", 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1319999999999998e-06 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656725+0000", 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025118319999999999 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656773+0000", 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8641999999999999e-05 2024-04-23T19:02:02.828 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656802+0000", 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9232999999999999e-05 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656939+0000", 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013616400000000001 2024-04-23T19:02:02.829 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657129+0000", 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190077 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657315+0000", 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018593700000000001 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.670726+0000", 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013411809 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672902+0000", 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021760220000000001 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672952+0000", 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9243000000000003e-05 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.673008+0000", 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6229e-05 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.832 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.93547023, 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:02.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.834 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:02:02.835 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.836 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.837 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2283 3.2f 3:f4b34eeb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.825401138, 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016414225000000001, 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.838 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2283 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.839 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920671+0000", 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6579999999999998e-06 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922521+0000", 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001849304 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.840 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922556+0000", 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5567e-05 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922585+0000", 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8945000000000002e-05 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922689+0000", 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103657 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.841 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922794+0000", 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105377 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922883+0000", 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9029000000000004e-05 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.842 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.928429+0000", 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055458039999999997 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937001+0000", 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085721329999999991 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937045+0000", 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3551999999999999e-05 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.843 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937083+0000", 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8198999999999998e-05 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.780914460999998, 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:02:02.844 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:02.845 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.846 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:02:02.847 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:02.848 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.849 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.850 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2291 3.2f 3:f4447ec0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.721480564, 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018374181999999999, 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2291 2024-04-23T19:02:02.851 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.852 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024592+0000", 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026818+0000", 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002225875 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.853 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026846+0000", 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8011999999999999e-05 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026861+0000", 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5257e-05 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026959+0000", 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7923000000000004e-05 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.854 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027146+0000", 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187033 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027316+0000", 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170075 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.855 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.033411+0000", 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060947110000000001 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042837+0000", 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094266430000000002 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042908+0000", 2024-04-23T19:02:02.856 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0859999999999996e-05 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042963+0000", 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.857 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 26.571730601999999, 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.858 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.859 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:02:02.860 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:02.861 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:02:02.862 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:02.863 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:02.864 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:02.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:02.866 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:02.866+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:02.966 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:02.966+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:03.019 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:03.019 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:03.020 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:03.020 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:03.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:03.073 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:03.074+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:03.168 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:03.165+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:03.196 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:03.197 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:03.197 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:03.197 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:03.197 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:03.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:03.269 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:03.269+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2132 3.28 e56/20 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head v 56'7, mlcod=52'5)", 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.292587838999999, 2024-04-23T19:02:03.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016380967, 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041361+0000", 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3179999999999999e-06 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045289+0000", 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003928132 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045314+0000", 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4932000000000001e-05 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045327+0000", 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2825e-05 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045395+0000", 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8508000000000002e-05 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045417+0000", 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057670+0000", 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012252732000000001 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057741+0000", 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1099999999999994e-05 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2150 3.5 e56/20 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head v 56'3, mlcod=52'1)", 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.105942292999998, 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016970147000000001, 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228010+0000", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2000000000000002e-06 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232131+0000", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041208140000000004 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232164+0000", 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2991000000000003e-05 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232180+0000", 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5773999999999998e-05 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232266+0000", 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5572e-05 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232294+0000", 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.798e-05 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244931+0000", 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012637084999999999 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244975+0000", 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4731000000000003e-05 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.1015044, 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:02:03.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:03.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:02:03.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2188 3.2 3:4067ff17:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.799846937000002, 2024-04-23T19:02:03.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016815175000000002, 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2188 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534104+0000", 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3890000000000001e-06 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536507+0000", 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024034410000000001 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536542+0000", 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4332999999999998e-05 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536560+0000", 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8481000000000001e-05 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536656+0000", 2024-04-23T19:02:03.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5533999999999997e-05 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536831+0000", 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175575 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536999+0000", 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016784800000000001 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.543634+0000", 2024-04-23T19:02:03.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066347109999999997 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550835+0000", 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0072007310000000001 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550877+0000", 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999997e-05 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550916+0000", 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8751999999999998e-05 2024-04-23T19:02:03.352 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.776518136, 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.353 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2207 3.1e 3:780a1068:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.358 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.505496286, 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018197270000000001, 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2207 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:03.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828455+0000", 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.512e-06 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831640+0000", 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003185252 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831706+0000", 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5549000000000005e-05 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831733+0000", 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7809000000000001e-05 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831892+0000", 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159097 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832226+0000", 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033322000000000001 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832553+0000", 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032690300000000002 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.843688+0000", 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011135541000000001 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846344+0000", 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026557830000000001 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846510+0000", 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165766 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846648+0000", 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013883799999999999 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.374982228, 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.364 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:02:03.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:02:03.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.369 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.328007760999999, 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.370 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:02:03.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.267827970999999, 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:02:03.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:02:03.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2237 3.2 3:428ac9ed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:02:03.380 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.034505313, 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016445471, 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2237 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:02:03.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299446+0000", 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1520000000000002e-06 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302644+0000", 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031979460000000001 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302685+0000", 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0525000000000002e-05 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302702+0000", 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6877000000000001e-05 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302823+0000", 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121805 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303049+0000", 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022504799999999999 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303364+0000", 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031515900000000002 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.311910+0000", 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085464210000000002 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315716+0000", 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038055810000000002 2024-04-23T19:02:03.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315812+0000", 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6458000000000004e-05 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315888+0000", 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499000000000003e-05 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.955335065, 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:02:03.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:03.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2258 3.29 3:94133d0c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.760338317999999, 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016616373, 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2258 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573613+0000", 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.45e-06 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575917+0000", 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023045840000000001 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575976+0000", 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8556e-05 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575997+0000", 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0761999999999999e-05 2024-04-23T19:02:03.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576108+0000", 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111972 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576302+0000", 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019340899999999999 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:03.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576488+0000", 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018585800000000001 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.584483+0000", 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079952800000000004 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590103+0000", 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056203709999999999 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590172+0000", 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8613000000000002e-05 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590226+0000", 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3517999999999998e-05 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.714508739999999, 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:02:03.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:02:03.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.686110944999999, 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:02:03.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:02:03.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.6131201, 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.410 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:02:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:02:03.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.415 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.483758957999999, 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:02:03.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2292 3.38 3:1e95effa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.297302222999999, 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017689090000000001, 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.421 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2292 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036648+0000", 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038325+0000", 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00167702 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038352+0000", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7027000000000001e-05 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038362+0000", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0185e-05 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038440+0000", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8004999999999996e-05 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038621+0000", 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018072499999999999 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038783+0000", 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016250999999999999 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.050696+0000", 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011913105 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054217+0000", 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035209099999999999 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054283+0000", 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5506000000000006e-05 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054334+0000", 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1743000000000002e-05 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.426 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.277848803000001, 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:02:03.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:02:03.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:02:03.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:02:03.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2306 3.3c e57/20 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head v 57'6, mlcod=57'4)", 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.143488978000001, 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016887030000000001, 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.432 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190460+0000", 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.519e-06 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194624+0000", 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041640540000000004 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194650+0000", 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6041e-05 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194663+0000", 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2986000000000001e-05 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194742+0000", 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8827999999999998e-05 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194774+0000", 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2500999999999999e-05 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207187+0000", 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012412309 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207346+0000", 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015879199999999999 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.436 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2307 3.29 3:9750f0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.140107042, 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016969273, 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2307 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193844+0000", 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2140000000000001e-06 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195694+0000", 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018506519999999999 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195714+0000", 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9213000000000001e-05 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195726+0000", 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2221999999999999e-05 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195803+0000", 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7183999999999998e-05 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195935+0000", 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013161299999999999 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.196030+0000", 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5032999999999996e-05 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207642+0000", 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011612788000000001 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210690+0000", 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030474299999999998 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210758+0000", 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8514000000000002e-05 2024-04-23T19:02:03.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210810+0000", 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1409999999999997e-05 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:03.442 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:03.444 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:03.444 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:03.442+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:03.544 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:03.541+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:03.576 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:03.576 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:03.576 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:03.576 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:03.590 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:03.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:02:03.678 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:03.677+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:03.746 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:03.741+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:03.757 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:03.757 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:03.757 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:03.757 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:03.757 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:03.771 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:03.846 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:03.846+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:03.940 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:03.940 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:03.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:03.940 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:03.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.037307516999999, 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.941 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:03.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:03.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:03.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2125 3.3 3:c08a0c87:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.947 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.976754205999999, 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017529118, 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2125 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964246+0000", 2024-04-23T19:02:03.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1480000000000002e-06 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969234+0000", 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049879829999999997 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969264+0000", 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9864000000000001e-05 2024-04-23T19:02:03.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969278+0000", 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4243999999999999e-05 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969362+0000", 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4275000000000002e-05 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969503+0000", 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014088100000000001 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969621+0000", 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117854 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.978059+0000", 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084378890000000005 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981693+0000", 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036344250000000002 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981734+0000", 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1012e-05 2024-04-23T19:02:03.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981772+0000", 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2128 3.9 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:03.954 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.945394048000001, 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020104940000000002, 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2128 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995606+0000", 2024-04-23T19:02:03.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9859999999999999e-06 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999480+0000", 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038744750000000001 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999507+0000", 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7229999999999998e-05 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999519+0000", 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1404e-05 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999601+0000", 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1922000000000006e-05 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999767+0000", 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016648699999999999 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999903+0000", 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013553799999999999 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.006027+0000", 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061242520000000002 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015614+0000", 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009586542 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015664+0000", 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0865999999999997e-05 2024-04-23T19:02:03.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015708+0000", 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3238000000000002e-05 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2137 3.34 3:2fdd6a5a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:02:03.961 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.851372474000001, 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017293260000000001, 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2137 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089627+0000", 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.993e-06 2024-04-23T19:02:03.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094388+0000", 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047608260000000001 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094423+0000", 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4465999999999998e-05 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094449+0000", 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6463000000000001e-05 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094561+0000", 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011229 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094698+0000", 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013688400000000001 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094813+0000", 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114623 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.101380+0000", 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065671419999999998 2024-04-23T19:02:03.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106765+0000", 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053846240000000002 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106848+0000", 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3287000000000004e-05 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106918+0000", 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9661999999999998e-05 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.840916913000001, 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.968 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:03.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:03.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:03.975 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.728108218999999, 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.976 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:03.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:03.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.239535851999999, 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.983 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:03.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2204 3.14 3:2b7a418a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.153234554000001, 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018374023, 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2204 2024-04-23T19:02:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787765+0000", 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9299999999999999e-06 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792512+0000", 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047467719999999998 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792548+0000", 2024-04-23T19:02:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6170000000000001e-05 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792565+0000", 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6617e-05 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792637+0000", 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1826e-05 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792754+0000", 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117892 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792849+0000", 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4722999999999994e-05 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:03.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.800408+0000", 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075589489999999997 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806000+0000", 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055916009999999999 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806059+0000", 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9684e-05 2024-04-23T19:02:03.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806136+0000", 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6859000000000004e-05 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.089229632999999, 2024-04-23T19:02:03.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:03.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:03.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:04.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:04.003 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.9787806, 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.426854956, 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.231356381000001, 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:04.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:04.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2272 3.f e57/20 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.170553906999999, 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018222453, 2024-04-23T19:02:04.023 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:02:04.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770446+0000", 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2440000000000002e-06 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773167+0000", 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027208039999999998 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773220+0000", 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2985999999999997e-05 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773244+0000", 2024-04-23T19:02:04.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3876999999999999e-05 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773419+0000", 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017479799999999999 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773480+0000", 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1945000000000004e-05 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788495+0000", 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015014883999999999 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788665+0000", 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169915 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.137541164000002, 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.029 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:04.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:04.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2279 3.31 e57/20 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.075347656000002, 2024-04-23T19:02:04.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017397382999999999, 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865651+0000", 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3159999999999999e-06 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870481+0000", 2024-04-23T19:02:04.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048299570000000002 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870515+0000", 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4050000000000001e-05 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870531+0000", 2024-04-23T19:02:04.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5665999999999999e-05 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870700+0000", 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169178 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870773+0000", 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2992999999999997e-05 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.882908+0000", 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012134725000000001 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.883046+0000", 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138498 2024-04-23T19:02:04.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2284 3.1a 3:5a62ea4e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.004896409000001, 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018303172999999999, 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2284 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:02:04.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936104+0000", 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4539999999999999e-06 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940422+0000", 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043180930000000003 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940468+0000", 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5915999999999999e-05 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940486+0000", 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940613+0000", 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127816 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940870+0000", 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256297 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.941130+0000", 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026009999999999998 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.947876+0000", 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067462779999999996 2024-04-23T19:02:04.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954125+0000", 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0062487590000000004 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954282+0000", 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157262 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954404+0000", 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012147200000000001 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.994880252000002, 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:04.049 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:04.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.973861712000001, 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.056 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:04.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:04.061 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.863516657000002, 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:04.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:04.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.809455023000002, 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:04.068 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:04.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:04.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:04.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:04.074 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.075 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.075 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.075 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:04.075 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:04.075 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:04.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:04.078 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:02:04.078 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:04.078 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:04.073+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:04.177 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:04.173+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:04.250 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:04.250 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:04.250 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:04.250 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:04.263 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:04.264 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:04.265 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:04.278 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:04.278+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:04.279 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:04.279 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:04.295 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:04.295 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:04.312 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:04.313 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:04.331 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:04.332 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:04.349 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:04.349 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:04.367 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:04.368 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:04.379 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:04.377+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:04.384 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:04.384 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:04.432 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:04.432 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:04.446 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:04.480 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:04.478+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:04.581 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:04.582+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:04.614 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:04.614 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:04.627 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:04.682 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:04.677+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:04.751 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:04.751 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:04.765 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:04.810 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:04.809+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:04.883 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:04.881+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:04.927 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:04.927 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:04.941 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:04.986 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:04.985+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:05.085 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:05.086+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:05.110 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:05.110 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:05.124 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:05.186 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:05.185+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:05.241 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:05.241 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:05.255 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:05.287 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:05.286+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:05.388 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:05.386+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:05.422 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:05.423 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:05.436 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:05.489 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:05.490+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:05.558 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:05.558 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:05.572 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:05.621 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:05.622+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:05.691 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:05.693+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:05.703 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:05.703 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:05.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:05.805 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:05.806+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:05.884 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:05.884 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:05.893 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:05.890+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:05.899 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:05.993 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:05.993+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:06.067 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:06.067 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:06.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:02:06.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:06.129 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:06.130+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:06.195 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:06.194+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:06.257 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:06.257 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:06.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:06.313 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:06.314+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:06.397 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:06.394+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:06.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:06.427 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:06.427 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:06.442 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:06.497 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:06.497+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:06.546 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:06.546 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:06.563 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:06.563 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:06.579 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:06.579 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:06.595 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:06.595 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:06.598 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:06.597+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-23T19:02:06.608 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 107.319700486, 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013713064000000001, 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "reached pg", 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4452", 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/2373952917", 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289793+0000", 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289794+0000", 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.699e-06 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289802+0000", 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7530000000000001e-06 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289818+0000", 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5350999999999999e-05 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.289830+0000", 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2520999999999999e-05 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290088+0000", 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025836099999999997 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for peered", 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.290112+0000", 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3065999999999999e-05 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303236+0000", 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013124925000000001 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:00:19.303506+0000", 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026938800000000002 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2123 3.0 3:0261d0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.666497986000003, 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015185707999999999, 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.613 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2123 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942995+0000", 2024-04-23T19:02:06.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.942998+0000", 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8210000000000002e-06 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944838+0000", 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018401769999999999 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944863+0000", 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4899999999999999e-05 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944874+0000", 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0926e-05 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.944942+0000", 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7428999999999994e-05 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945070+0000", 2024-04-23T19:02:06.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012833899999999999 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.945175+0000", 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010466100000000001 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.957371+0000", 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012196864 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958106+0000", 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00073463499999999998 2024-04-23T19:02:06.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958147+0000", 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0506000000000001e-05 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.958181+0000", 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4449999999999997e-05 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.618 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.357098794999999, 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:06.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:02:06.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:02:06.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:02:06.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2162 3.25 3:a68bdb79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.259250442999999, 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014496184, 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2162 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350243+0000", 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.350245+0000", 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6249999999999999e-06 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351950+0000", 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001704721 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.351984+0000", 2024-04-23T19:02:06.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4224000000000003e-05 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352000+0000", 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5662e-05 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352094+0000", 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3715999999999995e-05 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352285+0000", 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019128799999999999 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.352456+0000", 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017101200000000001 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364058+0000", 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011602128 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364650+0000", 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00059187900000000002 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364688+0000", 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7515999999999998e-05 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.364739+0000", 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1412999999999997e-05 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2171 3.31 3:8c201035:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.153999730999999, 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015626368000000002, 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2171 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.630 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455494+0000", 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.455496+0000", 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8949999999999998e-06 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457275+0000", 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017788330000000001 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457301+0000", 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6024999999999999e-05 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457313+0000", 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1877e-05 2024-04-23T19:02:06.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457386+0000", 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3109999999999996e-05 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457527+0000", 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014033399999999999 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.457656+0000", 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129789 2024-04-23T19:02:06.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.464144+0000", 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064880069999999996 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471010+0000", 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068660070000000004 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471056+0000", 2024-04-23T19:02:06.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5943999999999999e-05 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.471120+0000", 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3547000000000007e-05 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2187 3.1f 3:fb7660b3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.086113230000002, 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014170726, 2024-04-23T19:02:06.635 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2187 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523380+0000", 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.523384+0000", 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8530000000000002e-06 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525403+0000", 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020189000000000001 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525440+0000", 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6979e-05 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525453+0000", 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3005e-05 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525563+0000", 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109985 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525789+0000", 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022658800000000001 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.525988+0000", 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000198409 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536623+0000", 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010635109 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537400+0000", 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00077722900000000005 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537466+0000", 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5518999999999994e-05 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.537551+0000", 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5149999999999996e-05 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.640 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.04248613, 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.641 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:02:06.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:02:06.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:02:06.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:02:06.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2200 3.1a e56/20 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head v 56'3, mlcod=52'1)", 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.901238720999999, 2024-04-23T19:02:06.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016149459000000001, 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708255+0000", 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.708257+0000", 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.666e-06 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712912+0000", 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004654661 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712947+0000", 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5612999999999999e-05 2024-04-23T19:02:06.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.712965+0000", 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.734e-05 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713105+0000", 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000140264 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.713170+0000", 2024-04-23T19:02:06.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4974999999999994e-05 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724310+0000", 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011139935 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.724404+0000", 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4005000000000005e-05 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.650 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.750873445, 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:06.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:02:06.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:02:06.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.673924672999998, 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:02:06.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2229 3.31 3:8ced272b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.405231789999998, 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012661527000000001, 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2229 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204261+0000", 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.204264+0000", 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6649999999999999e-06 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205798+0000", 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001534349 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205838+0000", 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9258000000000003e-05 2024-04-23T19:02:06.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205855+0000", 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7532000000000001e-05 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.205962+0000", 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010679 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206143+0000", 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000180559 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.206304+0000", 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016126500000000001 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.213214+0000", 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069100849999999998 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216772+0000", 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035580210000000002 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216855+0000", 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2996000000000003e-05 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.216923+0000", 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8007000000000001e-05 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2243 3.25 3:a47da34a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.241626409999999, 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016498994999999999, 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2243 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367867+0000", 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.367870+0000", 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4479999999999999e-06 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370547+0000", 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026765270000000002 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370583+0000", 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5710999999999997e-05 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370598+0000", 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5726000000000002e-05 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370683+0000", 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4819000000000002e-05 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370832+0000", 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014911899999999999 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.370992+0000", 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159815 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381097+0000", 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010105042999999999 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384082+0000", 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029852009999999998 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384244+0000", 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016155999999999999 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384366+0000", 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122026 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2245 3.0 3:03deb7e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.219492131999999, 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015195145, 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.675 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2245 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390001+0000", 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.390004+0000", 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9679999999999998e-06 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392079+0000", 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020753759999999999 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392103+0000", 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3479e-05 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392116+0000", 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2761e-05 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392224+0000", 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107904 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392428+0000", 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000204186 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.392635+0000", 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020687200000000001 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404314+0000", 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011679144000000001 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405073+0000", 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00075964499999999998 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405143+0000", 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9394999999999995e-05 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.405196+0000", 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3415000000000003e-05 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2251 3.32 e57/20 3:4e77dae7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_140:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:06.680 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.139648518000001, 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012365898, 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:06.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.469845+0000", 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.44e-07 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471716+0000", 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018707960000000001 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471751+0000", 2024-04-23T19:02:06.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4622999999999997e-05 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471769+0000", 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8508e-05 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471919+0000", 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000149853 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.471968+0000", 2024-04-23T19:02:06.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9066000000000001e-05 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482090+0000", 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122160999999999 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.482211+0000", 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000120347 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2254 3.1a e57/20 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head v 57'5, mlcod=56'3)", 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.089340387, 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016447765, 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520153+0000", 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.520156+0000", 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6429999999999999e-06 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524703+0000", 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045476930000000002 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524732+0000", 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8551000000000002e-05 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524745+0000", 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3124e-05 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524844+0000", 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8721999999999994e-05 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.524878+0000", 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4839000000000003e-05 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536495+0000", 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011616912 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.536601+0000", 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105281 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.688 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2278 3.8 e57/20 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.756666428999999, 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016293365000000001, 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852827+0000", 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852829+0000", 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9549999999999999e-06 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855964+0000", 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003135035 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.855993+0000", 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9369999999999998e-05 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856007+0000", 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3696999999999999e-05 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856132+0000", 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125313 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.856188+0000", 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6164e-05 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.868860+0000", 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012671319 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869120+0000", 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00026051200000000002 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.748238732000001, 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.693 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:02:06.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:02:06.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:02:06.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.698 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2280 3.25 3:a4e9d83c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.732644039, 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014342169, 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2280 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876849+0000", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876852+0000", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.305e-06 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878784+0000", 2024-04-23T19:02:06.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001932465 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878822+0000", 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7654999999999998e-05 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878844+0000", 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2124999999999999e-05 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.878935+0000", 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1154000000000002e-05 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879107+0000", 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172199 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.879257+0000", 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015013200000000001 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.889696+0000", 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010438523999999999 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891118+0000", 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014217640000000001 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891156+0000", 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8597000000000003e-05 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.891191+0000", 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5249000000000001e-05 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.510953837999999, 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:02:06.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:02:06.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2300 3.25 3:a433329a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:06.709 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.486454507000001, 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012342531, 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2300 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:06.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123039+0000", 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.123042+0000", 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2289999999999999e-06 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:06.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125053+0000", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020108349999999999 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125088+0000", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5472000000000002e-05 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125106+0000", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7207e-05 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125188+0000", 2024-04-23T19:02:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2473999999999997e-05 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125327+0000", 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013878299999999999 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.125436+0000", 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010893200000000001 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:06.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.134793+0000", 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0093574209999999994 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135267+0000", 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047370000000000002 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135330+0000", 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2910999999999994e-05 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:06.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.135381+0000", 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1567000000000003e-05 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:06.715 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:06.716 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:06.716 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:06.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:06.718 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:06.718 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:06.718 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:06.718 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:06.719 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:06.720 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:06.720 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:06.713+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:06.817 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:06.818+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:06.885 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:06.886 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:06.886 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:06.886 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:06.900 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:06.918 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:06.917+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:07.019 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:07.018+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:07.040 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:02:07.078 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:07.078 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:07.078 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:07.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:07.133 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:07.134+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:07.221 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:07.222+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:07.258 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:07.258 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:07.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2128 3.9 e56/20 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.256611108000001, 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015323256, 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000715+0000", 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.477e-06 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004783+0000", 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040687689999999999 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004810+0000", 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6999999999999999e-05 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004822+0000", 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1768e-05 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004888+0000", 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6135000000000003e-05 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004905+0000", 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7201e-05 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.015977+0000", 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011072039000000001 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.016036+0000", 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8866999999999997e-05 2024-04-23T19:02:07.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2138 3.9 e56/20 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head v 56'2, mlcod=0'0)", 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.148034396, 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015486679999999999, 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109292+0000", 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1639999999999999e-06 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113331+0000", 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040388969999999996 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113352+0000", 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1520000000000001e-05 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113364+0000", 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1548e-05 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113429+0000", 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5455000000000003e-05 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113451+0000", 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1393999999999999e-05 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124722+0000", 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011271458999999999 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124776+0000", 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4243000000000002e-05 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2139 3.13 3:cab0dc9f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:07.267 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.147153264000004, 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016204007999999999, 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2139 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110173+0000", 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.503e-06 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112023+0000", 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018492490000000001 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112057+0000", 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4360999999999998e-05 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112071+0000", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4449e-05 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112162+0000", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0484999999999998e-05 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112315+0000", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015275 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112433+0000", 2024-04-23T19:02:07.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118003 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124291+0000", 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011858153999999999 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126259+0000", 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019684889999999999 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126318+0000", 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9098000000000002e-05 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126375+0000", 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6467e-05 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2153 3.4 e56/20 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.002772053999998, 2024-04-23T19:02:07.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014484469999999999, 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254554+0000", 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.767e-06 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256112+0000", 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015583979999999999 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256137+0000", 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4689999999999999e-05 2024-04-23T19:02:07.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256149+0000", 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1722999999999999e-05 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256214+0000", 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5364000000000006e-05 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256239+0000", 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4754000000000001e-05 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.268971+0000", 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012732647 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269037+0000", 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5127000000000002e-05 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.671714968000003, 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:07.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:02:07.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:02:07.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:02:07.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.282 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2198 3.2d e56/20 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head v 56'3, mlcod=56'1)", 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.577731178000001, 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014321115000000001, 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679595+0000", 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1220000000000002e-06 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683327+0000", 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037316139999999999 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683358+0000", 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1183000000000003e-05 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683373+0000", 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.469e-05 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683506+0000", 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013350999999999999 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683550+0000", 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4056e-05 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693802+0000", 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010251532000000001 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693914+0000", 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112408 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2205 3.2d e56/20 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.453533436000001, 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015864357999999999, 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.287 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803793+0000", 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5799999999999999e-06 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807684+0000", 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038911620000000001 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807718+0000", 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3673000000000001e-05 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807734+0000", 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5913000000000002e-05 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807877+0000", 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014260499999999999 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807927+0000", 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9938999999999997e-05 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819494+0000", 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011567365 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819655+0000", 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112099999999999 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.291 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.393001390999999, 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:07.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:02:07.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:02:07.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:02:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2217 3.3d e57/20 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.197448393999998, 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013378533, 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3799999999999997e-07 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064170+0000", 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042934480000000001 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064200+0000", 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0429e-05 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064214+0000", 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3986e-05 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064305+0000", 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1048e-05 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064327+0000", 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2195e-05 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073180+0000", 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088524520000000002 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073254+0000", 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4437000000000006e-05 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2247 3.2e 3:77104512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.846868084, 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018591723000000001, 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2247 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:07.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410459+0000", 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.004e-06 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412345+0000", 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001885723 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412378+0000", 2024-04-23T19:02:07.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3494999999999997e-05 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412390+0000", 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1402e-05 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412535+0000", 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014549699999999999 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412841+0000", 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306068 2024-04-23T19:02:07.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.413048+0000", 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020667600000000001 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.426308+0000", 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013260532 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428861+0000", 2024-04-23T19:02:07.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025528600000000001 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428950+0000", 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9124999999999998e-05 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.429048+0000", 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7341000000000002e-05 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2248 3.13 3:cafccc7d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.835578268999999, 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017780271, 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2248 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421748+0000", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423913+0000", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165391 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423945+0000", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2002000000000003e-05 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423964+0000", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8745000000000001e-05 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424049+0000", 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4913999999999994e-05 2024-04-23T19:02:07.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424212+0000", 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016343400000000001 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424325+0000", 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113235 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.431161+0000", 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068358630000000002 2024-04-23T19:02:07.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439339+0000", 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081775819999999992 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439449+0000", 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109744 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439526+0000", 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7498999999999998e-05 2024-04-23T19:02:07.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2250 3.21 3:87aecc51:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.805359909, 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017023829000000001, 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2250 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451968+0000", 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5310000000000002e-06 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454099+0000", 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021313209999999998 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454141+0000", 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2363000000000001e-05 2024-04-23T19:02:07.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454163+0000", 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2002999999999999e-05 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454276+0000", 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112453 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454479+0000", 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020322 2024-04-23T19:02:07.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454667+0000", 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018758100000000001 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.463497+0000", 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008830582 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468850+0000", 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053529809999999997 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468928+0000", 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7832999999999998e-05 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468988+0000", 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9960999999999997e-05 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2256 3.21 3:849d8eb6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.710936471, 2024-04-23T19:02:07.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015796782999999998, 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2256 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546390+0000", 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.706e-06 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548597+0000", 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022068180000000001 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548634+0000", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7228999999999999e-05 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548651+0000", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886999999999999e-05 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548767+0000", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115738 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548955+0000", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018769199999999999 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.549161+0000", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020635799999999999 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.557911+0000", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087494389999999995 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562055+0000", 2024-04-23T19:02:07.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041443369999999997 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562125+0000", 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0090000000000001e-05 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562184+0000", 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9488999999999999e-05 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2259 3.13 3:cbd3cfdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.661364917, 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016674984, 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2259 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:07.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595963+0000", 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.597e-06 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598044+0000", 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002080798 2024-04-23T19:02:07.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598095+0000", 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848999999999998e-05 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598125+0000", 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9549000000000001e-05 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598276+0000", 2024-04-23T19:02:07.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151197 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598667+0000", 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039116800000000001 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598963+0000", 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029514 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.607659+0000", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008696723 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612305+0000", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046458209999999996 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612500+0000", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000194649 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612634+0000", 2024-04-23T19:02:07.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013449299999999999 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2264 3.13 3:ca21246b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.603114571999999, 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01879832, 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.328 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2264 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654213+0000", 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1319999999999998e-06 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656725+0000", 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025118319999999999 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656773+0000", 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8641999999999999e-05 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656802+0000", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9232999999999999e-05 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656939+0000", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013616400000000001 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657129+0000", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190077 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657315+0000", 2024-04-23T19:02:07.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018593700000000001 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.670726+0000", 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013411809 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672902+0000", 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021760220000000001 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672952+0000", 2024-04-23T19:02:07.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9243000000000003e-05 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.673008+0000", 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6229e-05 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.446724635999999, 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:02:07.333 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2283 3.2f 3:f4b34eeb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.336655543999999, 2024-04-23T19:02:07.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016414225000000001, 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2283 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920671+0000", 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6579999999999998e-06 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922521+0000", 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001849304 2024-04-23T19:02:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922556+0000", 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5567e-05 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922585+0000", 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8945000000000002e-05 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922689+0000", 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103657 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922794+0000", 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105377 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922883+0000", 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9029000000000004e-05 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.928429+0000", 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055458039999999997 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937001+0000", 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085721329999999991 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937045+0000", 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3551999999999999e-05 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937083+0000", 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8198999999999998e-05 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.292168867000001, 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.343 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:02:07.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2291 3.2f 3:f4447ec0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.232734969999999, 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018374181999999999, 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.348 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2291 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024592+0000", 2024-04-23T19:02:07.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026818+0000", 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002225875 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026846+0000", 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8011999999999999e-05 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026861+0000", 2024-04-23T19:02:07.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5257e-05 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026959+0000", 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7923000000000004e-05 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027146+0000", 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187033 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027316+0000", 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170075 2024-04-23T19:02:07.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.033411+0000", 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060947110000000001 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042837+0000", 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094266430000000002 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042908+0000", 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0859999999999996e-05 2024-04-23T19:02:07.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042963+0000", 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.082985008000001, 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.353 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.358 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.359 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.359 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.359 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.359 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:07.360 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:07.361 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:07.357+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:07.461 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:07.462+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:07.532 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:07.532 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:07.532 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:07.547 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:07.590 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:07.590+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:07.663 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:07.662+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:07.733 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:07.733 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:07.734 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:07.734 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:07.734 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:07.734 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:07.777 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:07.778+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:07.866 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:07.865+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:07.908 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:07.908 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2132 3.28 e56/20 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head v 56'7, mlcod=52'5)", 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.866273511000003, 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016380967, 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.909 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041360+0000", 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.041361+0000", 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3179999999999999e-06 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.910 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045289+0000", 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003928132 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045314+0000", 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4932000000000001e-05 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045327+0000", 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2825e-05 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.911 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045395+0000", 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8508000000000002e-05 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.045417+0000", 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1420000000000002e-05 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057670+0000", 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012252732000000001 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.057741+0000", 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1099999999999994e-05 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2150 3.5 e56/20 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head v 56'3, mlcod=52'1)", 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.679627965000002, 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016970147000000001, 2024-04-23T19:02:07.913 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228010+0000", 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2000000000000002e-06 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232131+0000", 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041208140000000004 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232164+0000", 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2991000000000003e-05 2024-04-23T19:02:07.915 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232180+0000", 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5773999999999998e-05 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232266+0000", 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5572e-05 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232294+0000", 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.798e-05 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244931+0000", 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012637084999999999 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244975+0000", 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4731000000000003e-05 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.675190071999999, 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.918 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:02:07.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:02:07.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.923 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2188 3.2 3:4067ff17:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.373532609000002, 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016815175000000002, 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2188 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534101+0000", 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.534104+0000", 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3890000000000001e-06 2024-04-23T19:02:07.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536507+0000", 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024034410000000001 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536542+0000", 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4332999999999998e-05 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536560+0000", 2024-04-23T19:02:07.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8481000000000001e-05 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536656+0000", 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5533999999999997e-05 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536831+0000", 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000175575 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:07.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.536999+0000", 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016784800000000001 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.543634+0000", 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066347109999999997 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550835+0000", 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0072007310000000001 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550877+0000", 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2379999999999997e-05 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.550916+0000", 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8751999999999998e-05 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:07.929 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.350203808000003, 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.933 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2207 3.1e 3:780a1068:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.079181957999999, 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018197270000000001, 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2207 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:07.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828455+0000", 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.512e-06 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831640+0000", 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003185252 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831706+0000", 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5549000000000005e-05 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831733+0000", 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7809000000000001e-05 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831892+0000", 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159097 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832226+0000", 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033322000000000001 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832553+0000", 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032690300000000002 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.843688+0000", 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011135541000000001 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846344+0000", 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026557830000000001 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846510+0000", 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165766 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846648+0000", 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013883799999999999 2024-04-23T19:02:07.940 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.948667899999997, 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.941 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:07.946 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.901693432999998, 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:07.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:02:07.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:02:07.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:02:07.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:02:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:02:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:02:07.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:02:07.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:02:07.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:02:07.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:07.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:02:07.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:02:07.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:02:07.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:02:07.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:02:07.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:02:07.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:02:07.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:02:07.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.957 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.958 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:07.958 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:07.958 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.841513642999999, 2024-04-23T19:02:07.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:02:07.959 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.959 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.959 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.959 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:07.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:07.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:02:07.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:02:07.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:02:07.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:02:07.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:02:07.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:02:07.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:02:07.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:02:07.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:02:07.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:02:07.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:02:07.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:02:07.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:02:07.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:02:07.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:02:07.968 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.968 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.968 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.969 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2237 3.2 3:428ac9ed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.969 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:02:07.969 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.608190985, 2024-04-23T19:02:07.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016445471, 2024-04-23T19:02:07.969 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.969 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.970 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.970 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.970 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2237 2024-04-23T19:02:07.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.971 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:02:07.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299442+0000", 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.299446+0000", 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1520000000000002e-06 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302644+0000", 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0031979460000000001 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302685+0000", 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0525000000000002e-05 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302702+0000", 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6877000000000001e-05 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.302823+0000", 2024-04-23T19:02:07.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121805 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303049+0000", 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00022504799999999999 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.303364+0000", 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031515900000000002 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.311910+0000", 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085464210000000002 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315716+0000", 2024-04-23T19:02:07.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038055810000000002 2024-04-23T19:02:07.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315812+0000", 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6458000000000004e-05 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.315888+0000", 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5499000000000003e-05 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.979 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.529020737000003, 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:02:07.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:02:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:02:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:02:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:02:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:02:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:02:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:07.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2258 3.29 3:94133d0c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.334023989999999, 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016616373, 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:07.988 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2258 2024-04-23T19:02:07.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:02:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573609+0000", 2024-04-23T19:02:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.573613+0000", 2024-04-23T19:02:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.45e-06 2024-04-23T19:02:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575917+0000", 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023045840000000001 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:07.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575976+0000", 2024-04-23T19:02:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8556e-05 2024-04-23T19:02:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.575997+0000", 2024-04-23T19:02:07.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0761999999999999e-05 2024-04-23T19:02:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576108+0000", 2024-04-23T19:02:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111972 2024-04-23T19:02:07.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576302+0000", 2024-04-23T19:02:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019340899999999999 2024-04-23T19:02:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.576488+0000", 2024-04-23T19:02:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018585800000000001 2024-04-23T19:02:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.584483+0000", 2024-04-23T19:02:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079952800000000004 2024-04-23T19:02:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590103+0000", 2024-04-23T19:02:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0056203709999999999 2024-04-23T19:02:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:07.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590172+0000", 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8613000000000002e-05 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.590226+0000", 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3517999999999998e-05 2024-04-23T19:02:08.000 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.001 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.288194412000003, 2024-04-23T19:02:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:02:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.002 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:02:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.003 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:02:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:02:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:02:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:02:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:02:08.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:02:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:02:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:02:08.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:02:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:02:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:02:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:02:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:02:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:02:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:02:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:02:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:02:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:02:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:02:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:02:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:02:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.259796616999999, 2024-04-23T19:02:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:02:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.016 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:02:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:02:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:02:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:02:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:02:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:02:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:02:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:02:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:02:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:02:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:02:08.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:02:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:02:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:02:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:02:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:02:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.025 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:08.026 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.186805772, 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:02:08.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:02:08.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.057444629999999, 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:02:08.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:02:08.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:02:08.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2292 3.38 3:1e95effa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:08.039 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.870987894999999, 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017689090000000001, 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2292 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036648+0000", 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038325+0000", 2024-04-23T19:02:08.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00167702 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038352+0000", 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7027000000000001e-05 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038362+0000", 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0185e-05 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038440+0000", 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8004999999999996e-05 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038621+0000", 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018072499999999999 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038783+0000", 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016250999999999999 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.050696+0000", 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011913105 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054217+0000", 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035209099999999999 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054283+0000", 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5506000000000006e-05 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054334+0000", 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1743000000000002e-05 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.851534475000001, 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.045 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:08.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2306 3.3c e57/20 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head v 57'6, mlcod=57'4)", 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.71717465, 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016887030000000001, 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190459+0000", 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.190460+0000", 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.519e-06 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194624+0000", 2024-04-23T19:02:08.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041640540000000004 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194650+0000", 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6041e-05 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194663+0000", 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2986000000000001e-05 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194742+0000", 2024-04-23T19:02:08.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8827999999999998e-05 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194774+0000", 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2500999999999999e-05 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207187+0000", 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012412309 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207346+0000", 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015879199999999999 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2307 3.29 3:9750f0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 31.713792714, 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016969273, 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2307 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:08.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193844+0000", 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2140000000000001e-06 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195694+0000", 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018506519999999999 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195714+0000", 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9213000000000001e-05 2024-04-23T19:02:08.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195726+0000", 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2221999999999999e-05 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195803+0000", 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7183999999999998e-05 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195935+0000", 2024-04-23T19:02:08.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013161299999999999 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.196030+0000", 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5032999999999996e-05 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207642+0000", 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011612788000000001 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210690+0000", 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030474299999999998 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210758+0000", 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8514000000000002e-05 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210810+0000", 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1409999999999997e-05 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.060 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:08.061 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:08.061 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:08.062 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:08.062 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:08.061+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:08.163 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:08.161+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:08.192 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:08.192 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:08.192 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:08.192 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:08.207 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:08.297 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:08.293+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:08.365 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:08.366+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:08.373 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:08.373 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:08.373 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:08.373 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:08.373 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:08.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:08.474 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:08.473+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:08.553 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:08.553 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:08.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:08.553 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:08.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.553 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.648098689999998, 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2125 3.3 3:c08a0c87:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.587545378999998, 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017529118, 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.559 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2125 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964243+0000", 2024-04-23T19:02:08.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.964246+0000", 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1480000000000002e-06 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969234+0000", 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049879829999999997 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969264+0000", 2024-04-23T19:02:08.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9864000000000001e-05 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969278+0000", 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4243999999999999e-05 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969362+0000", 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4275000000000002e-05 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969503+0000", 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014088100000000001 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.969621+0000", 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117854 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.978059+0000", 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084378890000000005 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981693+0000", 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036344250000000002 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981734+0000", 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1012e-05 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.981772+0000", 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2128 3.9 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.556185221, 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020104940000000002, 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2128 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995606+0000", 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9859999999999999e-06 2024-04-23T19:02:08.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999480+0000", 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038744750000000001 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999507+0000", 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7229999999999998e-05 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999519+0000", 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1404e-05 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999601+0000", 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1922000000000006e-05 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999767+0000", 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016648699999999999 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999903+0000", 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013553799999999999 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.006027+0000", 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061242520000000002 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015614+0000", 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009586542 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015664+0000", 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0865999999999997e-05 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015708+0000", 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3238000000000002e-05 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2137 3.34 3:2fdd6a5a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.462163646999997, 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017293260000000001, 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.570 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2137 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089624+0000", 2024-04-23T19:02:08.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.089627+0000", 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.993e-06 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094388+0000", 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047608260000000001 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094423+0000", 2024-04-23T19:02:08.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4465999999999998e-05 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094449+0000", 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6463000000000001e-05 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094561+0000", 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011229 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094698+0000", 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013688400000000001 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.094813+0000", 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114623 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.101380+0000", 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065671419999999998 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106765+0000", 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053846240000000002 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106848+0000", 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3287000000000004e-05 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.106918+0000", 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9661999999999998e-05 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.451708085999996, 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:08.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:08.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 34.338899392000002, 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:08.581 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.850327024999999, 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.587 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:08.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:08.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:08.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2204 3.14 3:2b7a418a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.764025727000003, 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018374023, 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2204 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787762+0000", 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.787765+0000", 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9299999999999999e-06 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792512+0000", 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047467719999999998 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792548+0000", 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6170000000000001e-05 2024-04-23T19:02:08.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792565+0000", 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6617e-05 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792637+0000", 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1826e-05 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792754+0000", 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117892 2024-04-23T19:02:08.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.792849+0000", 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4722999999999994e-05 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.800408+0000", 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075589489999999997 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806000+0000", 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055916009999999999 2024-04-23T19:02:08.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806059+0000", 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9684e-05 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.806136+0000", 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6859000000000004e-05 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.598 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.700020805999998, 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.599 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:08.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.589571773000003, 2024-04-23T19:02:08.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:08.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.608 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.037646129000002, 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:08.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:08.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:08.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.842147554, 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.614 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:08.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:08.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2272 3.f e57/20 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.781345080000001, 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018222453, 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770443+0000", 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770446+0000", 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2440000000000002e-06 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773167+0000", 2024-04-23T19:02:08.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027208039999999998 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773220+0000", 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2985999999999997e-05 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773244+0000", 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3876999999999999e-05 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773419+0000", 2024-04-23T19:02:08.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017479799999999999 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773480+0000", 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1945000000000004e-05 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788495+0000", 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015014883999999999 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788665+0000", 2024-04-23T19:02:08.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169915 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.748332337000001, 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:08.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2279 3.31 e57/20 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:02:08.629 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.686138829000001, 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017397382999999999, 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865649+0000", 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.865651+0000", 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3159999999999999e-06 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870481+0000", 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048299570000000002 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870515+0000", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4050000000000001e-05 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870531+0000", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5665999999999999e-05 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870700+0000", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169178 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.870773+0000", 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2992999999999997e-05 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.882908+0000", 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012134725000000001 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.883046+0000", 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138498 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2284 3.1a 3:5a62ea4e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.615687582, 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018303172999999999, 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2284 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936100+0000", 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.936104+0000", 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4539999999999999e-06 2024-04-23T19:02:08.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940422+0000", 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043180930000000003 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940468+0000", 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5915999999999999e-05 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940486+0000", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7725999999999999e-05 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940613+0000", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127816 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.940870+0000", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000256297 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:08.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.941130+0000", 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026009999999999998 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.947876+0000", 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067462779999999996 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954125+0000", 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0062487590000000004 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954282+0000", 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000157262 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954404+0000", 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012147200000000001 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.605671424999997, 2024-04-23T19:02:08.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:08.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:08.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:08.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.584652884999997, 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:08.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:08.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:08.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.474307830000001, 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.649 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:08.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:08.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:08.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.420246196000001, 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:08.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:08.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:08.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.659 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:08.660 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:08.660 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:08.661 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:08.662 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:08.662+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:08.720 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:08.765 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:08.766+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:08.828 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:08.828 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:08.828 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:08.828 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:08.842 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:08.863 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:08.862+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:08.873 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:08.873 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:08.890 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:08.907 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:08.908 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:08.924 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:08.924 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:08.944 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:08.945 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:08.964 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:08.961+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:08.965 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:08.965 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:08.965 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:08.965 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:08.979 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:08.984 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:09.003 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:09.003 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:09.065 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:09.066+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:09.069 INFO:tasks.workunit.client.0.smithi169.stderr:100+0 records in 2024-04-23T19:02:09.069 INFO:tasks.workunit.client.0.smithi169.stderr:100+0 records out 2024-04-23T19:02:09.069 INFO:tasks.workunit.client.0.smithi169.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.79474 s, 154 MB/s 2024-04-23T19:02:09.072 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:02:09.149 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:09.149 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:09.163 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:09.165 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:09.166+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:09.267 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:09.266+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:09.286 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:09.301 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:09.368 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:09.366+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:09.421 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:09.422 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:09.437 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:09.469 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:09.466+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:09.560 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:09.560 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:09.570 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:09.565+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:09.574 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:09.671 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:09.669+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:09.739 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:09.739 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:09.753 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:09.794 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:09.797+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:09.874 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:09.874+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:09.918 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:09.918 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:09.933 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:09.978 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:09.977+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:10.049 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.049 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.062 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:02:10.067 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:10.081 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:10.078+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:10.177 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:10.177+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:10.182 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.182 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:10.278 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:10.277+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:10.313 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.313 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:10.379 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:10.381+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:10.442 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.442 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:10.501 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:10.502+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:10.575 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.575 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.580 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:10.578+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:10.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:10.681 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:10.682+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:10.752 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.752 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:10.782 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:10.781+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:10.883 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:10.882+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:10.930 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:10.930 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:10.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:10.984 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:10.985+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:11.022 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:11.085 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:11.082+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:11.140 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:11.140 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:11.165 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:11.185 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:11.181+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:11.204 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:11.204 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:11.231 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:11.231 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:11.252 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:11.253 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:11.275 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:11.275 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:11.286 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:11.285+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:11.314 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:11.314 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:11.352 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:11.352 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:11.355 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:11.356 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:11.356 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:11.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:11.384 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:11.384 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:11.387 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:11.385+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:11.423 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:11.423 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:11.497 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:11.498+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:11.537 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2128 3.9 e56/20 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.53743334, 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015323256, 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.538 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000713+0000", 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.000715+0000", 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.477e-06 2024-04-23T19:02:11.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004783+0000", 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040687689999999999 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004810+0000", 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6999999999999999e-05 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004822+0000", 2024-04-23T19:02:11.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1768e-05 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004888+0000", 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6135000000000003e-05 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.004905+0000", 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7201e-05 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.015977+0000", 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011072039000000001 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.016036+0000", 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8866999999999997e-05 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2138 3.9 e56/20 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head v 56'2, mlcod=0'0)", 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:11.542 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.428856627999998, 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015486679999999999, 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109290+0000", 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.109292+0000", 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1639999999999999e-06 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113331+0000", 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040388969999999996 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113352+0000", 2024-04-23T19:02:11.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1520000000000001e-05 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113364+0000", 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1548e-05 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113429+0000", 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5455000000000003e-05 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.113451+0000", 2024-04-23T19:02:11.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1393999999999999e-05 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124722+0000", 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011271458999999999 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124776+0000", 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4243000000000002e-05 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2139 3.13 3:cab0dc9f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.427975496000002, 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016204007999999999, 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2139 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.547 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110171+0000", 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.110173+0000", 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.503e-06 2024-04-23T19:02:11.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112023+0000", 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018492490000000001 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112057+0000", 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4360999999999998e-05 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112071+0000", 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4449e-05 2024-04-23T19:02:11.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112162+0000", 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0484999999999998e-05 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112315+0000", 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015275 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.112433+0000", 2024-04-23T19:02:11.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118003 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.124291+0000", 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011858153999999999 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126259+0000", 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019684889999999999 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126318+0000", 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9098000000000002e-05 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.126375+0000", 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6467e-05 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2153 3.4 e56/20 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.283594286000003, 2024-04-23T19:02:11.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014484469999999999, 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254552+0000", 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254554+0000", 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.767e-06 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256112+0000", 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015583979999999999 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256137+0000", 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4689999999999999e-05 2024-04-23T19:02:11.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256149+0000", 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1722999999999999e-05 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256214+0000", 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5364000000000006e-05 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.256239+0000", 2024-04-23T19:02:11.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4754000000000001e-05 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.268971+0000", 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012732647 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269037+0000", 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5127000000000002e-05 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.952537200000002, 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:02:11.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:02:11.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:02:11.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2198 3.2d e56/20 3:b4245aaa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_87:head v 56'3, mlcod=56'1)", 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.858553409999999, 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014321115000000001, 2024-04-23T19:02:11.562 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679593+0000", 2024-04-23T19:02:11.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.679595+0000", 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1220000000000002e-06 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683327+0000", 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0037316139999999999 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683358+0000", 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1183000000000003e-05 2024-04-23T19:02:11.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683373+0000", 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.469e-05 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683506+0000", 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013350999999999999 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.683550+0000", 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4056e-05 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693802+0000", 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010251532000000001 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.693914+0000", 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112408 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2205 3.2d e56/20 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.734355667999999, 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015864357999999999, 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803791+0000", 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.803793+0000", 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5799999999999999e-06 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807684+0000", 2024-04-23T19:02:11.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038911620000000001 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807718+0000", 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3673000000000001e-05 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807734+0000", 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5913000000000002e-05 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807877+0000", 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014260499999999999 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.807927+0000", 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9938999999999997e-05 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819494+0000", 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011567365 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.819655+0000", 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112099999999999 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.673823622999997, 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.573 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:11.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:02:11.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2217 3.3d e57/20 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.478270625999997, 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013378533, 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:11.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059876+0000", 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3799999999999997e-07 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064170+0000", 2024-04-23T19:02:11.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0042934480000000001 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064200+0000", 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0429e-05 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064214+0000", 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3986e-05 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064305+0000", 2024-04-23T19:02:11.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1048e-05 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.064327+0000", 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2195e-05 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073180+0000", 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088524520000000002 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073254+0000", 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4437000000000006e-05 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2247 3.2e 3:77104512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.127690315999999, 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018591723000000001, 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2247 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:11.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410459+0000", 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.004e-06 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412345+0000", 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001885723 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412378+0000", 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3494999999999997e-05 2024-04-23T19:02:11.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412390+0000", 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1402e-05 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412535+0000", 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014549699999999999 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412841+0000", 2024-04-23T19:02:11.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306068 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.413048+0000", 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020667600000000001 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.426308+0000", 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013260532 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428861+0000", 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025528600000000001 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428950+0000", 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9124999999999998e-05 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.429048+0000", 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7341000000000002e-05 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2248 3.13 3:cafccc7d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.116400501000001, 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017780271, 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2248 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421748+0000", 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423913+0000", 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165391 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423945+0000", 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2002000000000003e-05 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423964+0000", 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8745000000000001e-05 2024-04-23T19:02:11.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424049+0000", 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4913999999999994e-05 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424212+0000", 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016343400000000001 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424325+0000", 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113235 2024-04-23T19:02:11.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.431161+0000", 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068358630000000002 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439339+0000", 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081775819999999992 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439449+0000", 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109744 2024-04-23T19:02:11.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439526+0000", 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7498999999999998e-05 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2250 3.21 3:87aecc51:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.086182141000002, 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017023829000000001, 2024-04-23T19:02:11.594 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2250 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.595 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451968+0000", 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5310000000000002e-06 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454099+0000", 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021313209999999998 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454141+0000", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2363000000000001e-05 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454163+0000", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2002999999999999e-05 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454276+0000", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112453 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454479+0000", 2024-04-23T19:02:11.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020322 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454667+0000", 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018758100000000001 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.463497+0000", 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008830582 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468850+0000", 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053529809999999997 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468928+0000", 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7832999999999998e-05 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468988+0000", 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9960999999999997e-05 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.599 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2256 3.21 3:849d8eb6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.991758703000002, 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015796782999999998, 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2256 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.600 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546388+0000", 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.546390+0000", 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.706e-06 2024-04-23T19:02:11.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548597+0000", 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022068180000000001 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548634+0000", 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7228999999999999e-05 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548651+0000", 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6886999999999999e-05 2024-04-23T19:02:11.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548767+0000", 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115738 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.548955+0000", 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018769199999999999 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.549161+0000", 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020635799999999999 2024-04-23T19:02:11.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.557911+0000", 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087494389999999995 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562055+0000", 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041443369999999997 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562125+0000", 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0090000000000001e-05 2024-04-23T19:02:11.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.562184+0000", 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9488999999999999e-05 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2259 3.13 3:cbd3cfdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.942187148999999, 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016674984, 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.605 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2259 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595959+0000", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.595963+0000", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.597e-06 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598044+0000", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002080798 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598095+0000", 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1848999999999998e-05 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598125+0000", 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9549000000000001e-05 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598276+0000", 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151197 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598667+0000", 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039116800000000001 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.598963+0000", 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029514 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.607659+0000", 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008696723 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612305+0000", 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046458209999999996 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612500+0000", 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000194649 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.612634+0000", 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013449299999999999 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2264 3.13 3:ca21246b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.883936804000001, 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01879832, 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2264 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654213+0000", 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1319999999999998e-06 2024-04-23T19:02:11.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656725+0000", 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025118319999999999 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656773+0000", 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8641999999999999e-05 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656802+0000", 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9232999999999999e-05 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656939+0000", 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013616400000000001 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657129+0000", 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190077 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657315+0000", 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018593700000000001 2024-04-23T19:02:11.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.670726+0000", 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013411809 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672902+0000", 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021760220000000001 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672952+0000", 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9243000000000003e-05 2024-04-23T19:02:11.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.673008+0000", 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6229e-05 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.727546867999997, 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.616 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2283 3.2f 3:f4b34eeb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:11.620 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.617477776000001, 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016414225000000001, 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2283 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920669+0000", 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.920671+0000", 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6579999999999998e-06 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922521+0000", 2024-04-23T19:02:11.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001849304 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922556+0000", 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5567e-05 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922585+0000", 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8945000000000002e-05 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922689+0000", 2024-04-23T19:02:11.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103657 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922794+0000", 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105377 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.922883+0000", 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9029000000000004e-05 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.928429+0000", 2024-04-23T19:02:11.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055458039999999997 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937001+0000", 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085721329999999991 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937045+0000", 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3551999999999999e-05 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.937083+0000", 2024-04-23T19:02:11.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8198999999999998e-05 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.572991098999999, 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.626 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2291 3.2f 3:f4447ec0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.631 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.513557202000001, 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018374181999999999, 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2291 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024592+0000", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026818+0000", 2024-04-23T19:02:11.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002225875 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026846+0000", 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8011999999999999e-05 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026861+0000", 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5257e-05 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026959+0000", 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7923000000000004e-05 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027146+0000", 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187033 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027316+0000", 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170075 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.033411+0000", 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060947110000000001 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042837+0000", 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094266430000000002 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042908+0000", 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0859999999999996e-05 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.636 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042963+0000", 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 35.36380724, 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.637 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.642 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.643 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.643 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.643 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:11.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:11.645 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:11.645+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:11.745 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:11.745+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:11.829 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2639 3.28 e74/20 3:159db161:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_74:head v 74'15, mlcod=74'13)", 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.826172+0000", 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.0064003790000000003, 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064209150000000001, 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "started", 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:11.830 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.826172+0000", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.826172+0000", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.826174+0000", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1280000000000002e-06 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.831071+0000", 2024-04-23T19:02:11.831 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048969870000000002 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.831090+0000", 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9196000000000001e-05 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.831099+0000", 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9979999999999992e-06 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:11.832 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.831168+0000", 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8664999999999994e-05 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.831195+0000", 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7152e-05 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: ], 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 1 2024-04-23T19:02:11.833 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:11.846 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:11.845+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:11.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:11.947 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:11.946+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:11.987 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:11.987 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:11.988 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:11.988 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:12.008 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:12.049 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:12.050+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:12.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:02:12.155 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:12.146+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2150 3.5 e56/20 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head v 56'3, mlcod=52'1)", 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.002555166999997, 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016970147000000001, 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.231 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228005+0000", 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.228010+0000", 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2000000000000002e-06 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232131+0000", 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041208140000000004 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232164+0000", 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2991000000000003e-05 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232180+0000", 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5773999999999998e-05 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232266+0000", 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5572e-05 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232294+0000", 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.798e-05 2024-04-23T19:02:12.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244931+0000", 2024-04-23T19:02:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012637084999999999 2024-04-23T19:02:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.244975+0000", 2024-04-23T19:02:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4731000000000003e-05 2024-04-23T19:02:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.237 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.998117274000002, 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.238 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:12.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:02:12.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:02:12.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:02:12.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.673131009999999, 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:02:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.245 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:02:12.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2207 3.1e 3:780a1068:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.402109160000002, 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018197270000000001, 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2207 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828451+0000", 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.828455+0000", 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.512e-06 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831640+0000", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003185252 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831706+0000", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5549000000000005e-05 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831733+0000", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7809000000000001e-05 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.831892+0000", 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159097 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832226+0000", 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033322000000000001 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.832553+0000", 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00032690300000000002 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.843688+0000", 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011135541000000001 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846344+0000", 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0026557830000000001 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846510+0000", 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165766 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.846648+0000", 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013883799999999999 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.271595101999999, 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:12.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:02:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:02:12.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:02:12.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:02:12.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:02:12.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.224620635000001, 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:02:12.262 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.267 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.164440845000001, 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:12.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:02:12.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.851947938999999, 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:02:12.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:02:12.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.611121613999998, 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:02:12.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:02:12.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:02:12.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.582723819000002, 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:12.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:02:12.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.287 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.509732974000002, 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:02:12.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:02:12.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.293 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.380371832000002, 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.295 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:02:12.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2292 3.38 3:1e95effa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.193915097000001, 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017689090000000001, 2024-04-23T19:02:12.299 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2292 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036645+0000", 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.036648+0000", 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:12.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038325+0000", 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00167702 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038352+0000", 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7027000000000001e-05 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038362+0000", 2024-04-23T19:02:12.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0185e-05 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038440+0000", 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8004999999999996e-05 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038621+0000", 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018072499999999999 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.038783+0000", 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016250999999999999 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.050696+0000", 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011913105 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054217+0000", 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0035209099999999999 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054283+0000", 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5506000000000006e-05 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.054334+0000", 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1743000000000002e-05 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.305 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.174461676999996, 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.307 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:02:12.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:02:12.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.311 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2307 3.29 3:9750f0fa:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.036719916000003, 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016969273, 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2307 2024-04-23T19:02:12.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193840+0000", 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.193844+0000", 2024-04-23T19:02:12.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2140000000000001e-06 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195694+0000", 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018506519999999999 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195714+0000", 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9213000000000001e-05 2024-04-23T19:02:12.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195726+0000", 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2221999999999999e-05 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195803+0000", 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7183999999999998e-05 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.195935+0000", 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013161299999999999 2024-04-23T19:02:12.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.196030+0000", 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5032999999999996e-05 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.207642+0000", 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011612788000000001 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210690+0000", 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030474299999999998 2024-04-23T19:02:12.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210758+0000", 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8514000000000002e-05 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.210810+0000", 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1409999999999997e-05 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.317 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2589 3.7 3:e099d359:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.95245905200000003, 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022967630999999999, 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2589 2024-04-23T19:02:12.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278103+0000", 2024-04-23T19:02:12.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.53e-06 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279752+0000", 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001649537 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279779+0000", 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6225e-05 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279790+0000", 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1282e-05 2024-04-23T19:02:12.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279872+0000", 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1750999999999997e-05 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280046+0000", 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017436599999999999 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280209+0000", 2024-04-23T19:02:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000163015 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.289737+0000", 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095279800000000001 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.300928+0000", 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011190930999999999 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301008+0000", 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0530000000000003e-05 2024-04-23T19:02:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301069+0000", 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0483999999999999e-05 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2606 3.24 3:24ce0bc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.76359189199999999, 2024-04-23T19:02:12.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020245796, 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2606 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466971+0000", 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4590000000000001e-06 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468836+0000", 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018649509999999999 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468889+0000", 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3374000000000001e-05 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468905+0000", 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:02:12.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468993+0000", 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7823000000000003e-05 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469141+0000", 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014848500000000001 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469260+0000", 2024-04-23T19:02:12.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118539 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.477188+0000", 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079282559999999998 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487089+0000", 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099014710000000002 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487157+0000", 2024-04-23T19:02:12.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8052000000000005e-05 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487214+0000", 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6913000000000002e-05 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2610 3.28 e74/20 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head v 74'14, mlcod=57'12)", 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.71904903799999997, 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019605237000000001, 2024-04-23T19:02:12.329 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511513+0000", 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516421+0000", 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049076500000000004 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516460+0000", 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8877000000000001e-05 2024-04-23T19:02:12.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516488+0000", 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7991e-05 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516583+0000", 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5161999999999995e-05 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516618+0000", 2024-04-23T19:02:12.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5138000000000001e-05 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531057+0000", 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014438950000000001 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531117+0000", 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9607e-05 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2614 3.2 3:41269b4e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.546571+0000", 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.68398939800000003, 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017834552, 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2614 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546571+0000", 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546571+0000", 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546574+0000", 2024-04-23T19:02:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6390000000000001e-06 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.548385+0000", 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001811593 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.548417+0000", 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1507999999999997e-05 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.548430+0000", 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3617e-05 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.548513+0000", 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2284e-05 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.548642+0000", 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129138 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.548785+0000", 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014360999999999999 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.555451+0000", 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066658059999999998 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.564325+0000", 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0088742130000000006 2024-04-23T19:02:12.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.564370+0000", 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4144999999999998e-05 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.564406+0000", 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5998999999999999e-05 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2633 3.29 3:947900e5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.339 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.47763471899999999, 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020162854000000001, 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2633 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:12.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752928+0000", 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.678e-06 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754759+0000", 2024-04-23T19:02:12.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018305579999999999 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754791+0000", 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2137000000000001e-05 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754806+0000", 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.506e-05 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.342 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754890+0000", 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3547000000000005e-05 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755061+0000", 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017095399999999999 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755221+0000", 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000160786 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.343 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.764529+0000", 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009307872 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.772884+0000", 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083544829999999994 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773000+0000", 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116632 2024-04-23T19:02:12.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773088+0000", 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8146999999999995e-05 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:12.345 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:12.347 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:12.347 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:12.346+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:12.447 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:12.446+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:12.497 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:12.498 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:12.498 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:12.514 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:12.563 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:12.565+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:12.649 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:12.650+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:12.661 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:12.661 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:12.661 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:12.661 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:12.661 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:12.675 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:12.762 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:12.765+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:12.849 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.944265123999998, 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.850 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:12.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:12.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2128 3.9 3:91cfb4f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.852351655, 2024-04-23T19:02:12.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020104940000000002, 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2128 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995603+0000", 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.995606+0000", 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9859999999999999e-06 2024-04-23T19:02:12.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999480+0000", 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038744750000000001 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999507+0000", 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7229999999999998e-05 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999519+0000", 2024-04-23T19:02:12.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1404e-05 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999601+0000", 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1922000000000006e-05 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999767+0000", 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016648699999999999 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:12.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.999903+0000", 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013553799999999999 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.006027+0000", 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061242520000000002 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015614+0000", 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009586542 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015664+0000", 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0865999999999997e-05 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.015708+0000", 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3238000000000002e-05 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.862 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.747874520000003, 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:12.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.868 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.635065826000002, 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.869 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:12.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.146493458999998, 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:12.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:12.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:12.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:12.880 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.996187239999998, 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:12.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:12.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.885738207000003, 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:12.886 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:12.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:12.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.333812563000002, 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:12.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:12.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:12.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.138313988, 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.902 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.044498771000001, 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.908 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.901837858999997, 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:12.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:12.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:12.914 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.880819318999997, 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.918 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.770474264000001, 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:12.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:12.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:12.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.716412630000001, 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.925 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:12.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.930 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.468597975, 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:12.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:12.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.936 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.89407473199999998, 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:12.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:12.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:12.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.942 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2659 3.31 e74/20 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head v 74'9, mlcod=74'7)", 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.76200182599999999, 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020828660999999998, 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085955+0000", 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5940000000000001e-06 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093827+0000", 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078715069999999998 2024-04-23T19:02:12.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093857+0000", 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9963000000000001e-05 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093873+0000", 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6609999999999999e-05 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094012+0000", 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013919099999999999 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094079+0000", 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6148000000000004e-05 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106678+0000", 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012599880000000001 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106781+0000", 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102768 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.67171378500000001, 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.947 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:12.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.951 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.59609642200000001, 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.952 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:12.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:12.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.50372761799999999, 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.958 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:12.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:12.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.963 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:12.964 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:12.964 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:12.965 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:12.966 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:12.962+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:13.066 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:13.066+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:13.080 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:02:13.148 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:13.148 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:13.148 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:13.148 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:13.167 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:13.167 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:13.169+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:13.267 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:13.266+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:13.339 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:13.339 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:13.339 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:13.339 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:13.339 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:13.356 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:13.409 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:13.409+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:13.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:02:13.491 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.630008799000002, 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.497 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2132 3.28 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 39.454779658, 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021363914000000001, 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2132 2024-04-23T19:02:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036340+0000", 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040181+0000", 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038414909999999998 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040205+0000", 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3711e-05 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040217+0000", 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1467e-05 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040291+0000", 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4610000000000006e-05 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040422+0000", 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131297 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040539+0000", 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011694899999999999 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.047401+0000", 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068619040000000003 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057538+0000", 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010136915999999999 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057634+0000", 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5923999999999998e-05 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057701+0000", 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7291000000000003e-05 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 39.268487552000003, 2024-04-23T19:02:13.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:13.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:13.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:13.510 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.604135134000003, 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:02:13.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:02:13.516 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.581976623999999, 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:13.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:13.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.434052508999997, 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:13.523 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:13.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:13.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:13.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.383111438999997, 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.529 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:13.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:13.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:13.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.533 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 38.379248240000003, 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:13.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:13.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:13.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.869225612999998, 2024-04-23T19:02:13.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:13.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:13.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.849701158999999, 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.544 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:13.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:13.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:13.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.793167855, 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.550 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:13.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.555 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.717540458999999, 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:02:13.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:13.561 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.516452323999999, 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:13.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.307560242999998, 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.567 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:13.572 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2313 3.c 3:30fd00ab:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.254511+0000", 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.236605910999998, 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021192193000000002, 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.573 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2313 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254511+0000", 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254511+0000", 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254515+0000", 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6629999999999999e-06 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261256+0000", 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067410450000000002 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261289+0000", 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3266000000000003e-05 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261306+0000", 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7139999999999999e-05 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261435+0000", 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012880199999999999 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261706+0000", 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027071000000000002 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.261943+0000", 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023696399999999999 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.270710+0000", 2024-04-23T19:02:13.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087674829999999995 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.275361+0000", 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00465081 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.275566+0000", 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000204778 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.275703+0000", 2024-04-23T19:02:13.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137532 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.986182128, 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.579 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:13.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.393711849, 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.585 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:13.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:13.589 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.85132139200000001, 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:13.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:13.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:13.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:13.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:13.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2726 3.30 3:0ce56bcb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:13.595 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.61051464200000005, 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021924124999999999, 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2726 2024-04-23T19:02:13.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880606+0000", 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:13.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884605+0000", 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039984160000000003 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884644+0000", 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8813000000000003e-05 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884662+0000", 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8145999999999999e-05 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884745+0000", 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2955999999999997e-05 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884863+0000", 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011857 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884968+0000", 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105176 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.889496+0000", 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004527522 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902433+0000", 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012937277 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902485+0000", 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2188000000000002e-05 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902527+0000", 2024-04-23T19:02:13.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1260999999999997e-05 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2732 3.5 3:a290817c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.51816616500000001, 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022383746999999999, 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:13.602 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2732 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:13.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972955+0000", 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7529999999999999e-06 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.976996+0000", 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040414190000000001 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977054+0000", 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8202000000000003e-05 2024-04-23T19:02:13.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977081+0000", 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6533000000000002e-05 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977243+0000", 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016217400000000001 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977497+0000", 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025378800000000002 2024-04-23T19:02:13.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977735+0000", 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839600000000001 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.989236+0000", 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011500776000000001 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995095+0000", 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058587800000000001 2024-04-23T19:02:13.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995196+0000", 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010110799999999999 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995335+0000", 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138818 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:13.607 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:13.608 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:13.502+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:13.609 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:13.610 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:13.606+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:13.633 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:13.634 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:13.659 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:13.659 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:13.682 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:13.682 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:13.707 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:13.707 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:13.709 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:13.710+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:13.730 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:13.730 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:13.763 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:13.763 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:13.791 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:13.791 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:13.792 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:13.792 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:13.810 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:13.810+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:13.816 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:13.821 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:13.821 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:13.911 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:13.910+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:13.947 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:13.948 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:13.967 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:14.014 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:14.017+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:14.093 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:14.093 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:14.110 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:14.132 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 1Gb. 2024-04-23T19:02:14.132 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:02:14.132 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:02:14.132 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-04-23T19:02:14.132 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:02:14.154 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:14.157+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:14.214 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:14.214+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:14.286 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:14.287 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:14.303 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:14.350 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:14.353+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:14.353 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:02:14.353 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:02:14.416 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:14.417+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:14.430 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:14.430 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:14.443 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:14.534 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:14.537+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:14.611 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:14.612 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:14.617 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:14.618+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:14.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:14.718 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:14.718+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:14.762 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:14.763 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:14.780 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:14.820 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:14.821+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:14.921 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:14.918+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:14.948 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:14.948 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:14.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:15.021 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:15.021+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:15.117 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:02:15.121 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:15.121+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:15.129 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:15.129 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:15.147 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:15.237 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:15.238+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:15.318 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:15.319 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:15.323 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:15.325+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:15.345 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:15.424 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:15.425+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:15.501 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:15.501 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:15.518 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:15.561 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:15.562+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:15.626 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:15.629+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:15.631 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:15.631 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:15.647 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:15.741 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:15.742+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:15.809 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:15.809 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:15.825 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:15.847 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:15.874 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:15.874+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:15.929 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:15.930+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:15.984 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:15.984 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:15.998 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:16.003 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:16.004 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:16.020 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:16.021 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:16.030 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:16.029+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:16.050 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:16.050 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:16.080 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:16.080 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:16.109 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:02:16.115 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:16.115 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:16.130 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:16.133+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:16.136 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:16.136 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:16.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.562006959000001, 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:16.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.283293381999997, 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:02:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:02:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:02:16.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2247 3.2e 3:77104512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.737160074999998, 2024-04-23T19:02:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018591723000000001, 2024-04-23T19:02:16.164 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2247 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410456+0000", 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.410459+0000", 2024-04-23T19:02:16.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.004e-06 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412345+0000", 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001885723 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412378+0000", 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3494999999999997e-05 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412390+0000", 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1402e-05 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412535+0000", 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014549699999999999 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.412841+0000", 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000306068 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.413048+0000", 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020667600000000001 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.426308+0000", 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013260532 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428861+0000", 2024-04-23T19:02:16.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025528600000000001 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.428950+0000", 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9124999999999998e-05 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.429048+0000", 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7341000000000002e-05 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2248 3.13 3:cafccc7d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.725870260000001, 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017780271, 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.171 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2248 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.172 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421746+0000", 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.421748+0000", 2024-04-23T19:02:16.173 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423913+0000", 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165391 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.174 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423945+0000", 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2002000000000003e-05 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.423964+0000", 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8745000000000001e-05 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424049+0000", 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4913999999999994e-05 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.175 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424212+0000", 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016343400000000001 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.424325+0000", 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113235 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.431161+0000", 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068358630000000002 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.176 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439339+0000", 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081775819999999992 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439449+0000", 2024-04-23T19:02:16.177 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109744 2024-04-23T19:02:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.439526+0000", 2024-04-23T19:02:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7498999999999998e-05 2024-04-23T19:02:16.178 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2250 3.21 3:87aecc51:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.695651900000001, 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017023829000000001, 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.179 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2250 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451964+0000", 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.451968+0000", 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5310000000000002e-06 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454099+0000", 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021313209999999998 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454141+0000", 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2363000000000001e-05 2024-04-23T19:02:16.181 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454163+0000", 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2002999999999999e-05 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454276+0000", 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112453 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.182 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454479+0000", 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020322 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.454667+0000", 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018758100000000001 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.463497+0000", 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008830582 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.183 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468850+0000", 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053529809999999997 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468928+0000", 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7832999999999998e-05 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.468988+0000", 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9960999999999997e-05 2024-04-23T19:02:16.184 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2264 3.13 3:ca21246b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.493406563000001, 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01879832, 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.185 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2264 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.186 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654210+0000", 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.654213+0000", 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1319999999999998e-06 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656725+0000", 2024-04-23T19:02:16.187 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025118319999999999 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656773+0000", 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8641999999999999e-05 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656802+0000", 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9232999999999999e-05 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.656939+0000", 2024-04-23T19:02:16.188 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013616400000000001 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657129+0000", 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000190077 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.657315+0000", 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018593700000000001 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.670726+0000", 2024-04-23T19:02:16.189 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013411809 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672902+0000", 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021760220000000001 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.672952+0000", 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9243000000000003e-05 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.190 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.673008+0000", 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6229e-05 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.337016626999997, 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.192 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.193 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.194 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.196 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.197 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.182460857999999, 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:02:16.198 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:02:16.199 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:02:16.200 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.201 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.202 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.203 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.204 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2291 3.2f 3:f4447ec0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.123026961000001, 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018374181999999999, 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.205 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2291 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.206 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024589+0000", 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.024592+0000", 2024-04-23T19:02:16.207 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026818+0000", 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002225875 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026846+0000", 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8011999999999999e-05 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.208 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026861+0000", 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5257e-05 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.026959+0000", 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7923000000000004e-05 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027146+0000", 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187033 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.209 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.027316+0000", 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170075 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.033411+0000", 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060947110000000001 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042837+0000", 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094266430000000002 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.210 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042908+0000", 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0859999999999996e-05 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.042963+0000", 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5078999999999999e-05 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.211 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.973276998999999, 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.212 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:02:16.213 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:02:16.214 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:02:16.215 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:02:16.216 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2590 3.21 3:86702f7a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.8586719049999996, 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028377956999999999, 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.217 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2590 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.218 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288948+0000", 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4089999999999999e-06 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290740+0000", 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001792774 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290764+0000", 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3901999999999999e-05 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.219 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290778+0000", 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3485999999999999e-05 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290847+0000", 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9556999999999998e-05 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290964+0000", 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011652800000000001 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.220 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.291086+0000", 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012249400000000001 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.295914+0000", 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048272369999999998 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317211+0000", 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021297608999999999 2024-04-23T19:02:16.221 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317282+0000", 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0350000000000002e-05 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317322+0000", 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0611000000000001e-05 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2602 3.13 3:c84206b6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.423153+0000", 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.7244635639999997, 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019341764000000001, 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2602 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.223 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.423153+0000", 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.423153+0000", 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.423156+0000", 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8279999999999996e-06 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.224 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425242+0000", 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020859889999999999 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425278+0000", 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5482999999999999e-05 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425297+0000", 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9208e-05 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.225 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425389+0000", 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2015000000000006e-05 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425559+0000", 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170032 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425702+0000", 2024-04-23T19:02:16.226 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014321099999999999 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.432853+0000", 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071505140000000002 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.442414+0000", 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095612070000000004 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.442458+0000", 2024-04-23T19:02:16.227 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3912000000000002e-05 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.442494+0000", 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6365000000000002e-05 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2612 3.1d 3:b8b97969:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.6220029399999998, 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020723431, 2024-04-23T19:02:16.228 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2612 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.229 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525616+0000", 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2119999999999999e-06 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527272+0000", 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001655658 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.230 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527292+0000", 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9466999999999998e-05 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527302+0000", 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527364+0000", 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1520999999999996e-05 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.231 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527520+0000", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156804 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527634+0000", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.535370+0000", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077363500000000003 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.232 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546236+0000", 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010866069000000001 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546281+0000", 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4594e-05 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546337+0000", 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6032000000000002e-05 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.233 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2635 3.2e 3:74863d32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3763565570000003, 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022820072, 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2635 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.234 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771265+0000", 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7989999999999999e-06 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.235 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773229+0000", 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019637729999999998 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773254+0000", 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4494e-05 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773268+0000", 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4117999999999999e-05 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.236 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773369+0000", 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101499 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773539+0000", 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017010199999999999 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773696+0000", 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697000000000001 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.783147+0000", 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094510140000000006 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.793991+0000", 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010843428 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794032+0000", 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1223999999999997e-05 2024-04-23T19:02:16.238 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794080+0000", 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7651000000000002e-05 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2654 3.1d 3:bbe5d29a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.015661+0000", 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.1319548729999998, 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019430334, 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.239 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2654 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.015661+0000", 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.240 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.015661+0000", 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.015666+0000", 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3839999999999999e-06 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019355+0000", 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036894369999999998 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.241 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019390+0000", 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5336999999999997e-05 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019406+0000", 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5775999999999999e-05 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019480+0000", 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3961999999999994e-05 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.242 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019594+0000", 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113647 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019689+0000", 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4907999999999993e-05 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.025136+0000", 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054473459999999996 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.243 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.034958+0000", 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098223979999999995 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.035032+0000", 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3336000000000004e-05 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.035092+0000", 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9803000000000003e-05 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.244 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2661 3.13 3:caea25e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0422116219999999, 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020454087999999999, 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2661 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.245 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105408+0000", 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8e-06 2024-04-23T19:02:16.246 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107045+0000", 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016363980000000001 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107079+0000", 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3899999999999997e-05 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107102+0000", 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159e-05 2024-04-23T19:02:16.247 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107187+0000", 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4775000000000001e-05 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107359+0000", 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017244600000000001 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107473+0000", 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113565 2024-04-23T19:02:16.248 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.113697+0000", 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062245319999999996 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125770+0000", 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012073122 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125810+0000", 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9662000000000001e-05 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125859+0000", 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8729000000000001e-05 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2664 3.13 3:c816585d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0092259290000003, 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025442844999999999, 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.250 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2664 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.251 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138393+0000", 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0960000000000001e-06 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140225+0000", 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018314309999999999 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.252 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140257+0000", 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2319e-05 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140272+0000", 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4800000000000001e-05 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140345+0000", 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3120999999999993e-05 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.253 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140507+0000", 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016169700000000001 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140629+0000", 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121945 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.147178+0000", 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065491350000000002 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.254 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163685+0000", 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016507705000000001 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163770+0000", 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4227999999999994e-05 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163833+0000", 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3367999999999994e-05 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.255 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2671 3.13 3:ca8a8235:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.216816+0000", 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.9307997509999999, 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017513198000000001, 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2671 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.256 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.216816+0000", 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.216816+0000", 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.216819+0000", 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.875e-06 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.257 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.218980+0000", 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021602639999999998 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.219005+0000", 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5834e-05 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.219019+0000", 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3732e-05 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.258 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.219098+0000", 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8992000000000005e-05 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.219254+0000", 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015547400000000001 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.219377+0000", 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012311399999999999 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.225725+0000", 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006347976 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.234206+0000", 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084808460000000002 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.234273+0000", 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7745999999999998e-05 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.260 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.234330+0000", 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6344999999999997e-05 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2703 3.4 e74/20 3:235c0b5d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_138:head v 74'6, mlcod=74'4)", 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.549521+0000", 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.5980952799999999, 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018955988999999999, 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.261 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549521+0000", 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549521+0000", 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.262 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549524+0000", 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.751e-06 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551357+0000", 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018333799999999999 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551384+0000", 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6580999999999998e-05 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.263 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551397+0000", 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3594000000000001e-05 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551483+0000", 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5601999999999998e-05 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551505+0000", 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1940999999999999e-05 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.264 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568399+0000", 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016894704 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568477+0000", 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7435999999999995e-05 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2755 3.1d 3:b99e894a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.304226+0000", 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.8433904220000001, 2024-04-23T19:02:16.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019321808999999999, 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2755 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304226+0000", 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304226+0000", 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304229+0000", 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5669999999999999e-06 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308218+0000", 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039889189999999996 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308247+0000", 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9166000000000002e-05 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308262+0000", 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4766000000000001e-05 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308350+0000", 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7683999999999996e-05 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308556+0000", 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000206257 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308702+0000", 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000146334 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.271 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.318357+0000", 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0096545940000000007 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.323260+0000", 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049031450000000002 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.323425+0000", 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000164735 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.323548+0000", 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012264200000000001 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.273 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:16.274 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:16.274 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:16.275 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:16.276 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:16.276 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:16.277 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:16.274+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:16.376 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:16.377+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:16.438 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:16.438 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:16.438 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:16.438 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:16.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:16.477 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:16.477+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:16.567 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:16.567 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:16.567 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:16.567 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:16.567 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:16.578 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:16.577+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:16.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:16.679 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:16.681+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:16.700 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:16.700 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:16.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.466331304000001, 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.701 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:02:16.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:02:16.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:02:16.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:02:16.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:16.706 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.141345039999997, 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:02:16.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:16.712 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.739809131999998, 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.692834664999999, 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.719 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.632654875, 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:02:16.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.320161968999997, 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:02:16.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:16.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:02:16.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:02:16.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:02:16.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.079335643999997, 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.736 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:02:16.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:16.742 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.050937849, 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:02:16.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.977947004000001, 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.753 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.848585862, 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:16.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:02:16.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:02:16.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.642675707000002, 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:02:16.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.765 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2589 3.7 3:e099d359:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.4206730820000004, 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022967630999999999, 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.766 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2589 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278103+0000", 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.53e-06 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279752+0000", 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001649537 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279779+0000", 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6225e-05 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279790+0000", 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1282e-05 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279872+0000", 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1750999999999997e-05 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280046+0000", 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017436599999999999 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280209+0000", 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000163015 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.289737+0000", 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095279800000000001 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.300928+0000", 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011190930999999999 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301008+0000", 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0530000000000003e-05 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301069+0000", 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0483999999999999e-05 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.771 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2606 3.24 3:24ce0bc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2318059220000004, 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020245796, 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.772 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2606 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.773 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466971+0000", 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4590000000000001e-06 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468836+0000", 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018649509999999999 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.774 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468889+0000", 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3374000000000001e-05 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468905+0000", 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468993+0000", 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7823000000000003e-05 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.775 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469141+0000", 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014848500000000001 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469260+0000", 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118539 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.776 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.477188+0000", 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079282559999999998 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487089+0000", 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099014710000000002 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487157+0000", 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8052000000000005e-05 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.777 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487214+0000", 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6913000000000002e-05 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2610 3.28 e74/20 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head v 74'14, mlcod=57'12)", 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.187263068, 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019605237000000001, 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.778 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.779 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511513+0000", 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516421+0000", 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049076500000000004 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516460+0000", 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8877000000000001e-05 2024-04-23T19:02:16.780 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516488+0000", 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7991e-05 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516583+0000", 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5161999999999995e-05 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516618+0000", 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5138000000000001e-05 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.781 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531057+0000", 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014438950000000001 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531117+0000", 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9607e-05 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.782 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2633 3.29 3:947900e5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.9458487489999996, 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020162854000000001, 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2633 2024-04-23T19:02:16.783 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752928+0000", 2024-04-23T19:02:16.784 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.678e-06 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754759+0000", 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018305579999999999 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754791+0000", 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2137000000000001e-05 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754806+0000", 2024-04-23T19:02:16.785 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.506e-05 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754890+0000", 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3547000000000005e-05 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755061+0000", 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017095399999999999 2024-04-23T19:02:16.786 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755221+0000", 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000160786 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.764529+0000", 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009307872 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.787 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.772884+0000", 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083544829999999994 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773000+0000", 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116632 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.788 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773088+0000", 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8146999999999995e-05 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2656 3.29 3:948bcae1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.657587082, 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022388272000000001, 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.789 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2656 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041190+0000", 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.022e-06 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.791 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043694+0000", 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025040980000000002 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043725+0000", 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0676999999999998e-05 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043740+0000", 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4956999999999999e-05 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.792 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043815+0000", 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5221000000000004e-05 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043939+0000", 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000123752 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.044030+0000", 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1100000000000005e-05 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.793 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.050413+0000", 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063828110000000004 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063437+0000", 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013023998 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.794 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063520+0000", 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3217e-05 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063576+0000", 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5418999999999999e-05 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2675 3.27 3:e6fd3fd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4372798360000001, 2024-04-23T19:02:16.795 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019592078999999998, 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2675 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.796 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261497+0000", 2024-04-23T19:02:16.797 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6520000000000002e-06 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262858+0000", 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013611439999999999 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262888+0000", 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0035e-05 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.798 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262904+0000", 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5622999999999999e-05 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262986+0000", 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2356999999999998e-05 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.263133+0000", 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014631600000000001 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.799 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.263298+0000", 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016500799999999999 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.271403+0000", 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081050800000000006 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.800 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.280998+0000", 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095951939999999996 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.281036+0000", 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8217999999999999e-05 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.281087+0000", 2024-04-23T19:02:16.801 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0451999999999997e-05 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2680 3.38 3:1f9aecb2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.383204686, 2024-04-23T19:02:16.802 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019232905000000002, 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2680 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.803 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.804 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315573+0000", 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2370000000000001e-06 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317162+0000", 2024-04-23T19:02:16.805 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015887200000000001 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317180+0000", 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8000999999999999e-05 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317190+0000", 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9159999999999996e-06 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317265+0000", 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5400000000000003e-05 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.807 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317441+0000", 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017650599999999999 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317607+0000", 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016575499999999999 2024-04-23T19:02:16.808 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.323096+0000", 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054891970000000003 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334677+0000", 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011580567999999999 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.809 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334745+0000", 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7800999999999997e-05 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334803+0000", 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7803999999999997e-05 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.810 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2724 3.24 3:242ccc30:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.8533744990000001, 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019407211000000001, 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2724 2024-04-23T19:02:16.811 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.812 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845404+0000", 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.63e-06 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847765+0000", 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023616370000000002 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.813 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847794+0000", 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9145999999999998e-05 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847812+0000", 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7516999999999998e-05 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847959+0000", 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014682000000000001 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.814 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.848303+0000", 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000343999 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.848782+0000", 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047950800000000002 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.815 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.859976+0000", 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011193732 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864734+0000", 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047579570000000002 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864774+0000", 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9777000000000002e-05 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.816 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864807+0000", 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2767 3.38 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:16.817 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.2098455339999998, 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026034438999999999, 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2767 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.818 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488932+0000", 2024-04-23T19:02:16.819 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569999999999998e-06 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491230+0000", 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002297959 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491265+0000", 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4915e-05 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.820 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491281+0000", 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5885000000000001e-05 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491389+0000", 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010790600000000001 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491596+0000", 2024-04-23T19:02:16.821 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000206622 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491829+0000", 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000233143 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.503280+0000", 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011451823 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.822 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514817+0000", 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011536332999999999 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514899+0000", 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2245999999999998e-05 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:16.823 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514963+0000", 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4250000000000003e-05 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:16.824 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:16.826 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:16.826 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:16.826+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:16.926 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:16.928+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:16.959 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:16.959 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:16.959 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:16.959 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:16.973 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:17.058 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:17.060+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:17.128 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:17.126+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:17.138 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:17.139 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:17.139 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:17.139 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:17.139 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:17.153 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:17.230 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:17.230+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:17.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T19:02:17.306 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-23T19:02:17.331 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:17.331 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:17.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:17.331 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:17.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.425674956999998, 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:17.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:17.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.229284352999997, 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:17.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:17.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:17.343 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.116475659000002, 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.344 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:17.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.627903291999999, 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.350 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.477597072999998, 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.355 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:17.360 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.367148040000004, 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:17.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:17.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.815222396000003, 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.365 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.619723821000001, 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:17.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.525908604000001, 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:17.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:17.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.383247691999998, 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:17.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.362229151999998, 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.388 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:17.392 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.251884097000001, 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:17.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.197822463000001, 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:17.398 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.9500078079999996, 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.404 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.405 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:17.409 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3754845649999998, 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.410 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2659 3.31 e74/20 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head v 74'9, mlcod=74'7)", 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:17.415 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.2434116590000004, 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020828660999999998, 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085955+0000", 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5940000000000001e-06 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093827+0000", 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078715069999999998 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093857+0000", 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9963000000000001e-05 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093873+0000", 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6609999999999999e-05 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094012+0000", 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013919099999999999 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094079+0000", 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6148000000000004e-05 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106678+0000", 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012599880000000001 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106781+0000", 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102768 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:17.419 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1531236180000004, 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.423 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.0775062550000003, 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:17.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:17.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:17.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:17.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:17.428 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.9851374509999999, 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.429 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:17.434 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.8520000319999999, 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:17.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:02:17.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:02:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.440 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:17.441 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:17.354+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:17.442 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:17.442 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:17.442+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:17.543 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:17.542+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:17.571 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:17.571 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:17.571 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:17.571 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:17.585 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:17.644 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:17.642+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:17.705 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:17.705 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:17.705 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:17.705 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:17.705 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:17.720 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:17.745 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:17.742+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:17.846 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:17.846 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:17.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:17.846 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.983867547999999, 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:02:17.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:02:17.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:02:17.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2132 3.28 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.808638406999997, 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021363914000000001, 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.852 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2132 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036340+0000", 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040181+0000", 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038414909999999998 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040205+0000", 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3711e-05 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040217+0000", 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1467e-05 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040291+0000", 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4610000000000006e-05 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040422+0000", 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131297 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040539+0000", 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011694899999999999 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.047401+0000", 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068619040000000003 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057538+0000", 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010136915999999999 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057634+0000", 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5923999999999998e-05 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057701+0000", 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7291000000000003e-05 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.857 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.622346301, 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:17.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:17.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:17.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:17.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.957993883, 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:02:17.863 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.935835373000003, 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:17.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:17.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.787911258000001, 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.874 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:17.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:17.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:17.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.879 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.736970188000001, 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.733106988999999, 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:17.889 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.223084362000002, 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:17.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:17.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.893 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.203559908000003, 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.147026603999997, 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.899 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:17.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:17.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:17.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:17.905 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.905 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.905 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.071399208000003, 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.906 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:02:17.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:02:17.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.870311073000003, 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.911 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:17.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:17.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:17.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:17.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.661418992000002, 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:17.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.3400408769999999, 2024-04-23T19:02:17.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:17.928 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.7475705980000003, 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:17.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:17.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:17.932 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.2051801409999996, 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.933 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2726 3.30 3:0ce56bcb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:17.938 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.9643733909999996, 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021924124999999999, 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2726 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:17.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880606+0000", 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884605+0000", 2024-04-23T19:02:17.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039984160000000003 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884644+0000", 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8813000000000003e-05 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884662+0000", 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8145999999999999e-05 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884745+0000", 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2955999999999997e-05 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884863+0000", 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011857 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884968+0000", 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105176 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.889496+0000", 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004527522 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902433+0000", 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012937277 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902485+0000", 2024-04-23T19:02:17.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2188000000000002e-05 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902527+0000", 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1260999999999997e-05 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2732 3.5 3:a290817c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:17.944 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.8720249139999998, 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022383746999999999, 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2732 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:17.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972955+0000", 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7529999999999999e-06 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.976996+0000", 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040414190000000001 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977054+0000", 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8202000000000003e-05 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977081+0000", 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6533000000000002e-05 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977243+0000", 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016217400000000001 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977497+0000", 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025378800000000002 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977735+0000", 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839600000000001 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:17.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.989236+0000", 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011500776000000001 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995095+0000", 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058587800000000001 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995196+0000", 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010110799999999999 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995335+0000", 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138818 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2767 3.38 e75/20 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head v 75'8, mlcod=74'6)", 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3527713820000002, 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022125346000000001, 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:17.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496255+0000", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040496459999999996 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496290+0000", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999000000000002e-05 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496307+0000", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:17.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496440+0000", 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013291099999999999 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496482+0000", 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1802999999999999e-05 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514167+0000", 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685523000000002 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:17.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514330+0000", 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000162724 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:17.954 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:17.955 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:17.846+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:17.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:17.956 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:17.956+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:18.056 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:18.056+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:18.106 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.0 to 1 (10000) 2024-04-23T19:02:18.128 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:18.128 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:18.128 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:18.128 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:18.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:02:18.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-23T19:02:18.142 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:18.186 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:18.188+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:18.259 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:18.258+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:18.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:18.308 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:18.308 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:18.308 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:18.308 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:18.308 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:18.322 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:18.360 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:18.358+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:18.418 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:18.418 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:18.434 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:18.448 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:18.448 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 43.350610283000002, 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.449 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:18.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:18.455 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.759510093000003, 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.663231607, 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.461 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:02:18.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.399555585999998, 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.467 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:18.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:18.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.294441040000002, 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.475 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:18.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:18.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:18.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.480 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 42.147867857000001, 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:18.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:18.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:18.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:18.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:18.485 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.8300304240000003, 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.486 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.488 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:18.491 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.8208500660000002, 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:18.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:18.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.496 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.8113875759999996, 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.497 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:18.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:18.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.7920273269999996, 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.502 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:18.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:18.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:18.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.2768933090000001, 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.2654120830000002, 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.513 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:18.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:18.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:18.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:18.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:18.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:18.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.521 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2670 3.36 3:6da56ef5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.2412471470000002, 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021558461000000001, 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2670 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.522 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205488+0000", 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1559999999999999e-06 2024-04-23T19:02:18.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210364+0000", 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048764610000000003 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210390+0000", 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5599e-05 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210405+0000", 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5136999999999999e-05 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210541+0000", 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210854+0000", 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031316699999999999 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.211075+0000", 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022038 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226617+0000", 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015541721 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226809+0000", 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019238999999999999 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226936+0000", 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012679400000000001 2024-04-23T19:02:18.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.227043+0000", 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107475 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2679 3.a 3:53d5047c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.1406145639999998, 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021012060999999999, 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.527 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2679 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:18.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306121+0000", 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4699999999999998e-06 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310690+0000", 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045696959999999998 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310727+0000", 2024-04-23T19:02:18.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6040000000000001e-05 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310743+0000", 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6841999999999999e-05 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310893+0000", 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014921800000000001 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311178+0000", 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028541500000000002 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311409+0000", 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023114300000000001 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.319813+0000", 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084038440000000006 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.326919+0000", 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071059540000000003 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327015+0000", 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5702e-05 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327129+0000", 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114737 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.532 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2696 3.26 3:64250b99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.9674358979999997, 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023196560000000001, 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.533 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2696 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479299+0000", 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.576e-06 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483218+0000", 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003919774 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483251+0000", 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3145999999999997e-05 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483269+0000", 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7975999999999999e-05 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483360+0000", 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0916999999999997e-05 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483543+0000", 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183117 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483710+0000", 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016664100000000001 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.492065+0000", 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083545400000000006 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502380+0000", 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010315718 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502442+0000", 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1897999999999996e-05 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502493+0000", 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0256999999999997e-05 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2709 3.3f e74/20 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:18.538 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.8303609810000001, 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021298837000000001, 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:18.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616373+0000", 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7579999999999999e-06 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618956+0000", 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025837170000000001 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618984+0000", 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7470999999999998e-05 2024-04-23T19:02:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618998+0000", 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4527e-05 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619135+0000", 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013695499999999999 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619178+0000", 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2774000000000001e-05 2024-04-23T19:02:18.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637529+0000", 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018350789999999999 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637670+0000", 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014084500000000001 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.542 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.8271617769999997, 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.4879343110000001, 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:18.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:18.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.553 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2771 3.20 3:0642e822:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.9024159659999995, 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020962379, 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2771 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544319+0000", 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.54e-06 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547645+0000", 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033258020000000001 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547682+0000", 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7058999999999999e-05 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547701+0000", 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8450000000000001e-05 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547819+0000", 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118072 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547950+0000", 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013113999999999999 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.548056+0000", 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105782 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.554076+0000", 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060202390000000001 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565102+0000", 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011026144999999999 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565205+0000", 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102848 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565278+0000", 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3301999999999997e-05 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2778 3.a 3:517c3c8c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.8270531439999997, 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021706072, 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:18.559 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2778 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:18.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619682+0000", 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1200000000000002e-06 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623671+0000", 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887489999999998 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:18.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623703+0000", 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2465999999999997e-05 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623719+0000", 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6226e-05 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623882+0000", 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016293699999999999 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624278+0000", 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039613300000000001 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624707+0000", 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042824600000000002 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.633735+0000", 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090279169999999999 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641200+0000", 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074658709999999998 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641297+0000", 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6644999999999994e-05 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641385+0000", 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7762000000000004e-05 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.564 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.565 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.565 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:18.565 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:18.565 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:18.566 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:18.566 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:18.567 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:18.567 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:18.567 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:18.568 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:18.568+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:18.568 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:18.568 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:18.569 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:18.569 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:18.569 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:18.570 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:18.570 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:18.571 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:18.667 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:18.666+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:18.738 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:18.738 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:18.752 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:18.767 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:18.766+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:18.869 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:18.866+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:18.869 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:18.869 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:18.883 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:18.969 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:18.968+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:19.000 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:19.000 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:19.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:19.071 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:19.069+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:19.114 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:02:19.114 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.1 to 1 (10000) 2024-04-23T19:02:19.145 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:19.154 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:19.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:19.171 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:19.172+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:19.272 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:19.269+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:19.333 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:19.333 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:19.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:19.373 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:19.372+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:19.473 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:19.473+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:19.515 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:19.515 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:19.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:19.574 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:19.576+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:19.675 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:19.676+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:19.696 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:19.696 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:19.710 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:19.776 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:19.773+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:19.832 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:19.833 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:19.847 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:19.890 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:19.889+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:19.978 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:19.977+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:20.012 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:20.012 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:20.026 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:20.078 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:20.080+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:20.127 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.2 to 1 (10000) 2024-04-23T19:02:20.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-23T19:02:20.179 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:20.180+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:20.199 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:20.200 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:20.215 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:20.309 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:20.309+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:20.381 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:20.381+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:20.384 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:20.384 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:20.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:20.489 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:20.489+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:20.565 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:20.565 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:20.574 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:20.579 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:20.622 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:20.621+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:20.684 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:20.681+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:20.715 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:20.716 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:20.732 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:20.743 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:20.743 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:20.751 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:20.758 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:20.767 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:20.768 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:20.788 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:20.789 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:20.789 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:20.785+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:20.809 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:20.809 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:20.830 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:20.830 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:20.851 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:20.851 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:20.882 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:20.882 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:20.882 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:20.882 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:20.882 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:20.886 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:20.884+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:20.896 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:20.986 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:20.988+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:21.059 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.825665399000002, 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.060 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:21.066 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.500679134999999, 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:02:21.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:02:21.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:02:21.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.099143226999999, 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.077 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.052168760000001, 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.078 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:02:21.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.083 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.991988970000001, 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.679496063999999, 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.438669738999998, 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.093 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:02:21.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.410271944000002, 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:02:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:02:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:02:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.337281099000002, 2024-04-23T19:02:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:02:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:02:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.207919957000001, 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.114 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.002009802000003, 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:02:21.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:02:21.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.120 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2589 3.7 3:e099d359:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.7800071769999999, 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022967630999999999, 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2589 2024-04-23T19:02:21.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278103+0000", 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.53e-06 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279752+0000", 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001649537 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279779+0000", 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6225e-05 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279790+0000", 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1282e-05 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279872+0000", 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1750999999999997e-05 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280046+0000", 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017436599999999999 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280209+0000", 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000163015 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.289737+0000", 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095279800000000001 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.300928+0000", 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011190930999999999 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301008+0000", 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0530000000000003e-05 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301069+0000", 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0483999999999999e-05 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2606 3.24 3:24ce0bc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5911400170000007, 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020245796, 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2606 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466971+0000", 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4590000000000001e-06 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468836+0000", 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018649509999999999 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468889+0000", 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3374000000000001e-05 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468905+0000", 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468993+0000", 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7823000000000003e-05 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469141+0000", 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014848500000000001 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469260+0000", 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118539 2024-04-23T19:02:21.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.477188+0000", 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079282559999999998 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487089+0000", 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099014710000000002 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487157+0000", 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8052000000000005e-05 2024-04-23T19:02:21.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487214+0000", 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6913000000000002e-05 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2610 3.28 e74/20 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head v 74'14, mlcod=57'12)", 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5465971629999995, 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019605237000000001, 2024-04-23T19:02:21.132 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511513+0000", 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516421+0000", 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049076500000000004 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516460+0000", 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8877000000000001e-05 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516488+0000", 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7991e-05 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516583+0000", 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5161999999999995e-05 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516618+0000", 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5138000000000001e-05 2024-04-23T19:02:21.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531057+0000", 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014438950000000001 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531117+0000", 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9607e-05 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2633 3.29 3:947900e5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.136 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.3051828440000008, 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020162854000000001, 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2633 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752928+0000", 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.678e-06 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754759+0000", 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018305579999999999 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754791+0000", 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2137000000000001e-05 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754806+0000", 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.506e-05 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754890+0000", 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3547000000000005e-05 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755061+0000", 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017095399999999999 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755221+0000", 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000160786 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.764529+0000", 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009307872 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.772884+0000", 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083544829999999994 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773000+0000", 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116632 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773088+0000", 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8146999999999995e-05 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2656 3.29 3:948bcae1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.0169211770000004, 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022388272000000001, 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2656 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041190+0000", 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.022e-06 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043694+0000", 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025040980000000002 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043725+0000", 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0676999999999998e-05 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043740+0000", 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4956999999999999e-05 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043815+0000", 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5221000000000004e-05 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043939+0000", 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000123752 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.044030+0000", 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1100000000000005e-05 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.050413+0000", 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063828110000000004 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063437+0000", 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013023998 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063520+0000", 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3217e-05 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063576+0000", 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5418999999999999e-05 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2675 3.27 3:e6fd3fd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.7966139309999996, 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019592078999999998, 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2675 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261497+0000", 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6520000000000002e-06 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262858+0000", 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013611439999999999 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262888+0000", 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0035e-05 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262904+0000", 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5622999999999999e-05 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262986+0000", 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2356999999999998e-05 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.263133+0000", 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014631600000000001 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.263298+0000", 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016500799999999999 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.271403+0000", 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081050800000000006 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.280998+0000", 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095951939999999996 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.281036+0000", 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8217999999999999e-05 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.281087+0000", 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0451999999999997e-05 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2680 3.38 3:1f9aecb2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.7425387810000004, 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019232905000000002, 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.153 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2680 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315573+0000", 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2370000000000001e-06 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317162+0000", 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015887200000000001 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.155 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317180+0000", 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8000999999999999e-05 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317190+0000", 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9159999999999996e-06 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317265+0000", 2024-04-23T19:02:21.156 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5400000000000003e-05 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317441+0000", 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017650599999999999 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317607+0000", 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016575499999999999 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.323096+0000", 2024-04-23T19:02:21.157 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054891970000000003 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334677+0000", 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011580567999999999 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334745+0000", 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7800999999999997e-05 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334803+0000", 2024-04-23T19:02:21.158 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7803999999999997e-05 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2724 3.24 3:242ccc30:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 8.2127085940000004, 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019407211000000001, 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.159 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2724 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.160 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845404+0000", 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.63e-06 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847765+0000", 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023616370000000002 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847794+0000", 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9145999999999998e-05 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.161 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847812+0000", 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7516999999999998e-05 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847959+0000", 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014682000000000001 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.848303+0000", 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000343999 2024-04-23T19:02:21.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.848782+0000", 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047950800000000002 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.859976+0000", 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011193732 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864734+0000", 2024-04-23T19:02:21.163 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047579570000000002 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864774+0000", 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9777000000000002e-05 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864807+0000", 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2767 3.38 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 7.5691796289999997, 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026034438999999999, 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2767 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.165 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488932+0000", 2024-04-23T19:02:21.166 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569999999999998e-06 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491230+0000", 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002297959 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491265+0000", 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4915e-05 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491281+0000", 2024-04-23T19:02:21.167 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5885000000000001e-05 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491389+0000", 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010790600000000001 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491596+0000", 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000206622 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:21.168 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491829+0000", 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000233143 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.503280+0000", 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011451823 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514817+0000", 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011536332999999999 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:21.169 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514899+0000", 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2245999999999998e-05 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514963+0000", 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4250000000000003e-05 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:21.170 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:21.171 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:02:21.172 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:21.172+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:21.173 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:21.174 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.3 to 1 (10000) 2024-04-23T19:02:21.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-23T19:02:21.273 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:21.272+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:21.307 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:21.307 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:21.307 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:21.307 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:21.322 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:21.373 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:21.373+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:21.474 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:21.473+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:21.492 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:21.492 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:21.492 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:21.492 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:21.492 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:21.507 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:21.575 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:21.573+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:21.628 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:21.628 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.725549485000002, 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:21.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.634 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.529158881000001, 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.635 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:21.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:21.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:21.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:21.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.416350186999999, 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:21.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:21.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:21.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:21.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.927777820000003, 2024-04-23T19:02:21.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:21.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:21.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.777471601000002, 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:21.652 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.657 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.667022568, 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:21.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:21.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:21.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:21.661 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.115096923999999, 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.662 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:21.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.919598348999997, 2024-04-23T19:02:21.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:21.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:21.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:21.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.825783131999998, 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.673 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:21.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:21.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:21.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:21.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.683122220000001, 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:21.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:21.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:21.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.662103680000001, 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:21.684 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.688 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.551758624999998, 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 45.497696990999998, 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.694 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:21.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.249882336000001, 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.6753590930000009, 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.705 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:21.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:21.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:21.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2659 3.31 e74/20 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head v 74'9, mlcod=74'7)", 2024-04-23T19:02:21.710 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.5432861869999996, 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020828660999999998, 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:21.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085955+0000", 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5940000000000001e-06 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093827+0000", 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078715069999999998 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093857+0000", 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9963000000000001e-05 2024-04-23T19:02:21.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093873+0000", 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6609999999999999e-05 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094012+0000", 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013919099999999999 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094079+0000", 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6148000000000004e-05 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106678+0000", 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012599880000000001 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106781+0000", 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102768 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:21.714 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.4529981460000005, 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:21.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:21.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.3773807829999996, 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2850119790000001, 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.724 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:21.729 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1518745599999995, 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:21.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:21.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:21.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:02:21.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:02:21.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:02:21.735 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.735 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.735 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.735 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:21.735 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:21.735 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:21.736 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:21.737 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:21.733+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:21.837 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:21.836+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:21.864 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:21.864 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:21.864 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:21.864 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:21.878 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:21.967 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:21.968+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:22.039 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:22.037+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:22.045 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:22.046 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:22.046 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:22.046 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:22.046 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:22.060 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:22.140 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:02:22.146 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.4 to 1 (10000) 2024-04-23T19:02:22.150 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:22.152+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:22.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.371311745, 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.234 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.239 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2132 3.28 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 48.196082603999997, 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021363914000000001, 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2132 2024-04-23T19:02:22.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036340+0000", 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040181+0000", 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038414909999999998 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040205+0000", 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3711e-05 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040217+0000", 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1467e-05 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040291+0000", 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4610000000000006e-05 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040422+0000", 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131297 2024-04-23T19:02:22.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040539+0000", 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011694899999999999 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.047401+0000", 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068619040000000003 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057538+0000", 2024-04-23T19:02:22.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010136915999999999 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057634+0000", 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5923999999999998e-05 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057701+0000", 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7291000000000003e-05 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.248 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 48.009790498000001, 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.249 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:22.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:22.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:22.257 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.345438080000001, 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.258 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:02:22.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:02:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:02:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:02:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:02:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.265 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:22.266 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.323279569999997, 2024-04-23T19:02:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:22.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:22.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:22.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.275 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.175355455000002, 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.281 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.124414385000001, 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:22.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.286 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.120551186, 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.287 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:22.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:22.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:22.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.297 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:22.298 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.610528559000002, 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:22.304 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.591004105000003, 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:22.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:22.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.307 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:22.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:22.312 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.534470800999998, 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.313 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:22.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:22.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:22.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:22.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.325 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.458843405000003, 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.326 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.327 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:02:22.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.333 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.257755269999997, 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:22.334 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:22.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:22.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:22.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.048863189000002, 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.342 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:22.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:22.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:22.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:22.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.727485074000001, 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.135014795, 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.353 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:22.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.5926243380000003, 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.357 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:22.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:22.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:22.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:22.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2726 3.30 3:0ce56bcb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.3518175879999994, 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021924124999999999, 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2726 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880606+0000", 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884605+0000", 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039984160000000003 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884644+0000", 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8813000000000003e-05 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884662+0000", 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8145999999999999e-05 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884745+0000", 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2955999999999997e-05 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884863+0000", 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011857 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884968+0000", 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105176 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.889496+0000", 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004527522 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902433+0000", 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012937277 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902485+0000", 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2188000000000002e-05 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902527+0000", 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1260999999999997e-05 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2732 3.5 3:a290817c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2594691109999996, 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022383746999999999, 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.368 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2732 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972955+0000", 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7529999999999999e-06 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.976996+0000", 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040414190000000001 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977054+0000", 2024-04-23T19:02:22.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8202000000000003e-05 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977081+0000", 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6533000000000002e-05 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977243+0000", 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016217400000000001 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977497+0000", 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025378800000000002 2024-04-23T19:02:22.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977735+0000", 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839600000000001 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.989236+0000", 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011500776000000001 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995095+0000", 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058587800000000001 2024-04-23T19:02:22.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995196+0000", 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010110799999999999 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995335+0000", 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138818 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2767 3.38 e75/20 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head v 75'8, mlcod=74'6)", 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.7402155790000009, 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022125346000000001, 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496255+0000", 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040496459999999996 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496290+0000", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999000000000002e-05 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496307+0000", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496440+0000", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013291099999999999 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496482+0000", 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1802999999999999e-05 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514167+0000", 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685523000000002 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514330+0000", 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000162724 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.377 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.378 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.378 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:22.379 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:22.379 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:22.380+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:22.480 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:22.477+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:22.553 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:22.553 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:22.553 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:22.553 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:22.569 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:22.581 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:22.581+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:22.682 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:22.681+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:22.690 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:22.690 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:22.690 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:22.691 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:22.691 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:22.705 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:22.783 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:22.784+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.727168372000001, 2024-04-23T19:02:22.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:22.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:22.832 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.136068182000002, 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 47.039789696, 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.838 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:02:22.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.776113674999998, 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.844 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:22.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:22.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:22.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:22.849 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.670999129000002, 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.850 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.855 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 46.524425946000001, 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.856 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:22.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:22.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:22.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.206588513, 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.861 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:22.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:22.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:22.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:22.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.197408155, 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.187945665000001, 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.877 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.168585415999999, 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.878 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:22.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:22.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:22.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:22.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.653451398, 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.883 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:22.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:22.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:22.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:22.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.641970172000001, 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2670 3.36 3:6da56ef5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.894 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.617805236000001, 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021558461000000001, 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2670 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.895 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205488+0000", 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1559999999999999e-06 2024-04-23T19:02:22.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210364+0000", 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048764610000000003 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210390+0000", 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5599e-05 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210405+0000", 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5136999999999999e-05 2024-04-23T19:02:22.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210541+0000", 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210854+0000", 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031316699999999999 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.211075+0000", 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022038 2024-04-23T19:02:22.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226617+0000", 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015541721 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226809+0000", 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019238999999999999 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226936+0000", 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012679400000000001 2024-04-23T19:02:22.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.227043+0000", 2024-04-23T19:02:22.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107475 2024-04-23T19:02:22.900 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.900 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2679 3.a 3:53d5047c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.517172652999999, 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021012060999999999, 2024-04-23T19:02:22.901 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2679 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:22.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306121+0000", 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4699999999999998e-06 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310690+0000", 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045696959999999998 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310727+0000", 2024-04-23T19:02:22.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6040000000000001e-05 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310743+0000", 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6841999999999999e-05 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310893+0000", 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014921800000000001 2024-04-23T19:02:22.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311178+0000", 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028541500000000002 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311409+0000", 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023114300000000001 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.319813+0000", 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084038440000000006 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.326919+0000", 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071059540000000003 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327015+0000", 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5702e-05 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327129+0000", 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114737 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.908 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2696 3.26 3:64250b99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.343993986999999, 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023196560000000001, 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2696 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479299+0000", 2024-04-23T19:02:22.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.576e-06 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483218+0000", 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003919774 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483251+0000", 2024-04-23T19:02:22.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3145999999999997e-05 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483269+0000", 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7975999999999999e-05 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483360+0000", 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0916999999999997e-05 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483543+0000", 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183117 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483710+0000", 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016664100000000001 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.492065+0000", 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083545400000000006 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502380+0000", 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010315718 2024-04-23T19:02:22.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502442+0000", 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1897999999999996e-05 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502493+0000", 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0256999999999997e-05 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.916 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2709 3.3f e74/20 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.20691907, 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021298837000000001, 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616373+0000", 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7579999999999999e-06 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618956+0000", 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025837170000000001 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618984+0000", 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7470999999999998e-05 2024-04-23T19:02:22.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618998+0000", 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4527e-05 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619135+0000", 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013695499999999999 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619178+0000", 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2774000000000001e-05 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637529+0000", 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018350789999999999 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637670+0000", 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014084500000000001 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 10.203719866, 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.922 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.8644923999999996, 2024-04-23T19:02:22.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:22.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:22.935 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2771 3.20 3:0642e822:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2789740550000008, 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020962379, 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.936 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2771 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544319+0000", 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.54e-06 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547645+0000", 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033258020000000001 2024-04-23T19:02:22.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547682+0000", 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7058999999999999e-05 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547701+0000", 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8450000000000001e-05 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547819+0000", 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118072 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547950+0000", 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013113999999999999 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.548056+0000", 2024-04-23T19:02:22.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105782 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.554076+0000", 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060202390000000001 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565102+0000", 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011026144999999999 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565205+0000", 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102848 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565278+0000", 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3301999999999997e-05 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2778 3.a 3:517c3c8c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2036112330000002, 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021706072, 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:22.943 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2778 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:22.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619682+0000", 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1200000000000002e-06 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623671+0000", 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887489999999998 2024-04-23T19:02:22.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623703+0000", 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2465999999999997e-05 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623719+0000", 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6226e-05 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:22.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623882+0000", 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016293699999999999 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624278+0000", 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039613300000000001 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624707+0000", 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042824600000000002 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.633735+0000", 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090279169999999999 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641200+0000", 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074658709999999998 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641297+0000", 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6644999999999994e-05 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:22.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641385+0000", 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7762000000000004e-05 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:22.950 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:22.951 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:22.953 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:22.954 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:22.952+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:23.053 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:23.052+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:23.107 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:23.107 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:23.121 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:23.121 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:23.121 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:23.121 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:23.123 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:23.135 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:23.139 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:23.154 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:23.153+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:23.155 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:23.165 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.5 to 1 (10000) 2024-04-23T19:02:23.175 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:23.175 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:23.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-23T19:02:23.194 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:23.194 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:23.213 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:23.213 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:23.231 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:23.231 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:23.255 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:23.256+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:23.301 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:23.301 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:23.316 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:23.356 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:23.353+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:23.458 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:23.457+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:23.482 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:23.482 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:23.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:23.559 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:23.557+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:23.621 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:23.622 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:23.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:23.661 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:23.660+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:23.762 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:23.761+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:23.803 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:23.803 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:23.818 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:23.863 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:23.864+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:23.964 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:23.964+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:23.986 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:23.986 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:24.065 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:24.061+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:24.120 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:24.120 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:24.169 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.6 to 1 (10000) 2024-04-23T19:02:24.169 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:24.165+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:24.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:02:24.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-23T19:02:24.289 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:24.289+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:24.293 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:24.293 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:24.397 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:24.397+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:24.469 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:24.468+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:24.470 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:24.470 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:24.570 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:24.572+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:24.633 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:24.633 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:24.689 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:24.689+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:24.761 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:24.762 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.772 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:24.769+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:24.774 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:24.873 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:24.872+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:24.940 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:24.940 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:24.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:24.973 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:24.972+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:25.075 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:25.075 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:25.075 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:25.073+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:25.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:25.176 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:25.173+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:25.178 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:02:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.7 to 1 (10000) 2024-04-23T19:02:25.208 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-23T19:02:25.208 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:02:25.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:25.256 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:25.256 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:25.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:25.314 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:25.313+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:25.380 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:25.377+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:25.389 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:25.405 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:25.406 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:25.422 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:25.422 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:25.439 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:25.439 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:25.459 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:25.460 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:25.467 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:25.467 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2151 3.7 3:e007c7bb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.23552522, 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019608105000000001, 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.468 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2151 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232443+0000", 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.232445+0000", 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.176e-06 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234043+0000", 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001598136 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234074+0000", 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0233999999999999e-05 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234088+0000", 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234165+0000", 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7088999999999993e-05 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234316+0000", 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000151321 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.234463+0000", 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147219 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.245858+0000", 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011394589 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.251972+0000", 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0061145610000000001 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252010+0000", 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7262999999999999e-05 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252051+0000", 2024-04-23T19:02:25.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1547e-05 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2190 3.1e 3:78e71445:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.910538956000003, 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019467915999999998, 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2190 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557429+0000", 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.557432+0000", 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.525e-06 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559851+0000", 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024195409999999999 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559890+0000", 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8442999999999998e-05 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559909+0000", 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.878e-05 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.559980+0000", 2024-04-23T19:02:25.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1396000000000006e-05 2024-04-23T19:02:25.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560142+0000", 2024-04-23T19:02:25.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000161514 2024-04-23T19:02:25.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.560286+0000", 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144783 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.565571+0000", 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0052847959999999996 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576768+0000", 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011196704 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576840+0000", 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2132000000000007e-05 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.576897+0000", 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7302000000000001e-05 2024-04-23T19:02:25.484 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.509003047999997, 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.485 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:02:25.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:02:25.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:02:25.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:02:25.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:02:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:02:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.493 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2215 3.b 3:d1b29a79:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:25.493 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:25.493 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.462028580999998, 2024-04-23T19:02:25.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020280914000000001, 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.494 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2215 2024-04-23T19:02:25.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.495 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:25.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005940+0000", 2024-04-23T19:02:25.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.005945+0000", 2024-04-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4129999999999997e-06 2024-04-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009018+0000", 2024-04-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030728040000000002 2024-04-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009068+0000", 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0488999999999997e-05 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009097+0000", 2024-04-23T19:02:25.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8189999999999999e-05 2024-04-23T19:02:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009249+0000", 2024-04-23T19:02:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015217 2024-04-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009554+0000", 2024-04-23T19:02:25.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00030546000000000002 2024-04-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.009859+0000", 2024-04-23T19:02:25.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000304856 2024-04-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025488+0000", 2024-04-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015628791999999999 2024-04-23T19:02:25.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.025855+0000", 2024-04-23T19:02:25.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000367318 2024-04-23T19:02:25.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026075+0000", 2024-04-23T19:02:25.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021969599999999999 2024-04-23T19:02:25.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.026221+0000", 2024-04-23T19:02:25.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014572599999999999 2024-04-23T19:02:25.507 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.507 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.508 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.508 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2218 3.3c e57/20 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:25.508 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:25.508 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.401848790999999, 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020479194999999999, 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:25.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:25.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.066120+0000", 2024-04-23T19:02:25.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7999999999999995e-07 2024-04-23T19:02:25.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071578+0000", 2024-04-23T19:02:25.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054574560000000003 2024-04-23T19:02:25.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071595+0000", 2024-04-23T19:02:25.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7719000000000001e-05 2024-04-23T19:02:25.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071607+0000", 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1521e-05 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071684+0000", 2024-04-23T19:02:25.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7575000000000002e-05 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.071715+0000", 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0213999999999999e-05 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086524+0000", 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014809806999999999 2024-04-23T19:02:25.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.086599+0000", 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4222999999999997e-05 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.516 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.089355885000003, 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.517 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:02:25.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:02:25.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:25.523 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.848529560000003, 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.524 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.525 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:02:25.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.525 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:25.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:02:25.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:02:25.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:02:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.530 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.530 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:02:25.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:02:25.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:02:25.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:02:25.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:02:25.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.535 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:02:25.535 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:25.535 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.820131764999999, 2024-04-23T19:02:25.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:02:25.535 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.535 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:02:25.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:02:25.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:02:25.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.542 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2269 3.7 3:e0b16e4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.74714092, 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019188845999999999, 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.543 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.544 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2269 2024-04-23T19:02:25.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.544 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720827+0000", 2024-04-23T19:02:25.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.720830+0000", 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.722990+0000", 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021594919999999998 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723052+0000", 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1885999999999997e-05 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723073+0000", 2024-04-23T19:02:25.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1416e-05 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723181+0000", 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107769 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723355+0000", 2024-04-23T19:02:25.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000174282 2024-04-23T19:02:25.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:25.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.723484+0000", 2024-04-23T19:02:25.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000128388 2024-04-23T19:02:25.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.729216+0000", 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057327289999999998 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739901+0000", 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010684829 2024-04-23T19:02:25.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.552 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.739969+0000", 2024-04-23T19:02:25.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7570999999999994e-05 2024-04-23T19:02:25.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.740016+0000", 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7386999999999999e-05 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2278 3.8 3:1073b596:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.617779777999999, 2024-04-23T19:02:25.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019186399, 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2278 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850189+0000", 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.850191+0000", 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.311e-06 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852169+0000", 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019783679999999999 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852202+0000", 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2806999999999999e-05 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852218+0000", 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6161e-05 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852316+0000", 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7884e-05 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852509+0000", 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019252700000000001 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.852678+0000", 2024-04-23T19:02:25.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169545 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.857436+0000", 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047575279999999996 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869178+0000", 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011742093 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869307+0000", 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012969300000000001 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.869375+0000", 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7482000000000002e-05 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.561 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 49.411869623000001, 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:02:25.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2589 3.7 3:e099d359:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.189866997999999, 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022967630999999999, 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2589 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278103+0000", 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.53e-06 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279752+0000", 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001649537 2024-04-23T19:02:25.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279779+0000", 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6225e-05 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279790+0000", 2024-04-23T19:02:25.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1282e-05 2024-04-23T19:02:25.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279872+0000", 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1750999999999997e-05 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280046+0000", 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017436599999999999 2024-04-23T19:02:25.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:25.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280209+0000", 2024-04-23T19:02:25.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000163015 2024-04-23T19:02:25.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.289737+0000", 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095279800000000001 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.300928+0000", 2024-04-23T19:02:25.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011190930999999999 2024-04-23T19:02:25.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301008+0000", 2024-04-23T19:02:25.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0530000000000003e-05 2024-04-23T19:02:25.577 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.577 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.577 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301069+0000", 2024-04-23T19:02:25.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0483999999999999e-05 2024-04-23T19:02:25.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.578 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.578 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.579 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2606 3.24 3:24ce0bc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.579 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:25.579 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.000999838, 2024-04-23T19:02:25.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020245796, 2024-04-23T19:02:25.579 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.579 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.580 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.580 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.580 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2606 2024-04-23T19:02:25.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466968+0000", 2024-04-23T19:02:25.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.466971+0000", 2024-04-23T19:02:25.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4590000000000001e-06 2024-04-23T19:02:25.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468836+0000", 2024-04-23T19:02:25.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018649509999999999 2024-04-23T19:02:25.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468889+0000", 2024-04-23T19:02:25.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3374000000000001e-05 2024-04-23T19:02:25.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468905+0000", 2024-04-23T19:02:25.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5472999999999999e-05 2024-04-23T19:02:25.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.468993+0000", 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7823000000000003e-05 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469141+0000", 2024-04-23T19:02:25.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014848500000000001 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.469260+0000", 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000118539 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.477188+0000", 2024-04-23T19:02:25.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079282559999999998 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487089+0000", 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099014710000000002 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487157+0000", 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8052000000000005e-05 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.487214+0000", 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6913000000000002e-05 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2610 3.28 e74/20 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head v 74'14, mlcod=57'12)", 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.956456984000001, 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019605237000000001, 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511511+0000", 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.511513+0000", 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8619999999999999e-06 2024-04-23T19:02:25.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516421+0000", 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049076500000000004 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516460+0000", 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8877000000000001e-05 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516488+0000", 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7991e-05 2024-04-23T19:02:25.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516583+0000", 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5161999999999995e-05 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516618+0000", 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5138000000000001e-05 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531057+0000", 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014438950000000001 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531117+0000", 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9607e-05 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.594 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2633 3.29 3:947900e5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.715042665, 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020162854000000001, 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2633 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.595 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752926+0000", 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.752928+0000", 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.678e-06 2024-04-23T19:02:25.596 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754759+0000", 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018305579999999999 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754791+0000", 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2137000000000001e-05 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.597 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754806+0000", 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.506e-05 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.754890+0000", 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3547000000000005e-05 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755061+0000", 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017095399999999999 2024-04-23T19:02:25.598 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.755221+0000", 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000160786 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.764529+0000", 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009307872 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.772884+0000", 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0083544829999999994 2024-04-23T19:02:25.599 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773000+0000", 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000116632 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773088+0000", 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8146999999999995e-05 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.600 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2656 3.29 3:948bcae1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.426780998, 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022388272000000001, 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2656 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.601 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041187+0000", 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.041190+0000", 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.022e-06 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043694+0000", 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025040980000000002 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043725+0000", 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0676999999999998e-05 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043740+0000", 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4956999999999999e-05 2024-04-23T19:02:25.603 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043815+0000", 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5221000000000004e-05 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.043939+0000", 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000123752 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.044030+0000", 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1100000000000005e-05 2024-04-23T19:02:25.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.050413+0000", 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063828110000000004 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063437+0000", 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013023998 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.605 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063520+0000", 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3217e-05 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.063576+0000", 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5418999999999999e-05 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2675 3.27 3:e6fd3fd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.606 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.206473752000001, 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019592078999999998, 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2675 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.607 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261495+0000", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.261497+0000", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6520000000000002e-06 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262858+0000", 2024-04-23T19:02:25.608 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013611439999999999 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262888+0000", 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0035e-05 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262904+0000", 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5622999999999999e-05 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.609 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.262986+0000", 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2356999999999998e-05 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.263133+0000", 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014631600000000001 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.263298+0000", 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016500799999999999 2024-04-23T19:02:25.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.271403+0000", 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081050800000000006 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.280998+0000", 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095951939999999996 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.281036+0000", 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8217999999999999e-05 2024-04-23T19:02:25.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.281087+0000", 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0451999999999997e-05 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2680 3.38 3:1f9aecb2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.152398602, 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019232905000000002, 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.612 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2680 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315570+0000", 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.315573+0000", 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2370000000000001e-06 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317162+0000", 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015887200000000001 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317180+0000", 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8000999999999999e-05 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317190+0000", 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9159999999999996e-06 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317265+0000", 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5400000000000003e-05 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317441+0000", 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017650599999999999 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317607+0000", 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016575499999999999 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.323096+0000", 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054891970000000003 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334677+0000", 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011580567999999999 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334745+0000", 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7800999999999997e-05 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.334803+0000", 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7803999999999997e-05 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2724 3.24 3:242ccc30:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 12.622568415, 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019407211000000001, 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2724 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.618 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845400+0000", 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.845404+0000", 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.63e-06 2024-04-23T19:02:25.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847765+0000", 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023616370000000002 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847794+0000", 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9145999999999998e-05 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847812+0000", 2024-04-23T19:02:25.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7516999999999998e-05 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.847959+0000", 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014682000000000001 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.848303+0000", 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000343999 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.848782+0000", 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00047950800000000002 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.859976+0000", 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011193732 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864734+0000", 2024-04-23T19:02:25.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047579570000000002 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864774+0000", 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9777000000000002e-05 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.864807+0000", 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3488000000000002e-05 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2767 3.38 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 11.97903945, 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026034438999999999, 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:25.624 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2767 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488932+0000", 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569999999999998e-06 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491230+0000", 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002297959 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:25.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491265+0000", 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4915e-05 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491281+0000", 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5885000000000001e-05 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491389+0000", 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010790600000000001 2024-04-23T19:02:25.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491596+0000", 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000206622 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491829+0000", 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000233143 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.503280+0000", 2024-04-23T19:02:25.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011451823 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514817+0000", 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011536332999999999 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514899+0000", 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2245999999999998e-05 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:25.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514963+0000", 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4250000000000003e-05 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:25.630 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:25.631 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:25.633 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:25.633 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:25.634 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:25.635 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:25.637 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:25.632+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:25.642 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:02:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:02:25.656 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-04-23T19:02:25.186629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2114667245,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":2850,"num_read_kb":2547,"num_write":1698,"num_write_kb":2091649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2510,"ondisk_log_size":2510,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4387312,"kb_used_data":4137836,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750587408,"statfs":{"total":773094113280,"available":768601505792,"internally_reserved":0,"allocated":4237144064,"data_stored":4233501690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.043750"},"pg_stats":[{"pgid":"3.3f","version":"75'12","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398569+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:02:21.398569+0000","last_peered":"2024-04-23T19:02:21.398569+0000","last_clean":"2024-04-23T19:02:21.398569+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:02:21.398569+0000","last_undegraded":"2024-04-23T19:02:21.398569+0000","last_fullsized":"2024-04-23T19:02:21.398569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147401+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:02:21.147401+0000","last_peered":"2024-04-23T19:02:21.147401+0000","last_clean":"2024-04-23T19:02:21.147401+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:02:21.147401+0000","last_undegraded":"2024-04-23T19:02:21.147401+0000","last_fullsized":"2024-04-23T19:02:21.147401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'5","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148671+0000","last_change":"2024-04-23T19:00:15.257176+0000","last_active":"2024-04-23T19:02:21.148671+0000","last_peered":"2024-04-23T19:02:21.148671+0000","last_clean":"2024-04-23T19:02:21.148671+0000","last_became_active":"2024-04-23T19:00:15.256794+0000","last_became_peered":"2024-04-23T19:00:15.256794+0000","last_unstale":"2024-04-23T19:02:21.148671+0000","last_undegraded":"2024-04-23T19:02:21.148671+0000","last_fullsized":"2024-04-23T19:02:21.148671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400739+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:02:21.400739+0000","last_peered":"2024-04-23T19:02:21.400739+0000","last_clean":"2024-04-23T19:02:21.400739+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:02:21.400739+0000","last_undegraded":"2024-04-23T19:02:21.400739+0000","last_fullsized":"2024-04-23T19:02:21.400739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"74'6","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401040+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:02:21.401040+0000","last_peered":"2024-04-23T19:02:21.401040+0000","last_clean":"2024-04-23T19:02:21.401040+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:02:21.401040+0000","last_undegraded":"2024-04-23T19:02:21.401040+0000","last_fullsized":"2024-04-23T19:02:21.401040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147638+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:02:21.147638+0000","last_peered":"2024-04-23T19:02:21.147638+0000","last_clean":"2024-04-23T19:02:21.147638+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:02:21.147638+0000","last_undegraded":"2024-04-23T19:02:21.147638+0000","last_fullsized":"2024-04-23T19:02:21.147638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149358+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:02:21.149358+0000","last_peered":"2024-04-23T19:02:21.149358+0000","last_clean":"2024-04-23T19:02:21.149358+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:02:21.149358+0000","last_undegraded":"2024-04-23T19:02:21.149358+0000","last_fullsized":"2024-04-23T19:02:21.149358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400092+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:02:21.400092+0000","last_peered":"2024-04-23T19:02:21.400092+0000","last_clean":"2024-04-23T19:02:21.400092+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:02:21.400092+0000","last_undegraded":"2024-04-23T19:02:21.400092+0000","last_fullsized":"2024-04-23T19:02:21.400092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"74'7","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397961+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:02:21.397961+0000","last_peered":"2024-04-23T19:02:21.397961+0000","last_clean":"2024-04-23T19:02:21.397961+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:02:21.397961+0000","last_undegraded":"2024-04-23T19:02:21.397961+0000","last_fullsized":"2024-04-23T19:02:21.397961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400044+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:02:21.400044+0000","last_peered":"2024-04-23T19:02:21.400044+0000","last_clean":"2024-04-23T19:02:21.400044+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:02:21.400044+0000","last_undegraded":"2024-04-23T19:02:21.400044+0000","last_fullsized":"2024-04-23T19:02:21.400044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"74'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151153+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:02:21.151153+0000","last_peered":"2024-04-23T19:02:21.151153+0000","last_clean":"2024-04-23T19:02:21.151153+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:02:21.151153+0000","last_undegraded":"2024-04-23T19:02:21.151153+0000","last_fullsized":"2024-04-23T19:02:21.151153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":168,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149626+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:02:21.149626+0000","last_peered":"2024-04-23T19:02:21.149626+0000","last_clean":"2024-04-23T19:02:21.149626+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:02:21.149626+0000","last_undegraded":"2024-04-23T19:02:21.149626+0000","last_fullsized":"2024-04-23T19:02:21.149626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'4","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400869+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:02:21.400869+0000","last_peered":"2024-04-23T19:02:21.400869+0000","last_clean":"2024-04-23T19:02:21.400869+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:02:21.400869+0000","last_undegraded":"2024-04-23T19:02:21.400869+0000","last_fullsized":"2024-04-23T19:02:21.400869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152168+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:02:21.152168+0000","last_peered":"2024-04-23T19:02:21.152168+0000","last_clean":"2024-04-23T19:02:21.152168+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:02:21.152168+0000","last_undegraded":"2024-04-23T19:02:21.152168+0000","last_fullsized":"2024-04-23T19:02:21.152168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398531+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:02:21.398531+0000","last_peered":"2024-04-23T19:02:21.398531+0000","last_clean":"2024-04-23T19:02:21.398531+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:02:21.398531+0000","last_undegraded":"2024-04-23T19:02:21.398531+0000","last_fullsized":"2024-04-23T19:02:21.398531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"53'6","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399011+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:02:21.399011+0000","last_peered":"2024-04-23T19:02:21.399011+0000","last_clean":"2024-04-23T19:02:21.399011+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:02:21.399011+0000","last_undegraded":"2024-04-23T19:02:21.399011+0000","last_fullsized":"2024-04-23T19:02:21.399011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146725+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:02:21.146725+0000","last_peered":"2024-04-23T19:02:21.146725+0000","last_clean":"2024-04-23T19:02:21.146725+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:02:21.146725+0000","last_undegraded":"2024-04-23T19:02:21.146725+0000","last_fullsized":"2024-04-23T19:02:21.146725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398643+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:02:21.398643+0000","last_peered":"2024-04-23T19:02:21.398643+0000","last_clean":"2024-04-23T19:02:21.398643+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:02:21.398643+0000","last_undegraded":"2024-04-23T19:02:21.398643+0000","last_fullsized":"2024-04-23T19:02:21.398643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400801+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:02:21.400801+0000","last_peered":"2024-04-23T19:02:21.400801+0000","last_clean":"2024-04-23T19:02:21.400801+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:02:21.400801+0000","last_undegraded":"2024-04-23T19:02:21.400801+0000","last_fullsized":"2024-04-23T19:02:21.400801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399372+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:02:21.399372+0000","last_peered":"2024-04-23T19:02:21.399372+0000","last_clean":"2024-04-23T19:02:21.399372+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:02:21.399372+0000","last_undegraded":"2024-04-23T19:02:21.399372+0000","last_fullsized":"2024-04-23T19:02:21.399372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":171,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151350+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:02:21.151350+0000","last_peered":"2024-04-23T19:02:21.151350+0000","last_clean":"2024-04-23T19:02:21.151350+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:02:21.151350+0000","last_undegraded":"2024-04-23T19:02:21.151350+0000","last_fullsized":"2024-04-23T19:02:21.151350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'12","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399229+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:02:21.399229+0000","last_peered":"2024-04-23T19:02:21.399229+0000","last_clean":"2024-04-23T19:02:21.399229+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:02:21.399229+0000","last_undegraded":"2024-04-23T19:02:21.399229+0000","last_fullsized":"2024-04-23T19:02:21.399229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397642+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:02:21.397642+0000","last_peered":"2024-04-23T19:02:21.397642+0000","last_clean":"2024-04-23T19:02:21.397642+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:02:21.397642+0000","last_undegraded":"2024-04-23T19:02:21.397642+0000","last_fullsized":"2024-04-23T19:02:21.397642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148448+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:02:21.148448+0000","last_peered":"2024-04-23T19:02:21.148448+0000","last_clean":"2024-04-23T19:02:21.148448+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:02:21.148448+0000","last_undegraded":"2024-04-23T19:02:21.148448+0000","last_fullsized":"2024-04-23T19:02:21.148448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397332+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:02:21.397332+0000","last_peered":"2024-04-23T19:02:21.397332+0000","last_clean":"2024-04-23T19:02:21.397332+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:02:21.397332+0000","last_undegraded":"2024-04-23T19:02:21.397332+0000","last_fullsized":"2024-04-23T19:02:21.397332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'5","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399841+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:02:21.399841+0000","last_peered":"2024-04-23T19:02:21.399841+0000","last_clean":"2024-04-23T19:02:21.399841+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:02:21.399841+0000","last_undegraded":"2024-04-23T19:02:21.399841+0000","last_fullsized":"2024-04-23T19:02:21.399841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149774+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:02:21.149774+0000","last_peered":"2024-04-23T19:02:21.149774+0000","last_clean":"2024-04-23T19:02:21.149774+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:02:21.149774+0000","last_undegraded":"2024-04-23T19:02:21.149774+0000","last_fullsized":"2024-04-23T19:02:21.149774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'8","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399446+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:02:21.399446+0000","last_peered":"2024-04-23T19:02:21.399446+0000","last_clean":"2024-04-23T19:02:21.399446+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:02:21.399446+0000","last_undegraded":"2024-04-23T19:02:21.399446+0000","last_fullsized":"2024-04-23T19:02:21.399446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.145874+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:02:21.145874+0000","last_peered":"2024-04-23T19:02:21.145874+0000","last_clean":"2024-04-23T19:02:21.145874+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:02:21.145874+0000","last_undegraded":"2024-04-23T19:02:21.145874+0000","last_fullsized":"2024-04-23T19:02:21.145874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399190+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:02:21.399190+0000","last_peered":"2024-04-23T19:02:21.399190+0000","last_clean":"2024-04-23T19:02:21.399190+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:02:21.399190+0000","last_undegraded":"2024-04-23T19:02:21.399190+0000","last_fullsized":"2024-04-23T19:02:21.399190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'10","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397590+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:02:21.397590+0000","last_peered":"2024-04-23T19:02:21.397590+0000","last_clean":"2024-04-23T19:02:21.397590+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:02:21.397590+0000","last_undegraded":"2024-04-23T19:02:21.397590+0000","last_fullsized":"2024-04-23T19:02:21.397590+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149349+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:02:21.149349+0000","last_peered":"2024-04-23T19:02:21.149349+0000","last_clean":"2024-04-23T19:02:21.149349+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:02:21.149349+0000","last_undegraded":"2024-04-23T19:02:21.149349+0000","last_fullsized":"2024-04-23T19:02:21.149349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'17","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400734+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:02:21.400734+0000","last_peered":"2024-04-23T19:02:21.400734+0000","last_clean":"2024-04-23T19:02:21.400734+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:02:21.400734+0000","last_undegraded":"2024-04-23T19:02:21.400734+0000","last_fullsized":"2024-04-23T19:02:21.400734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398186+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:02:21.398186+0000","last_peered":"2024-04-23T19:02:21.398186+0000","last_clean":"2024-04-23T19:02:21.398186+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:02:21.398186+0000","last_undegraded":"2024-04-23T19:02:21.398186+0000","last_fullsized":"2024-04-23T19:02:21.398186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"75'40","reported_seq":163,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146446+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:02:21.146446+0000","last_peered":"2024-04-23T19:02:21.146446+0000","last_clean":"2024-04-23T19:02:21.146446+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:02:21.146446+0000","last_undegraded":"2024-04-23T19:02:21.146446+0000","last_fullsized":"2024-04-23T19:02:21.146446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150018+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:02:21.150018+0000","last_peered":"2024-04-23T19:02:21.150018+0000","last_clean":"2024-04-23T19:02:21.150018+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:02:21.150018+0000","last_undegraded":"2024-04-23T19:02:21.150018+0000","last_fullsized":"2024-04-23T19:02:21.150018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'13","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400534+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:02:21.400534+0000","last_peered":"2024-04-23T19:02:21.400534+0000","last_clean":"2024-04-23T19:02:21.400534+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:02:21.400534+0000","last_undegraded":"2024-04-23T19:02:21.400534+0000","last_fullsized":"2024-04-23T19:02:21.400534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399033+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:02:21.399033+0000","last_peered":"2024-04-23T19:02:21.399033+0000","last_clean":"2024-04-23T19:02:21.399033+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:02:21.399033+0000","last_undegraded":"2024-04-23T19:02:21.399033+0000","last_fullsized":"2024-04-23T19:02:21.399033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150451+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:02:21.150451+0000","last_peered":"2024-04-23T19:02:21.150451+0000","last_clean":"2024-04-23T19:02:21.150451+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:02:21.150451+0000","last_undegraded":"2024-04-23T19:02:21.150451+0000","last_fullsized":"2024-04-23T19:02:21.150451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149751+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:02:21.149751+0000","last_peered":"2024-04-23T19:02:21.149751+0000","last_clean":"2024-04-23T19:02:21.149751+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:02:21.149751+0000","last_undegraded":"2024-04-23T19:02:21.149751+0000","last_fullsized":"2024-04-23T19:02:21.149751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399192+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:02:21.399192+0000","last_peered":"2024-04-23T19:02:21.399192+0000","last_clean":"2024-04-23T19:02:21.399192+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:02:21.399192+0000","last_undegraded":"2024-04-23T19:02:21.399192+0000","last_fullsized":"2024-04-23T19:02:21.399192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404271+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:02:21.404271+0000","last_peered":"2024-04-23T19:02:21.404271+0000","last_clean":"2024-04-23T19:02:21.404271+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:02:21.404271+0000","last_undegraded":"2024-04-23T19:02:21.404271+0000","last_fullsized":"2024-04-23T19:02:21.404271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'3","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400936+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:02:21.400936+0000","last_peered":"2024-04-23T19:02:21.400936+0000","last_clean":"2024-04-23T19:02:21.400936+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:02:21.400936+0000","last_undegraded":"2024-04-23T19:02:21.400936+0000","last_fullsized":"2024-04-23T19:02:21.400936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402209+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:02:21.402209+0000","last_peered":"2024-04-23T19:02:21.402209+0000","last_clean":"2024-04-23T19:02:21.402209+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:02:21.402209+0000","last_undegraded":"2024-04-23T19:02:21.402209+0000","last_fullsized":"2024-04-23T19:02:21.402209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397116+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:02:21.397116+0000","last_peered":"2024-04-23T19:02:21.397116+0000","last_clean":"2024-04-23T19:02:21.397116+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:02:21.397116+0000","last_undegraded":"2024-04-23T19:02:21.397116+0000","last_fullsized":"2024-04-23T19:02:21.397116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"75'107","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398840+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:02:21.398840+0000","last_peered":"2024-04-23T19:02:21.398840+0000","last_clean":"2024-04-23T19:02:21.398840+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:02:21.398840+0000","last_undegraded":"2024-04-23T19:02:21.398840+0000","last_fullsized":"2024-04-23T19:02:21.398840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":116,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146622+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:02:21.146622+0000","last_peered":"2024-04-23T19:02:21.146622+0000","last_clean":"2024-04-23T19:02:21.146622+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:02:21.146622+0000","last_undegraded":"2024-04-23T19:02:21.146622+0000","last_fullsized":"2024-04-23T19:02:21.146622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401684+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:02:21.401684+0000","last_peered":"2024-04-23T19:02:21.401684+0000","last_clean":"2024-04-23T19:02:21.401684+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:02:21.401684+0000","last_undegraded":"2024-04-23T19:02:21.401684+0000","last_fullsized":"2024-04-23T19:02:21.401684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'5","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397738+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:02:21.397738+0000","last_peered":"2024-04-23T19:02:21.397738+0000","last_clean":"2024-04-23T19:02:21.397738+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:02:21.397738+0000","last_undegraded":"2024-04-23T19:02:21.397738+0000","last_fullsized":"2024-04-23T19:02:21.397738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151956+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:02:21.151956+0000","last_peered":"2024-04-23T19:02:21.151956+0000","last_clean":"2024-04-23T19:02:21.151956+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:02:21.151956+0000","last_undegraded":"2024-04-23T19:02:21.151956+0000","last_fullsized":"2024-04-23T19:02:21.151956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'15","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399089+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:02:21.399089+0000","last_peered":"2024-04-23T19:02:21.399089+0000","last_clean":"2024-04-23T19:02:21.399089+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:02:21.399089+0000","last_undegraded":"2024-04-23T19:02:21.399089+0000","last_fullsized":"2024-04-23T19:02:21.399089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"75'107","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398709+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:02:21.398709+0000","last_peered":"2024-04-23T19:02:21.398709+0000","last_clean":"2024-04-23T19:02:21.398709+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:02:21.398709+0000","last_undegraded":"2024-04-23T19:02:21.398709+0000","last_fullsized":"2024-04-23T19:02:21.398709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148005+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:02:21.148005+0000","last_peered":"2024-04-23T19:02:21.148005+0000","last_clean":"2024-04-23T19:02:21.148005+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:02:21.148005+0000","last_undegraded":"2024-04-23T19:02:21.148005+0000","last_fullsized":"2024-04-23T19:02:21.148005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"74'4","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398775+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:02:21.398775+0000","last_peered":"2024-04-23T19:02:21.398775+0000","last_clean":"2024-04-23T19:02:21.398775+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:02:21.398775+0000","last_undegraded":"2024-04-23T19:02:21.398775+0000","last_fullsized":"2024-04-23T19:02:21.398775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":192,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397794+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:02:21.397794+0000","last_peered":"2024-04-23T19:02:21.397794+0000","last_clean":"2024-04-23T19:02:21.397794+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:02:21.397794+0000","last_undegraded":"2024-04-23T19:02:21.397794+0000","last_fullsized":"2024-04-23T19:02:21.397794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'25","reported_seq":153,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149577+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:02:21.149577+0000","last_peered":"2024-04-23T19:02:21.149577+0000","last_clean":"2024-04-23T19:02:21.149577+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:02:21.149577+0000","last_undegraded":"2024-04-23T19:02:21.149577+0000","last_fullsized":"2024-04-23T19:02:21.149577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147873+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:02:21.147873+0000","last_peered":"2024-04-23T19:02:21.147873+0000","last_clean":"2024-04-23T19:02:21.147873+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:02:21.147873+0000","last_undegraded":"2024-04-23T19:02:21.147873+0000","last_fullsized":"2024-04-23T19:02:21.147873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":117,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148656+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:02:21.148656+0000","last_peered":"2024-04-23T19:02:21.148656+0000","last_clean":"2024-04-23T19:02:21.148656+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:02:21.148656+0000","last_undegraded":"2024-04-23T19:02:21.148656+0000","last_fullsized":"2024-04-23T19:02:21.148656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146927+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:02:21.146927+0000","last_peered":"2024-04-23T19:02:21.146927+0000","last_clean":"2024-04-23T19:02:21.146927+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:02:21.146927+0000","last_undegraded":"2024-04-23T19:02:21.146927+0000","last_fullsized":"2024-04-23T19:02:21.146927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"74'7","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398555+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:02:21.398555+0000","last_peered":"2024-04-23T19:02:21.398555+0000","last_clean":"2024-04-23T19:02:21.398555+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:02:21.398555+0000","last_undegraded":"2024-04-23T19:02:21.398555+0000","last_fullsized":"2024-04-23T19:02:21.398555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396924+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:02:21.396924+0000","last_peered":"2024-04-23T19:02:21.396924+0000","last_clean":"2024-04-23T19:02:21.396924+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:02:21.396924+0000","last_undegraded":"2024-04-23T19:02:21.396924+0000","last_fullsized":"2024-04-23T19:02:21.396924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'15","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400281+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:02:21.400281+0000","last_peered":"2024-04-23T19:02:21.400281+0000","last_clean":"2024-04-23T19:02:21.400281+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:02:21.400281+0000","last_undegraded":"2024-04-23T19:02:21.400281+0000","last_fullsized":"2024-04-23T19:02:21.400281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397078+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:02:21.397078+0000","last_peered":"2024-04-23T19:02:21.397078+0000","last_clean":"2024-04-23T19:02:21.397078+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:02:21.397078+0000","last_undegraded":"2024-04-23T19:02:21.397078+0000","last_fullsized":"2024-04-23T19:02:21.397078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398486+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:02:21.398486+0000","last_peered":"2024-04-23T19:02:21.398486+0000","last_clean":"2024-04-23T19:02:21.398486+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:02:21.398486+0000","last_undegraded":"2024-04-23T19:02:21.398486+0000","last_fullsized":"2024-04-23T19:02:21.398486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398712+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:02:21.398712+0000","last_peered":"2024-04-23T19:02:21.398712+0000","last_clean":"2024-04-23T19:02:21.398712+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:02:21.398712+0000","last_undegraded":"2024-04-23T19:02:21.398712+0000","last_fullsized":"2024-04-23T19:02:21.398712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'5","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399766+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:02:21.399766+0000","last_peered":"2024-04-23T19:02:21.399766+0000","last_clean":"2024-04-23T19:02:21.399766+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:02:21.399766+0000","last_undegraded":"2024-04-23T19:02:21.399766+0000","last_fullsized":"2024-04-23T19:02:21.399766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397811+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:02:21.397811+0000","last_peered":"2024-04-23T19:02:21.397811+0000","last_clean":"2024-04-23T19:02:21.397811+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:02:21.397811+0000","last_undegraded":"2024-04-23T19:02:21.397811+0000","last_fullsized":"2024-04-23T19:02:21.397811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'21","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400547+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:02:21.400547+0000","last_peered":"2024-04-23T19:02:21.400547+0000","last_clean":"2024-04-23T19:02:21.400547+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:02:21.400547+0000","last_undegraded":"2024-04-23T19:02:21.400547+0000","last_fullsized":"2024-04-23T19:02:21.400547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"75'107","reported_seq":244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399349+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:02:21.399349+0000","last_peered":"2024-04-23T19:02:21.399349+0000","last_clean":"2024-04-23T19:02:21.399349+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:02:21.399349+0000","last_undegraded":"2024-04-23T19:02:21.399349+0000","last_fullsized":"2024-04-23T19:02:21.399349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"53'5","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401068+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:02:21.401068+0000","last_peered":"2024-04-23T19:02:21.401068+0000","last_clean":"2024-04-23T19:02:21.401068+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:02:21.401068+0000","last_undegraded":"2024-04-23T19:02:21.401068+0000","last_fullsized":"2024-04-23T19:02:21.401068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"53'4","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400512+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:02:21.400512+0000","last_peered":"2024-04-23T19:02:21.400512+0000","last_clean":"2024-04-23T19:02:21.400512+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:02:21.400512+0000","last_undegraded":"2024-04-23T19:02:21.400512+0000","last_fullsized":"2024-04-23T19:02:21.400512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"74'5","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150067+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:02:21.150067+0000","last_peered":"2024-04-23T19:02:21.150067+0000","last_clean":"2024-04-23T19:02:21.150067+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:02:21.150067+0000","last_undegraded":"2024-04-23T19:02:21.150067+0000","last_fullsized":"2024-04-23T19:02:21.150067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397391+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:02:21.397391+0000","last_peered":"2024-04-23T19:02:21.397391+0000","last_clean":"2024-04-23T19:02:21.397391+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:02:21.397391+0000","last_undegraded":"2024-04-23T19:02:21.397391+0000","last_fullsized":"2024-04-23T19:02:21.397391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'26","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398938+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:02:21.398938+0000","last_peered":"2024-04-23T19:02:21.398938+0000","last_clean":"2024-04-23T19:02:21.398938+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:02:21.398938+0000","last_undegraded":"2024-04-23T19:02:21.398938+0000","last_fullsized":"2024-04-23T19:02:21.398938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396752+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:02:21.396752+0000","last_peered":"2024-04-23T19:02:21.396752+0000","last_clean":"2024-04-23T19:02:21.396752+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:02:21.396752+0000","last_undegraded":"2024-04-23T19:02:21.396752+0000","last_fullsized":"2024-04-23T19:02:21.396752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"69'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148566+0000","last_change":"2024-04-23T19:00:25.352691+0000","last_active":"2024-04-23T19:02:21.148566+0000","last_peered":"2024-04-23T19:02:21.148566+0000","last_clean":"2024-04-23T19:02:21.148566+0000","last_became_active":"2024-04-23T19:00:25.351805+0000","last_became_peered":"2024-04-23T19:00:25.351805+0000","last_unstale":"2024-04-23T19:02:21.148566+0000","last_undegraded":"2024-04-23T19:02:21.148566+0000","last_fullsized":"2024-04-23T19:02:21.148566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:41.939230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148910+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:02:21.148910+0000","last_peered":"2024-04-23T19:02:21.148910+0000","last_clean":"2024-04-23T19:02:21.148910+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:02:21.148910+0000","last_undegraded":"2024-04-23T19:02:21.148910+0000","last_fullsized":"2024-04-23T19:02:21.148910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"75'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399618+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:02:21.399618+0000","last_peered":"2024-04-23T19:02:21.399618+0000","last_clean":"2024-04-23T19:02:21.399618+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:02:21.399618+0000","last_undegraded":"2024-04-23T19:02:21.399618+0000","last_fullsized":"2024-04-23T19:02:21.399618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397012+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:02:21.397012+0000","last_peered":"2024-04-23T19:02:21.397012+0000","last_clean":"2024-04-23T19:02:21.397012+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:02:21.397012+0000","last_undegraded":"2024-04-23T19:02:21.397012+0000","last_fullsized":"2024-04-23T19:02:21.397012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"75'17","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149885+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:02:21.149885+0000","last_peered":"2024-04-23T19:02:21.149885+0000","last_clean":"2024-04-23T19:02:21.149885+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:02:21.149885+0000","last_undegraded":"2024-04-23T19:02:21.149885+0000","last_fullsized":"2024-04-23T19:02:21.149885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401938+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:02:21.401938+0000","last_peered":"2024-04-23T19:02:21.401938+0000","last_clean":"2024-04-23T19:02:21.401938+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:02:21.401938+0000","last_undegraded":"2024-04-23T19:02:21.401938+0000","last_fullsized":"2024-04-23T19:02:21.401938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397799+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:02:21.397799+0000","last_peered":"2024-04-23T19:02:21.397799+0000","last_clean":"2024-04-23T19:02:21.397799+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:02:21.397799+0000","last_undegraded":"2024-04-23T19:02:21.397799+0000","last_fullsized":"2024-04-23T19:02:21.397799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149958+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:02:21.149958+0000","last_peered":"2024-04-23T19:02:21.149958+0000","last_clean":"2024-04-23T19:02:21.149958+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:02:21.149958+0000","last_undegraded":"2024-04-23T19:02:21.149958+0000","last_fullsized":"2024-04-23T19:02:21.149958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"75'11","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398855+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:02:21.398855+0000","last_peered":"2024-04-23T19:02:21.398855+0000","last_clean":"2024-04-23T19:02:21.398855+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:02:21.398855+0000","last_undegraded":"2024-04-23T19:02:21.398855+0000","last_fullsized":"2024-04-23T19:02:21.398855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147504+0000","last_change":"2024-04-23T19:00:19.306483+0000","last_active":"2024-04-23T19:02:21.147504+0000","last_peered":"2024-04-23T19:02:21.147504+0000","last_clean":"2024-04-23T19:02:21.147504+0000","last_became_active":"2024-04-23T19:00:19.305544+0000","last_became_peered":"2024-04-23T19:00:19.305544+0000","last_unstale":"2024-04-23T19:02:21.147504+0000","last_undegraded":"2024-04-23T19:02:21.147504+0000","last_fullsized":"2024-04-23T19:02:21.147504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:57.250293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'23","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398818+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:02:21.398818+0000","last_peered":"2024-04-23T19:02:21.398818+0000","last_clean":"2024-04-23T19:02:21.398818+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:02:21.398818+0000","last_undegraded":"2024-04-23T19:02:21.398818+0000","last_fullsized":"2024-04-23T19:02:21.398818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"75'107","reported_seq":255,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398318+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:02:21.398318+0000","last_peered":"2024-04-23T19:02:21.398318+0000","last_clean":"2024-04-23T19:02:21.398318+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:02:21.398318+0000","last_undegraded":"2024-04-23T19:02:21.398318+0000","last_fullsized":"2024-04-23T19:02:21.398318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147659+0000","last_change":"2024-04-23T19:00:25.341628+0000","last_active":"2024-04-23T19:02:21.147659+0000","last_peered":"2024-04-23T19:02:21.147659+0000","last_clean":"2024-04-23T19:02:21.147659+0000","last_became_active":"2024-04-23T19:00:25.341011+0000","last_became_peered":"2024-04-23T19:00:25.341011+0000","last_unstale":"2024-04-23T19:02:21.147659+0000","last_undegraded":"2024-04-23T19:02:21.147659+0000","last_fullsized":"2024-04-23T19:02:21.147659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:34.837079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150443+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:02:21.150443+0000","last_peered":"2024-04-23T19:02:21.150443+0000","last_clean":"2024-04-23T19:02:21.150443+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:02:21.150443+0000","last_undegraded":"2024-04-23T19:02:21.150443+0000","last_fullsized":"2024-04-23T19:02:21.150443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147781+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:02:21.147781+0000","last_peered":"2024-04-23T19:02:21.147781+0000","last_clean":"2024-04-23T19:02:21.147781+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:02:21.147781+0000","last_undegraded":"2024-04-23T19:02:21.147781+0000","last_fullsized":"2024-04-23T19:02:21.147781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":264,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152139+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:02:21.152139+0000","last_peered":"2024-04-23T19:02:21.152139+0000","last_clean":"2024-04-23T19:02:21.152139+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:02:21.152139+0000","last_undegraded":"2024-04-23T19:02:21.152139+0000","last_fullsized":"2024-04-23T19:02:21.152139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"52'11","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398817+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:02:21.398817+0000","last_peered":"2024-04-23T19:02:21.398817+0000","last_clean":"2024-04-23T19:02:21.398817+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:02:21.398817+0000","last_undegraded":"2024-04-23T19:02:21.398817+0000","last_fullsized":"2024-04-23T19:02:21.398817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"75'107","reported_seq":282,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398708+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:02:21.398708+0000","last_peered":"2024-04-23T19:02:21.398708+0000","last_clean":"2024-04-23T19:02:21.398708+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:02:21.398708+0000","last_undegraded":"2024-04-23T19:02:21.398708+0000","last_fullsized":"2024-04-23T19:02:21.398708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147370+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:02:21.147370+0000","last_peered":"2024-04-23T19:02:21.147370+0000","last_clean":"2024-04-23T19:02:21.147370+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:02:21.147370+0000","last_undegraded":"2024-04-23T19:02:21.147370+0000","last_fullsized":"2024-04-23T19:02:21.147370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149563+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:02:21.149563+0000","last_peered":"2024-04-23T19:02:21.149563+0000","last_clean":"2024-04-23T19:02:21.149563+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:02:21.149563+0000","last_undegraded":"2024-04-23T19:02:21.149563+0000","last_fullsized":"2024-04-23T19:02:21.149563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"75'11","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398731+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:02:21.398731+0000","last_peered":"2024-04-23T19:02:21.398731+0000","last_clean":"2024-04-23T19:02:21.398731+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:02:21.398731+0000","last_undegraded":"2024-04-23T19:02:21.398731+0000","last_fullsized":"2024-04-23T19:02:21.398731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150176+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:02:21.150176+0000","last_peered":"2024-04-23T19:02:21.150176+0000","last_clean":"2024-04-23T19:02:21.150176+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:02:21.150176+0000","last_undegraded":"2024-04-23T19:02:21.150176+0000","last_fullsized":"2024-04-23T19:02:21.150176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149238+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:02:21.149238+0000","last_peered":"2024-04-23T19:02:21.149238+0000","last_clean":"2024-04-23T19:02:21.149238+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:02:21.149238+0000","last_undegraded":"2024-04-23T19:02:21.149238+0000","last_fullsized":"2024-04-23T19:02:21.149238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399935+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:02:21.399935+0000","last_peered":"2024-04-23T19:02:21.399935+0000","last_clean":"2024-04-23T19:02:21.399935+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:02:21.399935+0000","last_undegraded":"2024-04-23T19:02:21.399935+0000","last_fullsized":"2024-04-23T19:02:21.399935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147729+0000","last_change":"2024-04-23T19:00:25.337128+0000","last_active":"2024-04-23T19:02:21.147729+0000","last_peered":"2024-04-23T19:02:21.147729+0000","last_clean":"2024-04-23T19:02:21.147729+0000","last_became_active":"2024-04-23T19:00:25.336132+0000","last_became_peered":"2024-04-23T19:00:25.336132+0000","last_unstale":"2024-04-23T19:02:21.147729+0000","last_undegraded":"2024-04-23T19:02:21.147729+0000","last_fullsized":"2024-04-23T19:02:21.147729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:40.547819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399060+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:02:21.399060+0000","last_peered":"2024-04-23T19:02:21.399060+0000","last_clean":"2024-04-23T19:02:21.399060+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:02:21.399060+0000","last_undegraded":"2024-04-23T19:02:21.399060+0000","last_fullsized":"2024-04-23T19:02:21.399060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400615+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:02:21.400615+0000","last_peered":"2024-04-23T19:02:21.400615+0000","last_clean":"2024-04-23T19:02:21.400615+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:02:21.400615+0000","last_undegraded":"2024-04-23T19:02:21.400615+0000","last_fullsized":"2024-04-23T19:02:21.400615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148852+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:02:21.148852+0000","last_peered":"2024-04-23T19:02:21.148852+0000","last_clean":"2024-04-23T19:02:21.148852+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:02:21.148852+0000","last_undegraded":"2024-04-23T19:02:21.148852+0000","last_fullsized":"2024-04-23T19:02:21.148852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"74'11","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397428+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:02:21.397428+0000","last_peered":"2024-04-23T19:02:21.397428+0000","last_clean":"2024-04-23T19:02:21.397428+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:02:21.397428+0000","last_undegraded":"2024-04-23T19:02:21.397428+0000","last_fullsized":"2024-04-23T19:02:21.397428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398461+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:02:21.398461+0000","last_peered":"2024-04-23T19:02:21.398461+0000","last_clean":"2024-04-23T19:02:21.398461+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:02:21.398461+0000","last_undegraded":"2024-04-23T19:02:21.398461+0000","last_fullsized":"2024-04-23T19:02:21.398461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'31","reported_seq":161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152433+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:02:21.152433+0000","last_peered":"2024-04-23T19:02:21.152433+0000","last_clean":"2024-04-23T19:02:21.152433+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:02:21.152433+0000","last_undegraded":"2024-04-23T19:02:21.152433+0000","last_fullsized":"2024-04-23T19:02:21.152433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401206+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:02:21.401206+0000","last_peered":"2024-04-23T19:02:21.401206+0000","last_clean":"2024-04-23T19:02:21.401206+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:02:21.401206+0000","last_undegraded":"2024-04-23T19:02:21.401206+0000","last_fullsized":"2024-04-23T19:02:21.401206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397980+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:02:21.397980+0000","last_peered":"2024-04-23T19:02:21.397980+0000","last_clean":"2024-04-23T19:02:21.397980+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:02:21.397980+0000","last_undegraded":"2024-04-23T19:02:21.397980+0000","last_fullsized":"2024-04-23T19:02:21.397980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404123+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:02:21.404123+0000","last_peered":"2024-04-23T19:02:21.404123+0000","last_clean":"2024-04-23T19:02:21.404123+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:02:21.404123+0000","last_undegraded":"2024-04-23T19:02:21.404123+0000","last_fullsized":"2024-04-23T19:02:21.404123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400484+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:02:21.400484+0000","last_peered":"2024-04-23T19:02:21.400484+0000","last_clean":"2024-04-23T19:02:21.400484+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:02:21.400484+0000","last_undegraded":"2024-04-23T19:02:21.400484+0000","last_fullsized":"2024-04-23T19:02:21.400484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'13","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400002+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:02:21.400002+0000","last_peered":"2024-04-23T19:02:21.400002+0000","last_clean":"2024-04-23T19:02:21.400002+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:02:21.400002+0000","last_undegraded":"2024-04-23T19:02:21.400002+0000","last_fullsized":"2024-04-23T19:02:21.400002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152590+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:02:21.152590+0000","last_peered":"2024-04-23T19:02:21.152590+0000","last_clean":"2024-04-23T19:02:21.152590+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:02:21.152590+0000","last_undegraded":"2024-04-23T19:02:21.152590+0000","last_fullsized":"2024-04-23T19:02:21.152590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'111","reported_seq":304,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147864+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:02:21.147864+0000","last_peered":"2024-04-23T19:02:21.147864+0000","last_clean":"2024-04-23T19:02:21.147864+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:02:21.147864+0000","last_undegraded":"2024-04-23T19:02:21.147864+0000","last_fullsized":"2024-04-23T19:02:21.147864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":147,"num_read_kb":132,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398968+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:02:21.398968+0000","last_peered":"2024-04-23T19:02:21.398968+0000","last_clean":"2024-04-23T19:02:21.398968+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:02:21.398968+0000","last_undegraded":"2024-04-23T19:02:21.398968+0000","last_fullsized":"2024-04-23T19:02:21.398968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147322+0000","last_change":"2024-04-23T19:00:25.337116+0000","last_active":"2024-04-23T19:02:21.147322+0000","last_peered":"2024-04-23T19:02:21.147322+0000","last_clean":"2024-04-23T19:02:21.147322+0000","last_became_active":"2024-04-23T19:00:25.336196+0000","last_became_peered":"2024-04-23T19:00:25.336196+0000","last_unstale":"2024-04-23T19:02:21.147322+0000","last_undegraded":"2024-04-23T19:02:21.147322+0000","last_fullsized":"2024-04-23T19:02:21.147322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:14.525312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149672+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:02:21.149672+0000","last_peered":"2024-04-23T19:02:21.149672+0000","last_clean":"2024-04-23T19:02:21.149672+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:02:21.149672+0000","last_undegraded":"2024-04-23T19:02:21.149672+0000","last_fullsized":"2024-04-23T19:02:21.149672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397136+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:02:21.397136+0000","last_peered":"2024-04-23T19:02:21.397136+0000","last_clean":"2024-04-23T19:02:21.397136+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:02:21.397136+0000","last_undegraded":"2024-04-23T19:02:21.397136+0000","last_fullsized":"2024-04-23T19:02:21.397136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147506+0000","last_change":"2024-04-23T19:00:15.254230+0000","last_active":"2024-04-23T19:02:21.147506+0000","last_peered":"2024-04-23T19:02:21.147506+0000","last_clean":"2024-04-23T19:02:21.147506+0000","last_became_active":"2024-04-23T19:00:15.253857+0000","last_became_peered":"2024-04-23T19:00:15.253857+0000","last_unstale":"2024-04-23T19:02:21.147506+0000","last_undegraded":"2024-04-23T19:02:21.147506+0000","last_fullsized":"2024-04-23T19:02:21.147506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398435+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:02:21.398435+0000","last_peered":"2024-04-23T19:02:21.398435+0000","last_clean":"2024-04-23T19:02:21.398435+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:02:21.398435+0000","last_undegraded":"2024-04-23T19:02:21.398435+0000","last_fullsized":"2024-04-23T19:02:21.398435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'16","reported_seq":162,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399338+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:02:21.399338+0000","last_peered":"2024-04-23T19:02:21.399338+0000","last_clean":"2024-04-23T19:02:21.399338+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:02:21.399338+0000","last_undegraded":"2024-04-23T19:02:21.399338+0000","last_fullsized":"2024-04-23T19:02:21.399338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399587+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:02:21.399587+0000","last_peered":"2024-04-23T19:02:21.399587+0000","last_clean":"2024-04-23T19:02:21.399587+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:02:21.399587+0000","last_undegraded":"2024-04-23T19:02:21.399587+0000","last_fullsized":"2024-04-23T19:02:21.399587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400024+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:02:21.400024+0000","last_peered":"2024-04-23T19:02:21.400024+0000","last_clean":"2024-04-23T19:02:21.400024+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:02:21.400024+0000","last_undegraded":"2024-04-23T19:02:21.400024+0000","last_fullsized":"2024-04-23T19:02:21.400024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147912+0000","last_change":"2024-04-23T19:00:17.298132+0000","last_active":"2024-04-23T19:02:21.147912+0000","last_peered":"2024-04-23T19:02:21.147912+0000","last_clean":"2024-04-23T19:02:21.147912+0000","last_became_active":"2024-04-23T19:00:17.297866+0000","last_became_peered":"2024-04-23T19:00:17.297866+0000","last_unstale":"2024-04-23T19:02:21.147912+0000","last_undegraded":"2024-04-23T19:02:21.147912+0000","last_fullsized":"2024-04-23T19:02:21.147912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151713+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:02:21.151713+0000","last_peered":"2024-04-23T19:02:21.151713+0000","last_clean":"2024-04-23T19:02:21.151713+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:02:21.151713+0000","last_undegraded":"2024-04-23T19:02:21.151713+0000","last_fullsized":"2024-04-23T19:02:21.151713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147879+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:02:21.147879+0000","last_peered":"2024-04-23T19:02:21.147879+0000","last_clean":"2024-04-23T19:02:21.147879+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:02:21.147879+0000","last_undegraded":"2024-04-23T19:02:21.147879+0000","last_fullsized":"2024-04-23T19:02:21.147879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":190,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400770+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:02:21.400770+0000","last_peered":"2024-04-23T19:02:21.400770+0000","last_clean":"2024-04-23T19:02:21.400770+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:02:21.400770+0000","last_undegraded":"2024-04-23T19:02:21.400770+0000","last_fullsized":"2024-04-23T19:02:21.400770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397495+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:02:21.397495+0000","last_peered":"2024-04-23T19:02:21.397495+0000","last_clean":"2024-04-23T19:02:21.397495+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:02:21.397495+0000","last_undegraded":"2024-04-23T19:02:21.397495+0000","last_fullsized":"2024-04-23T19:02:21.397495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399328+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:02:21.399328+0000","last_peered":"2024-04-23T19:02:21.399328+0000","last_clean":"2024-04-23T19:02:21.399328+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:02:21.399328+0000","last_undegraded":"2024-04-23T19:02:21.399328+0000","last_fullsized":"2024-04-23T19:02:21.399328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"57'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146448+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:02:21.146448+0000","last_peered":"2024-04-23T19:02:21.146448+0000","last_clean":"2024-04-23T19:02:21.146448+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:02:21.146448+0000","last_undegraded":"2024-04-23T19:02:21.146448+0000","last_fullsized":"2024-04-23T19:02:21.146448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147816+0000","last_change":"2024-04-23T19:00:17.323700+0000","last_active":"2024-04-23T19:02:21.147816+0000","last_peered":"2024-04-23T19:02:21.147816+0000","last_clean":"2024-04-23T19:02:21.147816+0000","last_became_active":"2024-04-23T19:00:17.323443+0000","last_became_peered":"2024-04-23T19:00:17.323443+0000","last_unstale":"2024-04-23T19:02:21.147816+0000","last_undegraded":"2024-04-23T19:02:21.147816+0000","last_fullsized":"2024-04-23T19:02:21.147816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'9","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150396+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:02:21.150396+0000","last_peered":"2024-04-23T19:02:21.150396+0000","last_clean":"2024-04-23T19:02:21.150396+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:02:21.150396+0000","last_undegraded":"2024-04-23T19:02:21.150396+0000","last_fullsized":"2024-04-23T19:02:21.150396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148123+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:02:21.148123+0000","last_peered":"2024-04-23T19:02:21.148123+0000","last_clean":"2024-04-23T19:02:21.148123+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:02:21.148123+0000","last_undegraded":"2024-04-23T19:02:21.148123+0000","last_fullsized":"2024-04-23T19:02:21.148123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400158+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:02:21.400158+0000","last_peered":"2024-04-23T19:02:21.400158+0000","last_clean":"2024-04-23T19:02:21.400158+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:02:21.400158+0000","last_undegraded":"2024-04-23T19:02:21.400158+0000","last_fullsized":"2024-04-23T19:02:21.400158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'30","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400612+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:02:21.400612+0000","last_peered":"2024-04-23T19:02:21.400612+0000","last_clean":"2024-04-23T19:02:21.400612+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:02:21.400612+0000","last_undegraded":"2024-04-23T19:02:21.400612+0000","last_fullsized":"2024-04-23T19:02:21.400612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146055+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:02:21.146055+0000","last_peered":"2024-04-23T19:02:21.146055+0000","last_clean":"2024-04-23T19:02:21.146055+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:02:21.146055+0000","last_undegraded":"2024-04-23T19:02:21.146055+0000","last_fullsized":"2024-04-23T19:02:21.146055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400831+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:02:21.400831+0000","last_peered":"2024-04-23T19:02:21.400831+0000","last_clean":"2024-04-23T19:02:21.400831+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:02:21.400831+0000","last_undegraded":"2024-04-23T19:02:21.400831+0000","last_fullsized":"2024-04-23T19:02:21.400831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400436+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:02:21.400436+0000","last_peered":"2024-04-23T19:02:21.400436+0000","last_clean":"2024-04-23T19:02:21.400436+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:02:21.400436+0000","last_undegraded":"2024-04-23T19:02:21.400436+0000","last_fullsized":"2024-04-23T19:02:21.400436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148049+0000","last_change":"2024-04-23T19:00:15.252825+0000","last_active":"2024-04-23T19:02:21.148049+0000","last_peered":"2024-04-23T19:02:21.148049+0000","last_clean":"2024-04-23T19:02:21.148049+0000","last_became_active":"2024-04-23T19:00:15.247413+0000","last_became_peered":"2024-04-23T19:00:15.247413+0000","last_unstale":"2024-04-23T19:02:21.148049+0000","last_undegraded":"2024-04-23T19:02:21.148049+0000","last_fullsized":"2024-04-23T19:02:21.148049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399914+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:02:21.399914+0000","last_peered":"2024-04-23T19:02:21.399914+0000","last_clean":"2024-04-23T19:02:21.399914+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:02:21.399914+0000","last_undegraded":"2024-04-23T19:02:21.399914+0000","last_fullsized":"2024-04-23T19:02:21.399914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398555+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:02:21.398555+0000","last_peered":"2024-04-23T19:02:21.398555+0000","last_clean":"2024-04-23T19:02:21.398555+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:02:21.398555+0000","last_undegraded":"2024-04-23T19:02:21.398555+0000","last_fullsized":"2024-04-23T19:02:21.398555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147256+0000","last_change":"2024-04-23T19:00:21.313162+0000","last_active":"2024-04-23T19:02:21.147256+0000","last_peered":"2024-04-23T19:02:21.147256+0000","last_clean":"2024-04-23T19:02:21.147256+0000","last_became_active":"2024-04-23T19:00:21.312313+0000","last_became_peered":"2024-04-23T19:00:21.312313+0000","last_unstale":"2024-04-23T19:02:21.147256+0000","last_undegraded":"2024-04-23T19:02:21.147256+0000","last_fullsized":"2024-04-23T19:02:21.147256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:05.309099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"75'107","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147697+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:02:21.147697+0000","last_peered":"2024-04-23T19:02:21.147697+0000","last_clean":"2024-04-23T19:02:21.147697+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:02:21.147697+0000","last_undegraded":"2024-04-23T19:02:21.147697+0000","last_fullsized":"2024-04-23T19:02:21.147697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401878+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:02:21.401878+0000","last_peered":"2024-04-23T19:02:21.401878+0000","last_clean":"2024-04-23T19:02:21.401878+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:02:21.401878+0000","last_undegraded":"2024-04-23T19:02:21.401878+0000","last_fullsized":"2024-04-23T19:02:21.401878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398269+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:02:21.398269+0000","last_peered":"2024-04-23T19:02:21.398269+0000","last_clean":"2024-04-23T19:02:21.398269+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:02:21.398269+0000","last_undegraded":"2024-04-23T19:02:21.398269+0000","last_fullsized":"2024-04-23T19:02:21.398269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"74'4","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401526+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:02:21.401526+0000","last_peered":"2024-04-23T19:02:21.401526+0000","last_clean":"2024-04-23T19:02:21.401526+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:02:21.401526+0000","last_undegraded":"2024-04-23T19:02:21.401526+0000","last_fullsized":"2024-04-23T19:02:21.401526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148678+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:02:21.148678+0000","last_peered":"2024-04-23T19:02:21.148678+0000","last_clean":"2024-04-23T19:02:21.148678+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:02:21.148678+0000","last_undegraded":"2024-04-23T19:02:21.148678+0000","last_fullsized":"2024-04-23T19:02:21.148678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146648+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:02:21.146648+0000","last_peered":"2024-04-23T19:02:21.146648+0000","last_clean":"2024-04-23T19:02:21.146648+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:02:21.146648+0000","last_undegraded":"2024-04-23T19:02:21.146648+0000","last_fullsized":"2024-04-23T19:02:21.146648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147914+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:02:21.147914+0000","last_peered":"2024-04-23T19:02:21.147914+0000","last_clean":"2024-04-23T19:02:21.147914+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:02:21.147914+0000","last_undegraded":"2024-04-23T19:02:21.147914+0000","last_fullsized":"2024-04-23T19:02:21.147914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"75'107","reported_seq":321,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400664+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:02:21.400664+0000","last_peered":"2024-04-23T19:02:21.400664+0000","last_clean":"2024-04-23T19:02:21.400664+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:02:21.400664+0000","last_undegraded":"2024-04-23T19:02:21.400664+0000","last_fullsized":"2024-04-23T19:02:21.400664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399816+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:02:21.399816+0000","last_peered":"2024-04-23T19:02:21.399816+0000","last_clean":"2024-04-23T19:02:21.399816+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:02:21.399816+0000","last_undegraded":"2024-04-23T19:02:21.399816+0000","last_fullsized":"2024-04-23T19:02:21.399816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147280+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:02:21.147280+0000","last_peered":"2024-04-23T19:02:21.147280+0000","last_clean":"2024-04-23T19:02:21.147280+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:02:21.147280+0000","last_undegraded":"2024-04-23T19:02:21.147280+0000","last_fullsized":"2024-04-23T19:02:21.147280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'6","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404318+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:02:21.404318+0000","last_peered":"2024-04-23T19:02:21.404318+0000","last_clean":"2024-04-23T19:02:21.404318+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:02:21.404318+0000","last_undegraded":"2024-04-23T19:02:21.404318+0000","last_fullsized":"2024-04-23T19:02:21.404318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399682+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:02:21.399682+0000","last_peered":"2024-04-23T19:02:21.399682+0000","last_clean":"2024-04-23T19:02:21.399682+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:02:21.399682+0000","last_undegraded":"2024-04-23T19:02:21.399682+0000","last_fullsized":"2024-04-23T19:02:21.399682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398153+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:02:21.398153+0000","last_peered":"2024-04-23T19:02:21.398153+0000","last_clean":"2024-04-23T19:02:21.398153+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:02:21.398153+0000","last_undegraded":"2024-04-23T19:02:21.398153+0000","last_fullsized":"2024-04-23T19:02:21.398153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'37","reported_seq":170,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397480+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:02:21.397480+0000","last_peered":"2024-04-23T19:02:21.397480+0000","last_clean":"2024-04-23T19:02:21.397480+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:02:21.397480+0000","last_undegraded":"2024-04-23T19:02:21.397480+0000","last_fullsized":"2024-04-23T19:02:21.397480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397168+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:02:21.397168+0000","last_peered":"2024-04-23T19:02:21.397168+0000","last_clean":"2024-04-23T19:02:21.397168+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:02:21.397168+0000","last_undegraded":"2024-04-23T19:02:21.397168+0000","last_fullsized":"2024-04-23T19:02:21.397168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149138+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:02:21.149138+0000","last_peered":"2024-04-23T19:02:21.149138+0000","last_clean":"2024-04-23T19:02:21.149138+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:02:21.149138+0000","last_undegraded":"2024-04-23T19:02:21.149138+0000","last_fullsized":"2024-04-23T19:02:21.149138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401784+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:02:21.401784+0000","last_peered":"2024-04-23T19:02:21.401784+0000","last_clean":"2024-04-23T19:02:21.401784+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:02:21.401784+0000","last_undegraded":"2024-04-23T19:02:21.401784+0000","last_fullsized":"2024-04-23T19:02:21.401784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146951+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:02:21.146951+0000","last_peered":"2024-04-23T19:02:21.146951+0000","last_clean":"2024-04-23T19:02:21.146951+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:02:21.146951+0000","last_undegraded":"2024-04-23T19:02:21.146951+0000","last_fullsized":"2024-04-23T19:02:21.146951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"74'7","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148383+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:02:21.148383+0000","last_peered":"2024-04-23T19:02:21.148383+0000","last_clean":"2024-04-23T19:02:21.148383+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:02:21.148383+0000","last_undegraded":"2024-04-23T19:02:21.148383+0000","last_fullsized":"2024-04-23T19:02:21.148383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147903+0000","last_change":"2024-04-23T19:00:19.302914+0000","last_active":"2024-04-23T19:02:21.147903+0000","last_peered":"2024-04-23T19:02:21.147903+0000","last_clean":"2024-04-23T19:02:21.147903+0000","last_became_active":"2024-04-23T19:00:19.302271+0000","last_became_peered":"2024-04-23T19:00:19.302271+0000","last_unstale":"2024-04-23T19:02:21.147903+0000","last_undegraded":"2024-04-23T19:02:21.147903+0000","last_fullsized":"2024-04-23T19:02:21.147903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:39.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'17","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397588+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:02:21.397588+0000","last_peered":"2024-04-23T19:02:21.397588+0000","last_clean":"2024-04-23T19:02:21.397588+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:02:21.397588+0000","last_undegraded":"2024-04-23T19:02:21.397588+0000","last_fullsized":"2024-04-23T19:02:21.397588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397983+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:02:21.397983+0000","last_peered":"2024-04-23T19:02:21.397983+0000","last_clean":"2024-04-23T19:02:21.397983+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:02:21.397983+0000","last_undegraded":"2024-04-23T19:02:21.397983+0000","last_fullsized":"2024-04-23T19:02:21.397983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401360+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:02:21.401360+0000","last_peered":"2024-04-23T19:02:21.401360+0000","last_clean":"2024-04-23T19:02:21.401360+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:02:21.401360+0000","last_undegraded":"2024-04-23T19:02:21.401360+0000","last_fullsized":"2024-04-23T19:02:21.401360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147649+0000","last_change":"2024-04-23T19:00:17.321501+0000","last_active":"2024-04-23T19:02:21.147649+0000","last_peered":"2024-04-23T19:02:21.147649+0000","last_clean":"2024-04-23T19:02:21.147649+0000","last_became_active":"2024-04-23T19:00:17.321203+0000","last_became_peered":"2024-04-23T19:00:17.321203+0000","last_unstale":"2024-04-23T19:02:21.147649+0000","last_undegraded":"2024-04-23T19:02:21.147649+0000","last_fullsized":"2024-04-23T19:02:21.147649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'15","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399634+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:02:21.399634+0000","last_peered":"2024-04-23T19:02:21.399634+0000","last_clean":"2024-04-23T19:02:21.399634+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:02:21.399634+0000","last_undegraded":"2024-04-23T19:02:21.399634+0000","last_fullsized":"2024-04-23T19:02:21.399634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399937+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:02:21.399937+0000","last_peered":"2024-04-23T19:02:21.399937+0000","last_clean":"2024-04-23T19:02:21.399937+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:02:21.399937+0000","last_undegraded":"2024-04-23T19:02:21.399937+0000","last_fullsized":"2024-04-23T19:02:21.399937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"68'7","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401255+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:02:21.401255+0000","last_peered":"2024-04-23T19:02:21.401255+0000","last_clean":"2024-04-23T19:02:21.401255+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:02:21.401255+0000","last_undegraded":"2024-04-23T19:02:21.401255+0000","last_fullsized":"2024-04-23T19:02:21.401255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398041+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:02:21.398041+0000","last_peered":"2024-04-23T19:02:21.398041+0000","last_clean":"2024-04-23T19:02:21.398041+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:02:21.398041+0000","last_undegraded":"2024-04-23T19:02:21.398041+0000","last_fullsized":"2024-04-23T19:02:21.398041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398902+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:02:21.398902+0000","last_peered":"2024-04-23T19:02:21.398902+0000","last_clean":"2024-04-23T19:02:21.398902+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:02:21.398902+0000","last_undegraded":"2024-04-23T19:02:21.398902+0000","last_fullsized":"2024-04-23T19:02:21.398902+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"53'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397902+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:02:21.397902+0000","last_peered":"2024-04-23T19:02:21.397902+0000","last_clean":"2024-04-23T19:02:21.397902+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:02:21.397902+0000","last_undegraded":"2024-04-23T19:02:21.397902+0000","last_fullsized":"2024-04-23T19:02:21.397902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"75'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152334+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:02:21.152334+0000","last_peered":"2024-04-23T19:02:21.152334+0000","last_clean":"2024-04-23T19:02:21.152334+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:02:21.152334+0000","last_undegraded":"2024-04-23T19:02:21.152334+0000","last_fullsized":"2024-04-23T19:02:21.152334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397474+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:02:21.397474+0000","last_peered":"2024-04-23T19:02:21.397474+0000","last_clean":"2024-04-23T19:02:21.397474+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:02:21.397474+0000","last_undegraded":"2024-04-23T19:02:21.397474+0000","last_fullsized":"2024-04-23T19:02:21.397474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'19","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399740+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:02:21.399740+0000","last_peered":"2024-04-23T19:02:21.399740+0000","last_clean":"2024-04-23T19:02:21.399740+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:02:21.399740+0000","last_undegraded":"2024-04-23T19:02:21.399740+0000","last_fullsized":"2024-04-23T19:02:21.399740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398440+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:02:21.398440+0000","last_peered":"2024-04-23T19:02:21.398440+0000","last_clean":"2024-04-23T19:02:21.398440+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:02:21.398440+0000","last_undegraded":"2024-04-23T19:02:21.398440+0000","last_fullsized":"2024-04-23T19:02:21.398440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148355+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:02:21.148355+0000","last_peered":"2024-04-23T19:02:21.148355+0000","last_clean":"2024-04-23T19:02:21.148355+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:02:21.148355+0000","last_undegraded":"2024-04-23T19:02:21.148355+0000","last_fullsized":"2024-04-23T19:02:21.148355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398428+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:02:21.398428+0000","last_peered":"2024-04-23T19:02:21.398428+0000","last_clean":"2024-04-23T19:02:21.398428+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:02:21.398428+0000","last_undegraded":"2024-04-23T19:02:21.398428+0000","last_fullsized":"2024-04-23T19:02:21.398428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"75'5","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402140+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:02:21.402140+0000","last_peered":"2024-04-23T19:02:21.402140+0000","last_clean":"2024-04-23T19:02:21.402140+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:02:21.402140+0000","last_undegraded":"2024-04-23T19:02:21.402140+0000","last_fullsized":"2024-04-23T19:02:21.402140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399401+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:02:21.399401+0000","last_peered":"2024-04-23T19:02:21.399401+0000","last_clean":"2024-04-23T19:02:21.399401+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:02:21.399401+0000","last_undegraded":"2024-04-23T19:02:21.399401+0000","last_fullsized":"2024-04-23T19:02:21.399401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'15","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397326+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:02:21.397326+0000","last_peered":"2024-04-23T19:02:21.397326+0000","last_clean":"2024-04-23T19:02:21.397326+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:02:21.397326+0000","last_undegraded":"2024-04-23T19:02:21.397326+0000","last_fullsized":"2024-04-23T19:02:21.397326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399989+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:02:21.399989+0000","last_peered":"2024-04-23T19:02:21.399989+0000","last_clean":"2024-04-23T19:02:21.399989+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:02:21.399989+0000","last_undegraded":"2024-04-23T19:02:21.399989+0000","last_fullsized":"2024-04-23T19:02:21.399989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399608+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:02:21.399608+0000","last_peered":"2024-04-23T19:02:21.399608+0000","last_clean":"2024-04-23T19:02:21.399608+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:02:21.399608+0000","last_undegraded":"2024-04-23T19:02:21.399608+0000","last_fullsized":"2024-04-23T19:02:21.399608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'9","reported_seq":161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398632+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:02:21.398632+0000","last_peered":"2024-04-23T19:02:21.398632+0000","last_clean":"2024-04-23T19:02:21.398632+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:02:21.398632+0000","last_undegraded":"2024-04-23T19:02:21.398632+0000","last_fullsized":"2024-04-23T19:02:21.398632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404028+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:02:21.404028+0000","last_peered":"2024-04-23T19:02:21.404028+0000","last_clean":"2024-04-23T19:02:21.404028+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:02:21.404028+0000","last_undegraded":"2024-04-23T19:02:21.404028+0000","last_fullsized":"2024-04-23T19:02:21.404028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'25","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147784+0000","last_change":"2024-04-23T19:00:21.317917+0000","last_active":"2024-04-23T19:02:21.147784+0000","last_peered":"2024-04-23T19:02:21.147784+0000","last_clean":"2024-04-23T19:02:21.147784+0000","last_became_active":"2024-04-23T19:00:21.317050+0000","last_became_peered":"2024-04-23T19:00:21.317050+0000","last_unstale":"2024-04-23T19:02:21.147784+0000","last_undegraded":"2024-04-23T19:02:21.147784+0000","last_fullsized":"2024-04-23T19:02:21.147784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:14.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148926+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:02:21.148926+0000","last_peered":"2024-04-23T19:02:21.148926+0000","last_clean":"2024-04-23T19:02:21.148926+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:02:21.148926+0000","last_undegraded":"2024-04-23T19:02:21.148926+0000","last_fullsized":"2024-04-23T19:02:21.148926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396933+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:02:21.396933+0000","last_peered":"2024-04-23T19:02:21.396933+0000","last_clean":"2024-04-23T19:02:21.396933+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:02:21.396933+0000","last_undegraded":"2024-04-23T19:02:21.396933+0000","last_fullsized":"2024-04-23T19:02:21.396933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"53'4","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404086+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:02:21.404086+0000","last_peered":"2024-04-23T19:02:21.404086+0000","last_clean":"2024-04-23T19:02:21.404086+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:02:21.404086+0000","last_undegraded":"2024-04-23T19:02:21.404086+0000","last_fullsized":"2024-04-23T19:02:21.404086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148139+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:02:21.148139+0000","last_peered":"2024-04-23T19:02:21.148139+0000","last_clean":"2024-04-23T19:02:21.148139+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:02:21.148139+0000","last_undegraded":"2024-04-23T19:02:21.148139+0000","last_fullsized":"2024-04-23T19:02:21.148139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399403+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:02:21.399403+0000","last_peered":"2024-04-23T19:02:21.399403+0000","last_clean":"2024-04-23T19:02:21.399403+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:02:21.399403+0000","last_undegraded":"2024-04-23T19:02:21.399403+0000","last_fullsized":"2024-04-23T19:02:21.399403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'22","reported_seq":148,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398234+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:02:21.398234+0000","last_peered":"2024-04-23T19:02:21.398234+0000","last_clean":"2024-04-23T19:02:21.398234+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:02:21.398234+0000","last_undegraded":"2024-04-23T19:02:21.398234+0000","last_fullsized":"2024-04-23T19:02:21.398234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148070+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:02:21.148070+0000","last_peered":"2024-04-23T19:02:21.148070+0000","last_clean":"2024-04-23T19:02:21.148070+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:02:21.148070+0000","last_undegraded":"2024-04-23T19:02:21.148070+0000","last_fullsized":"2024-04-23T19:02:21.148070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398230+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:02:21.398230+0000","last_peered":"2024-04-23T19:02:21.398230+0000","last_clean":"2024-04-23T19:02:21.398230+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:02:21.398230+0000","last_undegraded":"2024-04-23T19:02:21.398230+0000","last_fullsized":"2024-04-23T19:02:21.398230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400884+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:02:21.400884+0000","last_peered":"2024-04-23T19:02:21.400884+0000","last_clean":"2024-04-23T19:02:21.400884+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:02:21.400884+0000","last_undegraded":"2024-04-23T19:02:21.400884+0000","last_fullsized":"2024-04-23T19:02:21.400884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149032+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:02:21.149032+0000","last_peered":"2024-04-23T19:02:21.149032+0000","last_clean":"2024-04-23T19:02:21.149032+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:02:21.149032+0000","last_undegraded":"2024-04-23T19:02:21.149032+0000","last_fullsized":"2024-04-23T19:02:21.149032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150260+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:02:21.150260+0000","last_peered":"2024-04-23T19:02:21.150260+0000","last_clean":"2024-04-23T19:02:21.150260+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:02:21.150260+0000","last_undegraded":"2024-04-23T19:02:21.150260+0000","last_fullsized":"2024-04-23T19:02:21.150260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'18","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402106+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:02:21.402106+0000","last_peered":"2024-04-23T19:02:21.402106+0000","last_clean":"2024-04-23T19:02:21.402106+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:02:21.402106+0000","last_undegraded":"2024-04-23T19:02:21.402106+0000","last_fullsized":"2024-04-23T19:02:21.402106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148318+0000","last_change":"2024-04-23T19:00:23.344133+0000","last_active":"2024-04-23T19:02:21.148318+0000","last_peered":"2024-04-23T19:02:21.148318+0000","last_clean":"2024-04-23T19:02:21.148318+0000","last_became_active":"2024-04-23T19:00:23.343020+0000","last_became_peered":"2024-04-23T19:00:23.343020+0000","last_unstale":"2024-04-23T19:02:21.148318+0000","last_undegraded":"2024-04-23T19:02:21.148318+0000","last_fullsized":"2024-04-23T19:02:21.148318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:16.330420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"52'5","reported_seq":115,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148810+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:02:21.148810+0000","last_peered":"2024-04-23T19:02:21.148810+0000","last_clean":"2024-04-23T19:02:21.148810+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:02:21.148810+0000","last_undegraded":"2024-04-23T19:02:21.148810+0000","last_fullsized":"2024-04-23T19:02:21.148810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397385+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:02:21.397385+0000","last_peered":"2024-04-23T19:02:21.397385+0000","last_clean":"2024-04-23T19:02:21.397385+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:02:21.397385+0000","last_undegraded":"2024-04-23T19:02:21.397385+0000","last_fullsized":"2024-04-23T19:02:21.397385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399450+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:02:21.399450+0000","last_peered":"2024-04-23T19:02:21.399450+0000","last_clean":"2024-04-23T19:02:21.399450+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:02:21.399450+0000","last_undegraded":"2024-04-23T19:02:21.399450+0000","last_fullsized":"2024-04-23T19:02:21.399450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148299+0000","last_change":"2024-04-23T19:00:19.306559+0000","last_active":"2024-04-23T19:02:21.148299+0000","last_peered":"2024-04-23T19:02:21.148299+0000","last_clean":"2024-04-23T19:02:21.148299+0000","last_became_active":"2024-04-23T19:00:19.305854+0000","last_became_peered":"2024-04-23T19:00:19.305854+0000","last_unstale":"2024-04-23T19:02:21.148299+0000","last_undegraded":"2024-04-23T19:02:21.148299+0000","last_fullsized":"2024-04-23T19:02:21.148299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150137+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:02:21.150137+0000","last_peered":"2024-04-23T19:02:21.150137+0000","last_clean":"2024-04-23T19:02:21.150137+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:02:21.150137+0000","last_undegraded":"2024-04-23T19:02:21.150137+0000","last_fullsized":"2024-04-23T19:02:21.150137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"75'107","reported_seq":252,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399196+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:02:21.399196+0000","last_peered":"2024-04-23T19:02:21.399196+0000","last_clean":"2024-04-23T19:02:21.399196+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:02:21.399196+0000","last_undegraded":"2024-04-23T19:02:21.399196+0000","last_fullsized":"2024-04-23T19:02:21.399196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397307+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:02:21.397307+0000","last_peered":"2024-04-23T19:02:21.397307+0000","last_clean":"2024-04-23T19:02:21.397307+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:02:21.397307+0000","last_undegraded":"2024-04-23T19:02:21.397307+0000","last_fullsized":"2024-04-23T19:02:21.397307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146839+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:02:21.146839+0000","last_peered":"2024-04-23T19:02:21.146839+0000","last_clean":"2024-04-23T19:02:21.146839+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:02:21.146839+0000","last_undegraded":"2024-04-23T19:02:21.146839+0000","last_fullsized":"2024-04-23T19:02:21.146839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"57'3","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149640+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:02:21.149640+0000","last_peered":"2024-04-23T19:02:21.149640+0000","last_clean":"2024-04-23T19:02:21.149640+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:02:21.149640+0000","last_undegraded":"2024-04-23T19:02:21.149640+0000","last_fullsized":"2024-04-23T19:02:21.149640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397419+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:02:21.397419+0000","last_peered":"2024-04-23T19:02:21.397419+0000","last_clean":"2024-04-23T19:02:21.397419+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:02:21.397419+0000","last_undegraded":"2024-04-23T19:02:21.397419+0000","last_fullsized":"2024-04-23T19:02:21.397419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'21","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149069+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:02:21.149069+0000","last_peered":"2024-04-23T19:02:21.149069+0000","last_clean":"2024-04-23T19:02:21.149069+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:02:21.149069+0000","last_undegraded":"2024-04-23T19:02:21.149069+0000","last_fullsized":"2024-04-23T19:02:21.149069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400883+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:02:21.400883+0000","last_peered":"2024-04-23T19:02:21.400883+0000","last_clean":"2024-04-23T19:02:21.400883+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:02:21.400883+0000","last_undegraded":"2024-04-23T19:02:21.400883+0000","last_fullsized":"2024-04-23T19:02:21.400883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398905+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:02:21.398905+0000","last_peered":"2024-04-23T19:02:21.398905+0000","last_clean":"2024-04-23T19:02:21.398905+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:02:21.398905+0000","last_undegraded":"2024-04-23T19:02:21.398905+0000","last_fullsized":"2024-04-23T19:02:21.398905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"57'6","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148186+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:02:21.148186+0000","last_peered":"2024-04-23T19:02:21.148186+0000","last_clean":"2024-04-23T19:02:21.148186+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:02:21.148186+0000","last_undegraded":"2024-04-23T19:02:21.148186+0000","last_fullsized":"2024-04-23T19:02:21.148186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'7","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396901+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:02:21.396901+0000","last_peered":"2024-04-23T19:02:21.396901+0000","last_clean":"2024-04-23T19:02:21.396901+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:02:21.396901+0000","last_undegraded":"2024-04-23T19:02:21.396901+0000","last_fullsized":"2024-04-23T19:02:21.396901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148443+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:02:21.148443+0000","last_peered":"2024-04-23T19:02:21.148443+0000","last_clean":"2024-04-23T19:02:21.148443+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:02:21.148443+0000","last_undegraded":"2024-04-23T19:02:21.148443+0000","last_fullsized":"2024-04-23T19:02:21.148443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'15","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400734+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:02:21.400734+0000","last_peered":"2024-04-23T19:02:21.400734+0000","last_clean":"2024-04-23T19:02:21.400734+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:02:21.400734+0000","last_undegraded":"2024-04-23T19:02:21.400734+0000","last_fullsized":"2024-04-23T19:02:21.400734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398213+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:02:21.398213+0000","last_peered":"2024-04-23T19:02:21.398213+0000","last_clean":"2024-04-23T19:02:21.398213+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:02:21.398213+0000","last_undegraded":"2024-04-23T19:02:21.398213+0000","last_fullsized":"2024-04-23T19:02:21.398213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401477+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:02:21.401477+0000","last_peered":"2024-04-23T19:02:21.401477+0000","last_clean":"2024-04-23T19:02:21.401477+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:02:21.401477+0000","last_undegraded":"2024-04-23T19:02:21.401477+0000","last_fullsized":"2024-04-23T19:02:21.401477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":166,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398000+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:02:21.398000+0000","last_peered":"2024-04-23T19:02:21.398000+0000","last_clean":"2024-04-23T19:02:21.398000+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:02:21.398000+0000","last_undegraded":"2024-04-23T19:02:21.398000+0000","last_fullsized":"2024-04-23T19:02:21.398000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401783+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:02:21.401783+0000","last_peered":"2024-04-23T19:02:21.401783+0000","last_clean":"2024-04-23T19:02:21.401783+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:02:21.401783+0000","last_undegraded":"2024-04-23T19:02:21.401783+0000","last_fullsized":"2024-04-23T19:02:21.401783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.145916+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:02:21.145916+0000","last_peered":"2024-04-23T19:02:21.145916+0000","last_clean":"2024-04-23T19:02:21.145916+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:02:21.145916+0000","last_undegraded":"2024-04-23T19:02:21.145916+0000","last_fullsized":"2024-04-23T19:02:21.145916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'12","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400441+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:02:21.400441+0000","last_peered":"2024-04-23T19:02:21.400441+0000","last_clean":"2024-04-23T19:02:21.400441+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:02:21.400441+0000","last_undegraded":"2024-04-23T19:02:21.400441+0000","last_fullsized":"2024-04-23T19:02:21.400441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146540+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:02:21.146540+0000","last_peered":"2024-04-23T19:02:21.146540+0000","last_clean":"2024-04-23T19:02:21.146540+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:02:21.146540+0000","last_undegraded":"2024-04-23T19:02:21.146540+0000","last_fullsized":"2024-04-23T19:02:21.146540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399217+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:02:21.399217+0000","last_peered":"2024-04-23T19:02:21.399217+0000","last_clean":"2024-04-23T19:02:21.399217+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:02:21.399217+0000","last_undegraded":"2024-04-23T19:02:21.399217+0000","last_fullsized":"2024-04-23T19:02:21.399217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146213+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:02:21.146213+0000","last_peered":"2024-04-23T19:02:21.146213+0000","last_clean":"2024-04-23T19:02:21.146213+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:02:21.146213+0000","last_undegraded":"2024-04-23T19:02:21.146213+0000","last_fullsized":"2024-04-23T19:02:21.146213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'7","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401548+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:02:21.401548+0000","last_peered":"2024-04-23T19:02:21.401548+0000","last_clean":"2024-04-23T19:02:21.401548+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:02:21.401548+0000","last_undegraded":"2024-04-23T19:02:21.401548+0000","last_fullsized":"2024-04-23T19:02:21.401548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147296+0000","last_change":"2024-04-23T19:00:19.302840+0000","last_active":"2024-04-23T19:02:21.147296+0000","last_peered":"2024-04-23T19:02:21.147296+0000","last_clean":"2024-04-23T19:02:21.147296+0000","last_became_active":"2024-04-23T19:00:19.302069+0000","last_became_peered":"2024-04-23T19:00:19.302069+0000","last_unstale":"2024-04-23T19:02:21.147296+0000","last_undegraded":"2024-04-23T19:02:21.147296+0000","last_fullsized":"2024-04-23T19:02:21.147296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:15.157506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'16","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146961+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:02:21.146961+0000","last_peered":"2024-04-23T19:02:21.146961+0000","last_clean":"2024-04-23T19:02:21.146961+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:02:21.146961+0000","last_undegraded":"2024-04-23T19:02:21.146961+0000","last_fullsized":"2024-04-23T19:02:21.146961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399877+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:02:21.399877+0000","last_peered":"2024-04-23T19:02:21.399877+0000","last_clean":"2024-04-23T19:02:21.399877+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:02:21.399877+0000","last_undegraded":"2024-04-23T19:02:21.399877+0000","last_fullsized":"2024-04-23T19:02:21.399877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146570+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:02:21.146570+0000","last_peered":"2024-04-23T19:02:21.146570+0000","last_clean":"2024-04-23T19:02:21.146570+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:02:21.146570+0000","last_undegraded":"2024-04-23T19:02:21.146570+0000","last_fullsized":"2024-04-23T19:02:21.146570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148639+0000","last_change":"2024-04-23T19:00:17.315323+0000","last_active":"2024-04-23T19:02:21.148639+0000","last_peered":"2024-04-23T19:02:21.148639+0000","last_clean":"2024-04-23T19:02:21.148639+0000","last_became_active":"2024-04-23T19:00:17.315077+0000","last_became_peered":"2024-04-23T19:00:17.315077+0000","last_unstale":"2024-04-23T19:02:21.148639+0000","last_undegraded":"2024-04-23T19:02:21.148639+0000","last_fullsized":"2024-04-23T19:02:21.148639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'10","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397658+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:02:21.397658+0000","last_peered":"2024-04-23T19:02:21.397658+0000","last_clean":"2024-04-23T19:02:21.397658+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:02:21.397658+0000","last_undegraded":"2024-04-23T19:02:21.397658+0000","last_fullsized":"2024-04-23T19:02:21.397658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148538+0000","last_change":"2024-04-23T19:00:17.297003+0000","last_active":"2024-04-23T19:02:21.148538+0000","last_peered":"2024-04-23T19:02:21.148538+0000","last_clean":"2024-04-23T19:02:21.148538+0000","last_became_active":"2024-04-23T19:00:17.295108+0000","last_became_peered":"2024-04-23T19:00:17.295108+0000","last_unstale":"2024-04-23T19:02:21.148538+0000","last_undegraded":"2024-04-23T19:02:21.148538+0000","last_fullsized":"2024-04-23T19:02:21.148538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"74'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397021+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:02:21.397021+0000","last_peered":"2024-04-23T19:02:21.397021+0000","last_clean":"2024-04-23T19:02:21.397021+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:02:21.397021+0000","last_undegraded":"2024-04-23T19:02:21.397021+0000","last_fullsized":"2024-04-23T19:02:21.397021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149572+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:02:21.149572+0000","last_peered":"2024-04-23T19:02:21.149572+0000","last_clean":"2024-04-23T19:02:21.149572+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:02:21.149572+0000","last_undegraded":"2024-04-23T19:02:21.149572+0000","last_fullsized":"2024-04-23T19:02:21.149572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151649+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:02:21.151649+0000","last_peered":"2024-04-23T19:02:21.151649+0000","last_clean":"2024-04-23T19:02:21.151649+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:02:21.151649+0000","last_undegraded":"2024-04-23T19:02:21.151649+0000","last_fullsized":"2024-04-23T19:02:21.151649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"53'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148070+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:02:21.148070+0000","last_peered":"2024-04-23T19:02:21.148070+0000","last_clean":"2024-04-23T19:02:21.148070+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:02:21.148070+0000","last_undegraded":"2024-04-23T19:02:21.148070+0000","last_fullsized":"2024-04-23T19:02:21.148070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399617+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:02:21.399617+0000","last_peered":"2024-04-23T19:02:21.399617+0000","last_clean":"2024-04-23T19:02:21.399617+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:02:21.399617+0000","last_undegraded":"2024-04-23T19:02:21.399617+0000","last_fullsized":"2024-04-23T19:02:21.399617+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":163,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400227+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:02:21.400227+0000","last_peered":"2024-04-23T19:02:21.400227+0000","last_clean":"2024-04-23T19:02:21.400227+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:02:21.400227+0000","last_undegraded":"2024-04-23T19:02:21.400227+0000","last_fullsized":"2024-04-23T19:02:21.400227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'12","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399480+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:02:21.399480+0000","last_peered":"2024-04-23T19:02:21.399480+0000","last_clean":"2024-04-23T19:02:21.399480+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:02:21.399480+0000","last_undegraded":"2024-04-23T19:02:21.399480+0000","last_fullsized":"2024-04-23T19:02:21.399480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148883+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:02:21.148883+0000","last_peered":"2024-04-23T19:02:21.148883+0000","last_clean":"2024-04-23T19:02:21.148883+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:02:21.148883+0000","last_undegraded":"2024-04-23T19:02:21.148883+0000","last_fullsized":"2024-04-23T19:02:21.148883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'13","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149821+0000","last_change":"2024-04-23T19:00:15.251155+0000","last_active":"2024-04-23T19:02:21.149821+0000","last_peered":"2024-04-23T19:02:21.149821+0000","last_clean":"2024-04-23T19:02:21.149821+0000","last_became_active":"2024-04-23T19:00:15.250798+0000","last_became_peered":"2024-04-23T19:00:15.250798+0000","last_unstale":"2024-04-23T19:02:21.149821+0000","last_undegraded":"2024-04-23T19:02:21.149821+0000","last_fullsized":"2024-04-23T19:02:21.149821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397859+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:02:21.397859+0000","last_peered":"2024-04-23T19:02:21.397859+0000","last_clean":"2024-04-23T19:02:21.397859+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:02:21.397859+0000","last_undegraded":"2024-04-23T19:02:21.397859+0000","last_fullsized":"2024-04-23T19:02:21.397859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'10","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399535+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:02:21.399535+0000","last_peered":"2024-04-23T19:02:21.399535+0000","last_clean":"2024-04-23T19:02:21.399535+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:02:21.399535+0000","last_undegraded":"2024-04-23T19:02:21.399535+0000","last_fullsized":"2024-04-23T19:02:21.399535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397534+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:02:21.397534+0000","last_peered":"2024-04-23T19:02:21.397534+0000","last_clean":"2024-04-23T19:02:21.397534+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:02:21.397534+0000","last_undegraded":"2024-04-23T19:02:21.397534+0000","last_fullsized":"2024-04-23T19:02:21.397534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401783+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:02:21.401783+0000","last_peered":"2024-04-23T19:02:21.401783+0000","last_clean":"2024-04-23T19:02:21.401783+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:02:21.401783+0000","last_undegraded":"2024-04-23T19:02:21.401783+0000","last_fullsized":"2024-04-23T19:02:21.401783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402073+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:02:21.402073+0000","last_peered":"2024-04-23T19:02:21.402073+0000","last_clean":"2024-04-23T19:02:21.402073+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:02:21.402073+0000","last_undegraded":"2024-04-23T19:02:21.402073+0000","last_fullsized":"2024-04-23T19:02:21.402073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"75'19","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148535+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:02:21.148535+0000","last_peered":"2024-04-23T19:02:21.148535+0000","last_clean":"2024-04-23T19:02:21.148535+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:02:21.148535+0000","last_undegraded":"2024-04-23T19:02:21.148535+0000","last_fullsized":"2024-04-23T19:02:21.148535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":59,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"75'6","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150282+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:02:21.150282+0000","last_peered":"2024-04-23T19:02:21.150282+0000","last_clean":"2024-04-23T19:02:21.150282+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:02:21.150282+0000","last_undegraded":"2024-04-23T19:02:21.150282+0000","last_fullsized":"2024-04-23T19:02:21.150282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"74'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398009+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:02:21.398009+0000","last_peered":"2024-04-23T19:02:21.398009+0000","last_clean":"2024-04-23T19:02:21.398009+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:02:21.398009+0000","last_undegraded":"2024-04-23T19:02:21.398009+0000","last_fullsized":"2024-04-23T19:02:21.398009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398289+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:02:21.398289+0000","last_peered":"2024-04-23T19:02:21.398289+0000","last_clean":"2024-04-23T19:02:21.398289+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:02:21.398289+0000","last_undegraded":"2024-04-23T19:02:21.398289+0000","last_fullsized":"2024-04-23T19:02:21.398289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151471+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:02:21.151471+0000","last_peered":"2024-04-23T19:02:21.151471+0000","last_clean":"2024-04-23T19:02:21.151471+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:02:21.151471+0000","last_undegraded":"2024-04-23T19:02:21.151471+0000","last_fullsized":"2024-04-23T19:02:21.151471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149139+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:02:21.149139+0000","last_peered":"2024-04-23T19:02:21.149139+0000","last_clean":"2024-04-23T19:02:21.149139+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:02:21.149139+0000","last_undegraded":"2024-04-23T19:02:21.149139+0000","last_fullsized":"2024-04-23T19:02:21.149139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'7","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400221+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:02:21.400221+0000","last_peered":"2024-04-23T19:02:21.400221+0000","last_clean":"2024-04-23T19:02:21.400221+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:02:21.400221+0000","last_undegraded":"2024-04-23T19:02:21.400221+0000","last_fullsized":"2024-04-23T19:02:21.400221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":146,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397871+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:02:21.397871+0000","last_peered":"2024-04-23T19:02:21.397871+0000","last_clean":"2024-04-23T19:02:21.397871+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:02:21.397871+0000","last_undegraded":"2024-04-23T19:02:21.397871+0000","last_fullsized":"2024-04-23T19:02:21.397871+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400118+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:02:21.400118+0000","last_peered":"2024-04-23T19:02:21.400118+0000","last_clean":"2024-04-23T19:02:21.400118+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:02:21.400118+0000","last_undegraded":"2024-04-23T19:02:21.400118+0000","last_fullsized":"2024-04-23T19:02:21.400118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399081+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:02:21.399081+0000","last_peered":"2024-04-23T19:02:21.399081+0000","last_clean":"2024-04-23T19:02:21.399081+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:02:21.399081+0000","last_undegraded":"2024-04-23T19:02:21.399081+0000","last_fullsized":"2024-04-23T19:02:21.399081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399911+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:02:21.399911+0000","last_peered":"2024-04-23T19:02:21.399911+0000","last_clean":"2024-04-23T19:02:21.399911+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:02:21.399911+0000","last_undegraded":"2024-04-23T19:02:21.399911+0000","last_fullsized":"2024-04-23T19:02:21.399911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"75'8","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397793+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:02:21.397793+0000","last_peered":"2024-04-23T19:02:21.397793+0000","last_clean":"2024-04-23T19:02:21.397793+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:02:21.397793+0000","last_undegraded":"2024-04-23T19:02:21.397793+0000","last_fullsized":"2024-04-23T19:02:21.397793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'7","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398554+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:02:21.398554+0000","last_peered":"2024-04-23T19:02:21.398554+0000","last_clean":"2024-04-23T19:02:21.398554+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:02:21.398554+0000","last_undegraded":"2024-04-23T19:02:21.398554+0000","last_fullsized":"2024-04-23T19:02:21.398554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400371+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:02:21.400371+0000","last_peered":"2024-04-23T19:02:21.400371+0000","last_clean":"2024-04-23T19:02:21.400371+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:02:21.400371+0000","last_undegraded":"2024-04-23T19:02:21.400371+0000","last_fullsized":"2024-04-23T19:02:21.400371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398707+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:02:21.398707+0000","last_peered":"2024-04-23T19:02:21.398707+0000","last_clean":"2024-04-23T19:02:21.398707+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:02:21.398707+0000","last_undegraded":"2024-04-23T19:02:21.398707+0000","last_fullsized":"2024-04-23T19:02:21.398707+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148276+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:02:21.148276+0000","last_peered":"2024-04-23T19:02:21.148276+0000","last_clean":"2024-04-23T19:02:21.148276+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:02:21.148276+0000","last_undegraded":"2024-04-23T19:02:21.148276+0000","last_fullsized":"2024-04-23T19:02:21.148276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"53'4","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402005+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:02:21.402005+0000","last_peered":"2024-04-23T19:02:21.402005+0000","last_clean":"2024-04-23T19:02:21.402005+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:02:21.402005+0000","last_undegraded":"2024-04-23T19:02:21.402005+0000","last_fullsized":"2024-04-23T19:02:21.402005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'12","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147888+0000","last_change":"2024-04-23T19:00:15.270216+0000","last_active":"2024-04-23T19:02:21.147888+0000","last_peered":"2024-04-23T19:02:21.147888+0000","last_clean":"2024-04-23T19:02:21.147888+0000","last_became_active":"2024-04-23T19:00:15.269392+0000","last_became_peered":"2024-04-23T19:00:15.269392+0000","last_unstale":"2024-04-23T19:02:21.147888+0000","last_undegraded":"2024-04-23T19:02:21.147888+0000","last_fullsized":"2024-04-23T19:02:21.147888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152166+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:02:21.152166+0000","last_peered":"2024-04-23T19:02:21.152166+0000","last_clean":"2024-04-23T19:02:21.152166+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:02:21.152166+0000","last_undegraded":"2024-04-23T19:02:21.152166+0000","last_fullsized":"2024-04-23T19:02:21.152166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":293,"num_read_kb":277,"num_write":246,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":145645,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":813,"num_read_kb":572,"num_write":449,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":243458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":354,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1250,"num_read_kb":1226,"num_write":256,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2113929216,"num_objects":506,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":506,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":578,"num_write_kb":2088960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4227858432,"data_stored":4227858432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595948,"kb_used_data":564756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93775892,"statfs":{"total":96636764160,"available":96026513408,"internally_reserved":0,"allocated":578310144,"data_stored":577834707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435596,"kb_used_data":404412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93936244,"statfs":{"total":96636764160,"available":96190713856,"internally_reserved":0,"allocated":414117888,"data_stored":413673071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583144,"kb_used_data":551956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93788696,"statfs":{"total":96636764160,"available":96039624704,"internally_reserved":0,"allocated":565202944,"data_stored":564717638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":652664,"kb_used_data":621480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93719176,"statfs":{"total":96636764160,"available":95968436224,"internally_reserved":0,"allocated":636395520,"data_stored":635969132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":724448,"kb_used_data":693264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93647392,"statfs":{"total":96636764160,"available":95894929408,"internally_reserved":0,"allocated":709902336,"data_stored":709430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380324,"kb_used_data":349144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93991516,"statfs":{"total":96636764160,"available":96247312384,"internally_reserved":0,"allocated":357523456,"data_stored":357097817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421336,"kb_used_data":390152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93950504,"statfs":{"total":96636764160,"available":96205316096,"internally_reserved":0,"allocated":399515648,"data_stored":399050685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":593852,"kb_used_data":562672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93777988,"statfs":{"total":96636764160,"available":96028659712,"internally_reserved":0,"allocated":576176128,"data_stored":575728576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":574619648,"data_stored":574619648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":398458880,"data_stored":398458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":708837376,"data_stored":708837376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":635437056,"data_stored":635437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":564133888,"data_stored":564133888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":413138944,"data_stored":413138944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":576716800,"data_stored":576716800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":59167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":59607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:02:25.668 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:02:25.733 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:25.732+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:25.766 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:25.767 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:25.767 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:25.767 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:25.782 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:25.870 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:25.872+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:25.934 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:25.933+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:25.949 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:25.949 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:25.949 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:25.964 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:26.035 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:26.033+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:26.037 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:02:26.049 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:02:26.067 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-04-23T19:02:25.928492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2114667245,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":2850,"num_read_kb":2547,"num_write":1698,"num_write_kb":2091649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2510,"ondisk_log_size":2510,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4387312,"kb_used_data":4137836,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750587408,"statfs":{"total":773094113280,"available":768601505792,"internally_reserved":0,"allocated":4237144064,"data_stored":4233501690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001229"},"pg_stats":[{"pgid":"3.3f","version":"75'12","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398569+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:02:21.398569+0000","last_peered":"2024-04-23T19:02:21.398569+0000","last_clean":"2024-04-23T19:02:21.398569+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:02:21.398569+0000","last_undegraded":"2024-04-23T19:02:21.398569+0000","last_fullsized":"2024-04-23T19:02:21.398569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147401+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:02:21.147401+0000","last_peered":"2024-04-23T19:02:21.147401+0000","last_clean":"2024-04-23T19:02:21.147401+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:02:21.147401+0000","last_undegraded":"2024-04-23T19:02:21.147401+0000","last_fullsized":"2024-04-23T19:02:21.147401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'5","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148671+0000","last_change":"2024-04-23T19:00:15.257176+0000","last_active":"2024-04-23T19:02:21.148671+0000","last_peered":"2024-04-23T19:02:21.148671+0000","last_clean":"2024-04-23T19:02:21.148671+0000","last_became_active":"2024-04-23T19:00:15.256794+0000","last_became_peered":"2024-04-23T19:00:15.256794+0000","last_unstale":"2024-04-23T19:02:21.148671+0000","last_undegraded":"2024-04-23T19:02:21.148671+0000","last_fullsized":"2024-04-23T19:02:21.148671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400739+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:02:21.400739+0000","last_peered":"2024-04-23T19:02:21.400739+0000","last_clean":"2024-04-23T19:02:21.400739+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:02:21.400739+0000","last_undegraded":"2024-04-23T19:02:21.400739+0000","last_fullsized":"2024-04-23T19:02:21.400739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"74'6","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401040+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:02:21.401040+0000","last_peered":"2024-04-23T19:02:21.401040+0000","last_clean":"2024-04-23T19:02:21.401040+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:02:21.401040+0000","last_undegraded":"2024-04-23T19:02:21.401040+0000","last_fullsized":"2024-04-23T19:02:21.401040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147638+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:02:21.147638+0000","last_peered":"2024-04-23T19:02:21.147638+0000","last_clean":"2024-04-23T19:02:21.147638+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:02:21.147638+0000","last_undegraded":"2024-04-23T19:02:21.147638+0000","last_fullsized":"2024-04-23T19:02:21.147638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149358+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:02:21.149358+0000","last_peered":"2024-04-23T19:02:21.149358+0000","last_clean":"2024-04-23T19:02:21.149358+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:02:21.149358+0000","last_undegraded":"2024-04-23T19:02:21.149358+0000","last_fullsized":"2024-04-23T19:02:21.149358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400092+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:02:21.400092+0000","last_peered":"2024-04-23T19:02:21.400092+0000","last_clean":"2024-04-23T19:02:21.400092+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:02:21.400092+0000","last_undegraded":"2024-04-23T19:02:21.400092+0000","last_fullsized":"2024-04-23T19:02:21.400092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"74'7","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397961+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:02:21.397961+0000","last_peered":"2024-04-23T19:02:21.397961+0000","last_clean":"2024-04-23T19:02:21.397961+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:02:21.397961+0000","last_undegraded":"2024-04-23T19:02:21.397961+0000","last_fullsized":"2024-04-23T19:02:21.397961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400044+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:02:21.400044+0000","last_peered":"2024-04-23T19:02:21.400044+0000","last_clean":"2024-04-23T19:02:21.400044+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:02:21.400044+0000","last_undegraded":"2024-04-23T19:02:21.400044+0000","last_fullsized":"2024-04-23T19:02:21.400044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"74'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151153+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:02:21.151153+0000","last_peered":"2024-04-23T19:02:21.151153+0000","last_clean":"2024-04-23T19:02:21.151153+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:02:21.151153+0000","last_undegraded":"2024-04-23T19:02:21.151153+0000","last_fullsized":"2024-04-23T19:02:21.151153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":168,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149626+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:02:21.149626+0000","last_peered":"2024-04-23T19:02:21.149626+0000","last_clean":"2024-04-23T19:02:21.149626+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:02:21.149626+0000","last_undegraded":"2024-04-23T19:02:21.149626+0000","last_fullsized":"2024-04-23T19:02:21.149626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'4","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400869+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:02:21.400869+0000","last_peered":"2024-04-23T19:02:21.400869+0000","last_clean":"2024-04-23T19:02:21.400869+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:02:21.400869+0000","last_undegraded":"2024-04-23T19:02:21.400869+0000","last_fullsized":"2024-04-23T19:02:21.400869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152168+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:02:21.152168+0000","last_peered":"2024-04-23T19:02:21.152168+0000","last_clean":"2024-04-23T19:02:21.152168+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:02:21.152168+0000","last_undegraded":"2024-04-23T19:02:21.152168+0000","last_fullsized":"2024-04-23T19:02:21.152168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398531+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:02:21.398531+0000","last_peered":"2024-04-23T19:02:21.398531+0000","last_clean":"2024-04-23T19:02:21.398531+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:02:21.398531+0000","last_undegraded":"2024-04-23T19:02:21.398531+0000","last_fullsized":"2024-04-23T19:02:21.398531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"53'6","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399011+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:02:21.399011+0000","last_peered":"2024-04-23T19:02:21.399011+0000","last_clean":"2024-04-23T19:02:21.399011+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:02:21.399011+0000","last_undegraded":"2024-04-23T19:02:21.399011+0000","last_fullsized":"2024-04-23T19:02:21.399011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146725+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:02:21.146725+0000","last_peered":"2024-04-23T19:02:21.146725+0000","last_clean":"2024-04-23T19:02:21.146725+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:02:21.146725+0000","last_undegraded":"2024-04-23T19:02:21.146725+0000","last_fullsized":"2024-04-23T19:02:21.146725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398643+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:02:21.398643+0000","last_peered":"2024-04-23T19:02:21.398643+0000","last_clean":"2024-04-23T19:02:21.398643+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:02:21.398643+0000","last_undegraded":"2024-04-23T19:02:21.398643+0000","last_fullsized":"2024-04-23T19:02:21.398643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400801+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:02:21.400801+0000","last_peered":"2024-04-23T19:02:21.400801+0000","last_clean":"2024-04-23T19:02:21.400801+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:02:21.400801+0000","last_undegraded":"2024-04-23T19:02:21.400801+0000","last_fullsized":"2024-04-23T19:02:21.400801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399372+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:02:21.399372+0000","last_peered":"2024-04-23T19:02:21.399372+0000","last_clean":"2024-04-23T19:02:21.399372+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:02:21.399372+0000","last_undegraded":"2024-04-23T19:02:21.399372+0000","last_fullsized":"2024-04-23T19:02:21.399372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":171,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151350+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:02:21.151350+0000","last_peered":"2024-04-23T19:02:21.151350+0000","last_clean":"2024-04-23T19:02:21.151350+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:02:21.151350+0000","last_undegraded":"2024-04-23T19:02:21.151350+0000","last_fullsized":"2024-04-23T19:02:21.151350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'12","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399229+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:02:21.399229+0000","last_peered":"2024-04-23T19:02:21.399229+0000","last_clean":"2024-04-23T19:02:21.399229+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:02:21.399229+0000","last_undegraded":"2024-04-23T19:02:21.399229+0000","last_fullsized":"2024-04-23T19:02:21.399229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397642+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:02:21.397642+0000","last_peered":"2024-04-23T19:02:21.397642+0000","last_clean":"2024-04-23T19:02:21.397642+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:02:21.397642+0000","last_undegraded":"2024-04-23T19:02:21.397642+0000","last_fullsized":"2024-04-23T19:02:21.397642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148448+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:02:21.148448+0000","last_peered":"2024-04-23T19:02:21.148448+0000","last_clean":"2024-04-23T19:02:21.148448+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:02:21.148448+0000","last_undegraded":"2024-04-23T19:02:21.148448+0000","last_fullsized":"2024-04-23T19:02:21.148448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397332+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:02:21.397332+0000","last_peered":"2024-04-23T19:02:21.397332+0000","last_clean":"2024-04-23T19:02:21.397332+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:02:21.397332+0000","last_undegraded":"2024-04-23T19:02:21.397332+0000","last_fullsized":"2024-04-23T19:02:21.397332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'5","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399841+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:02:21.399841+0000","last_peered":"2024-04-23T19:02:21.399841+0000","last_clean":"2024-04-23T19:02:21.399841+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:02:21.399841+0000","last_undegraded":"2024-04-23T19:02:21.399841+0000","last_fullsized":"2024-04-23T19:02:21.399841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149774+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:02:21.149774+0000","last_peered":"2024-04-23T19:02:21.149774+0000","last_clean":"2024-04-23T19:02:21.149774+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:02:21.149774+0000","last_undegraded":"2024-04-23T19:02:21.149774+0000","last_fullsized":"2024-04-23T19:02:21.149774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'8","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399446+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:02:21.399446+0000","last_peered":"2024-04-23T19:02:21.399446+0000","last_clean":"2024-04-23T19:02:21.399446+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:02:21.399446+0000","last_undegraded":"2024-04-23T19:02:21.399446+0000","last_fullsized":"2024-04-23T19:02:21.399446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.145874+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:02:21.145874+0000","last_peered":"2024-04-23T19:02:21.145874+0000","last_clean":"2024-04-23T19:02:21.145874+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:02:21.145874+0000","last_undegraded":"2024-04-23T19:02:21.145874+0000","last_fullsized":"2024-04-23T19:02:21.145874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399190+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:02:21.399190+0000","last_peered":"2024-04-23T19:02:21.399190+0000","last_clean":"2024-04-23T19:02:21.399190+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:02:21.399190+0000","last_undegraded":"2024-04-23T19:02:21.399190+0000","last_fullsized":"2024-04-23T19:02:21.399190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'10","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397590+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:02:21.397590+0000","last_peered":"2024-04-23T19:02:21.397590+0000","last_clean":"2024-04-23T19:02:21.397590+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:02:21.397590+0000","last_undegraded":"2024-04-23T19:02:21.397590+0000","last_fullsized":"2024-04-23T19:02:21.397590+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149349+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:02:21.149349+0000","last_peered":"2024-04-23T19:02:21.149349+0000","last_clean":"2024-04-23T19:02:21.149349+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:02:21.149349+0000","last_undegraded":"2024-04-23T19:02:21.149349+0000","last_fullsized":"2024-04-23T19:02:21.149349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'17","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400734+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:02:21.400734+0000","last_peered":"2024-04-23T19:02:21.400734+0000","last_clean":"2024-04-23T19:02:21.400734+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:02:21.400734+0000","last_undegraded":"2024-04-23T19:02:21.400734+0000","last_fullsized":"2024-04-23T19:02:21.400734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398186+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:02:21.398186+0000","last_peered":"2024-04-23T19:02:21.398186+0000","last_clean":"2024-04-23T19:02:21.398186+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:02:21.398186+0000","last_undegraded":"2024-04-23T19:02:21.398186+0000","last_fullsized":"2024-04-23T19:02:21.398186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"75'40","reported_seq":163,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146446+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:02:21.146446+0000","last_peered":"2024-04-23T19:02:21.146446+0000","last_clean":"2024-04-23T19:02:21.146446+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:02:21.146446+0000","last_undegraded":"2024-04-23T19:02:21.146446+0000","last_fullsized":"2024-04-23T19:02:21.146446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150018+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:02:21.150018+0000","last_peered":"2024-04-23T19:02:21.150018+0000","last_clean":"2024-04-23T19:02:21.150018+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:02:21.150018+0000","last_undegraded":"2024-04-23T19:02:21.150018+0000","last_fullsized":"2024-04-23T19:02:21.150018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'13","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400534+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:02:21.400534+0000","last_peered":"2024-04-23T19:02:21.400534+0000","last_clean":"2024-04-23T19:02:21.400534+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:02:21.400534+0000","last_undegraded":"2024-04-23T19:02:21.400534+0000","last_fullsized":"2024-04-23T19:02:21.400534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399033+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:02:21.399033+0000","last_peered":"2024-04-23T19:02:21.399033+0000","last_clean":"2024-04-23T19:02:21.399033+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:02:21.399033+0000","last_undegraded":"2024-04-23T19:02:21.399033+0000","last_fullsized":"2024-04-23T19:02:21.399033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150451+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:02:21.150451+0000","last_peered":"2024-04-23T19:02:21.150451+0000","last_clean":"2024-04-23T19:02:21.150451+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:02:21.150451+0000","last_undegraded":"2024-04-23T19:02:21.150451+0000","last_fullsized":"2024-04-23T19:02:21.150451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149751+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:02:21.149751+0000","last_peered":"2024-04-23T19:02:21.149751+0000","last_clean":"2024-04-23T19:02:21.149751+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:02:21.149751+0000","last_undegraded":"2024-04-23T19:02:21.149751+0000","last_fullsized":"2024-04-23T19:02:21.149751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399192+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:02:21.399192+0000","last_peered":"2024-04-23T19:02:21.399192+0000","last_clean":"2024-04-23T19:02:21.399192+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:02:21.399192+0000","last_undegraded":"2024-04-23T19:02:21.399192+0000","last_fullsized":"2024-04-23T19:02:21.399192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404271+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:02:21.404271+0000","last_peered":"2024-04-23T19:02:21.404271+0000","last_clean":"2024-04-23T19:02:21.404271+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:02:21.404271+0000","last_undegraded":"2024-04-23T19:02:21.404271+0000","last_fullsized":"2024-04-23T19:02:21.404271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'3","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400936+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:02:21.400936+0000","last_peered":"2024-04-23T19:02:21.400936+0000","last_clean":"2024-04-23T19:02:21.400936+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:02:21.400936+0000","last_undegraded":"2024-04-23T19:02:21.400936+0000","last_fullsized":"2024-04-23T19:02:21.400936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402209+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:02:21.402209+0000","last_peered":"2024-04-23T19:02:21.402209+0000","last_clean":"2024-04-23T19:02:21.402209+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:02:21.402209+0000","last_undegraded":"2024-04-23T19:02:21.402209+0000","last_fullsized":"2024-04-23T19:02:21.402209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397116+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:02:21.397116+0000","last_peered":"2024-04-23T19:02:21.397116+0000","last_clean":"2024-04-23T19:02:21.397116+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:02:21.397116+0000","last_undegraded":"2024-04-23T19:02:21.397116+0000","last_fullsized":"2024-04-23T19:02:21.397116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"75'107","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398840+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:02:21.398840+0000","last_peered":"2024-04-23T19:02:21.398840+0000","last_clean":"2024-04-23T19:02:21.398840+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:02:21.398840+0000","last_undegraded":"2024-04-23T19:02:21.398840+0000","last_fullsized":"2024-04-23T19:02:21.398840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":116,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146622+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:02:21.146622+0000","last_peered":"2024-04-23T19:02:21.146622+0000","last_clean":"2024-04-23T19:02:21.146622+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:02:21.146622+0000","last_undegraded":"2024-04-23T19:02:21.146622+0000","last_fullsized":"2024-04-23T19:02:21.146622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401684+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:02:21.401684+0000","last_peered":"2024-04-23T19:02:21.401684+0000","last_clean":"2024-04-23T19:02:21.401684+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:02:21.401684+0000","last_undegraded":"2024-04-23T19:02:21.401684+0000","last_fullsized":"2024-04-23T19:02:21.401684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'5","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397738+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:02:21.397738+0000","last_peered":"2024-04-23T19:02:21.397738+0000","last_clean":"2024-04-23T19:02:21.397738+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:02:21.397738+0000","last_undegraded":"2024-04-23T19:02:21.397738+0000","last_fullsized":"2024-04-23T19:02:21.397738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151956+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:02:21.151956+0000","last_peered":"2024-04-23T19:02:21.151956+0000","last_clean":"2024-04-23T19:02:21.151956+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:02:21.151956+0000","last_undegraded":"2024-04-23T19:02:21.151956+0000","last_fullsized":"2024-04-23T19:02:21.151956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'15","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399089+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:02:21.399089+0000","last_peered":"2024-04-23T19:02:21.399089+0000","last_clean":"2024-04-23T19:02:21.399089+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:02:21.399089+0000","last_undegraded":"2024-04-23T19:02:21.399089+0000","last_fullsized":"2024-04-23T19:02:21.399089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"75'107","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398709+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:02:21.398709+0000","last_peered":"2024-04-23T19:02:21.398709+0000","last_clean":"2024-04-23T19:02:21.398709+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:02:21.398709+0000","last_undegraded":"2024-04-23T19:02:21.398709+0000","last_fullsized":"2024-04-23T19:02:21.398709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148005+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:02:21.148005+0000","last_peered":"2024-04-23T19:02:21.148005+0000","last_clean":"2024-04-23T19:02:21.148005+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:02:21.148005+0000","last_undegraded":"2024-04-23T19:02:21.148005+0000","last_fullsized":"2024-04-23T19:02:21.148005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"74'4","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398775+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:02:21.398775+0000","last_peered":"2024-04-23T19:02:21.398775+0000","last_clean":"2024-04-23T19:02:21.398775+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:02:21.398775+0000","last_undegraded":"2024-04-23T19:02:21.398775+0000","last_fullsized":"2024-04-23T19:02:21.398775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":192,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397794+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:02:21.397794+0000","last_peered":"2024-04-23T19:02:21.397794+0000","last_clean":"2024-04-23T19:02:21.397794+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:02:21.397794+0000","last_undegraded":"2024-04-23T19:02:21.397794+0000","last_fullsized":"2024-04-23T19:02:21.397794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'25","reported_seq":153,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149577+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:02:21.149577+0000","last_peered":"2024-04-23T19:02:21.149577+0000","last_clean":"2024-04-23T19:02:21.149577+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:02:21.149577+0000","last_undegraded":"2024-04-23T19:02:21.149577+0000","last_fullsized":"2024-04-23T19:02:21.149577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147873+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:02:21.147873+0000","last_peered":"2024-04-23T19:02:21.147873+0000","last_clean":"2024-04-23T19:02:21.147873+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:02:21.147873+0000","last_undegraded":"2024-04-23T19:02:21.147873+0000","last_fullsized":"2024-04-23T19:02:21.147873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":117,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148656+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:02:21.148656+0000","last_peered":"2024-04-23T19:02:21.148656+0000","last_clean":"2024-04-23T19:02:21.148656+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:02:21.148656+0000","last_undegraded":"2024-04-23T19:02:21.148656+0000","last_fullsized":"2024-04-23T19:02:21.148656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146927+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:02:21.146927+0000","last_peered":"2024-04-23T19:02:21.146927+0000","last_clean":"2024-04-23T19:02:21.146927+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:02:21.146927+0000","last_undegraded":"2024-04-23T19:02:21.146927+0000","last_fullsized":"2024-04-23T19:02:21.146927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"74'7","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398555+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:02:21.398555+0000","last_peered":"2024-04-23T19:02:21.398555+0000","last_clean":"2024-04-23T19:02:21.398555+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:02:21.398555+0000","last_undegraded":"2024-04-23T19:02:21.398555+0000","last_fullsized":"2024-04-23T19:02:21.398555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396924+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:02:21.396924+0000","last_peered":"2024-04-23T19:02:21.396924+0000","last_clean":"2024-04-23T19:02:21.396924+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:02:21.396924+0000","last_undegraded":"2024-04-23T19:02:21.396924+0000","last_fullsized":"2024-04-23T19:02:21.396924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'15","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400281+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:02:21.400281+0000","last_peered":"2024-04-23T19:02:21.400281+0000","last_clean":"2024-04-23T19:02:21.400281+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:02:21.400281+0000","last_undegraded":"2024-04-23T19:02:21.400281+0000","last_fullsized":"2024-04-23T19:02:21.400281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397078+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:02:21.397078+0000","last_peered":"2024-04-23T19:02:21.397078+0000","last_clean":"2024-04-23T19:02:21.397078+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:02:21.397078+0000","last_undegraded":"2024-04-23T19:02:21.397078+0000","last_fullsized":"2024-04-23T19:02:21.397078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398486+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:02:21.398486+0000","last_peered":"2024-04-23T19:02:21.398486+0000","last_clean":"2024-04-23T19:02:21.398486+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:02:21.398486+0000","last_undegraded":"2024-04-23T19:02:21.398486+0000","last_fullsized":"2024-04-23T19:02:21.398486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398712+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:02:21.398712+0000","last_peered":"2024-04-23T19:02:21.398712+0000","last_clean":"2024-04-23T19:02:21.398712+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:02:21.398712+0000","last_undegraded":"2024-04-23T19:02:21.398712+0000","last_fullsized":"2024-04-23T19:02:21.398712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'5","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399766+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:02:21.399766+0000","last_peered":"2024-04-23T19:02:21.399766+0000","last_clean":"2024-04-23T19:02:21.399766+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:02:21.399766+0000","last_undegraded":"2024-04-23T19:02:21.399766+0000","last_fullsized":"2024-04-23T19:02:21.399766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397811+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:02:21.397811+0000","last_peered":"2024-04-23T19:02:21.397811+0000","last_clean":"2024-04-23T19:02:21.397811+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:02:21.397811+0000","last_undegraded":"2024-04-23T19:02:21.397811+0000","last_fullsized":"2024-04-23T19:02:21.397811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'21","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400547+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:02:21.400547+0000","last_peered":"2024-04-23T19:02:21.400547+0000","last_clean":"2024-04-23T19:02:21.400547+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:02:21.400547+0000","last_undegraded":"2024-04-23T19:02:21.400547+0000","last_fullsized":"2024-04-23T19:02:21.400547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"75'107","reported_seq":244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399349+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:02:21.399349+0000","last_peered":"2024-04-23T19:02:21.399349+0000","last_clean":"2024-04-23T19:02:21.399349+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:02:21.399349+0000","last_undegraded":"2024-04-23T19:02:21.399349+0000","last_fullsized":"2024-04-23T19:02:21.399349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"53'5","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401068+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:02:21.401068+0000","last_peered":"2024-04-23T19:02:21.401068+0000","last_clean":"2024-04-23T19:02:21.401068+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:02:21.401068+0000","last_undegraded":"2024-04-23T19:02:21.401068+0000","last_fullsized":"2024-04-23T19:02:21.401068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"53'4","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400512+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:02:21.400512+0000","last_peered":"2024-04-23T19:02:21.400512+0000","last_clean":"2024-04-23T19:02:21.400512+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:02:21.400512+0000","last_undegraded":"2024-04-23T19:02:21.400512+0000","last_fullsized":"2024-04-23T19:02:21.400512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"74'5","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150067+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:02:21.150067+0000","last_peered":"2024-04-23T19:02:21.150067+0000","last_clean":"2024-04-23T19:02:21.150067+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:02:21.150067+0000","last_undegraded":"2024-04-23T19:02:21.150067+0000","last_fullsized":"2024-04-23T19:02:21.150067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397391+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:02:21.397391+0000","last_peered":"2024-04-23T19:02:21.397391+0000","last_clean":"2024-04-23T19:02:21.397391+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:02:21.397391+0000","last_undegraded":"2024-04-23T19:02:21.397391+0000","last_fullsized":"2024-04-23T19:02:21.397391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'26","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398938+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:02:21.398938+0000","last_peered":"2024-04-23T19:02:21.398938+0000","last_clean":"2024-04-23T19:02:21.398938+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:02:21.398938+0000","last_undegraded":"2024-04-23T19:02:21.398938+0000","last_fullsized":"2024-04-23T19:02:21.398938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396752+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:02:21.396752+0000","last_peered":"2024-04-23T19:02:21.396752+0000","last_clean":"2024-04-23T19:02:21.396752+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:02:21.396752+0000","last_undegraded":"2024-04-23T19:02:21.396752+0000","last_fullsized":"2024-04-23T19:02:21.396752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"69'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148566+0000","last_change":"2024-04-23T19:00:25.352691+0000","last_active":"2024-04-23T19:02:21.148566+0000","last_peered":"2024-04-23T19:02:21.148566+0000","last_clean":"2024-04-23T19:02:21.148566+0000","last_became_active":"2024-04-23T19:00:25.351805+0000","last_became_peered":"2024-04-23T19:00:25.351805+0000","last_unstale":"2024-04-23T19:02:21.148566+0000","last_undegraded":"2024-04-23T19:02:21.148566+0000","last_fullsized":"2024-04-23T19:02:21.148566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:41.939230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148910+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:02:21.148910+0000","last_peered":"2024-04-23T19:02:21.148910+0000","last_clean":"2024-04-23T19:02:21.148910+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:02:21.148910+0000","last_undegraded":"2024-04-23T19:02:21.148910+0000","last_fullsized":"2024-04-23T19:02:21.148910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"75'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399618+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:02:21.399618+0000","last_peered":"2024-04-23T19:02:21.399618+0000","last_clean":"2024-04-23T19:02:21.399618+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:02:21.399618+0000","last_undegraded":"2024-04-23T19:02:21.399618+0000","last_fullsized":"2024-04-23T19:02:21.399618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397012+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:02:21.397012+0000","last_peered":"2024-04-23T19:02:21.397012+0000","last_clean":"2024-04-23T19:02:21.397012+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:02:21.397012+0000","last_undegraded":"2024-04-23T19:02:21.397012+0000","last_fullsized":"2024-04-23T19:02:21.397012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"75'17","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149885+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:02:21.149885+0000","last_peered":"2024-04-23T19:02:21.149885+0000","last_clean":"2024-04-23T19:02:21.149885+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:02:21.149885+0000","last_undegraded":"2024-04-23T19:02:21.149885+0000","last_fullsized":"2024-04-23T19:02:21.149885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401938+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:02:21.401938+0000","last_peered":"2024-04-23T19:02:21.401938+0000","last_clean":"2024-04-23T19:02:21.401938+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:02:21.401938+0000","last_undegraded":"2024-04-23T19:02:21.401938+0000","last_fullsized":"2024-04-23T19:02:21.401938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397799+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:02:21.397799+0000","last_peered":"2024-04-23T19:02:21.397799+0000","last_clean":"2024-04-23T19:02:21.397799+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:02:21.397799+0000","last_undegraded":"2024-04-23T19:02:21.397799+0000","last_fullsized":"2024-04-23T19:02:21.397799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149958+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:02:21.149958+0000","last_peered":"2024-04-23T19:02:21.149958+0000","last_clean":"2024-04-23T19:02:21.149958+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:02:21.149958+0000","last_undegraded":"2024-04-23T19:02:21.149958+0000","last_fullsized":"2024-04-23T19:02:21.149958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"75'11","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398855+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:02:21.398855+0000","last_peered":"2024-04-23T19:02:21.398855+0000","last_clean":"2024-04-23T19:02:21.398855+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:02:21.398855+0000","last_undegraded":"2024-04-23T19:02:21.398855+0000","last_fullsized":"2024-04-23T19:02:21.398855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147504+0000","last_change":"2024-04-23T19:00:19.306483+0000","last_active":"2024-04-23T19:02:21.147504+0000","last_peered":"2024-04-23T19:02:21.147504+0000","last_clean":"2024-04-23T19:02:21.147504+0000","last_became_active":"2024-04-23T19:00:19.305544+0000","last_became_peered":"2024-04-23T19:00:19.305544+0000","last_unstale":"2024-04-23T19:02:21.147504+0000","last_undegraded":"2024-04-23T19:02:21.147504+0000","last_fullsized":"2024-04-23T19:02:21.147504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:57.250293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'23","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398818+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:02:21.398818+0000","last_peered":"2024-04-23T19:02:21.398818+0000","last_clean":"2024-04-23T19:02:21.398818+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:02:21.398818+0000","last_undegraded":"2024-04-23T19:02:21.398818+0000","last_fullsized":"2024-04-23T19:02:21.398818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"75'107","reported_seq":255,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398318+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:02:21.398318+0000","last_peered":"2024-04-23T19:02:21.398318+0000","last_clean":"2024-04-23T19:02:21.398318+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:02:21.398318+0000","last_undegraded":"2024-04-23T19:02:21.398318+0000","last_fullsized":"2024-04-23T19:02:21.398318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147659+0000","last_change":"2024-04-23T19:00:25.341628+0000","last_active":"2024-04-23T19:02:21.147659+0000","last_peered":"2024-04-23T19:02:21.147659+0000","last_clean":"2024-04-23T19:02:21.147659+0000","last_became_active":"2024-04-23T19:00:25.341011+0000","last_became_peered":"2024-04-23T19:00:25.341011+0000","last_unstale":"2024-04-23T19:02:21.147659+0000","last_undegraded":"2024-04-23T19:02:21.147659+0000","last_fullsized":"2024-04-23T19:02:21.147659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:34.837079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":145,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150443+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:02:21.150443+0000","last_peered":"2024-04-23T19:02:21.150443+0000","last_clean":"2024-04-23T19:02:21.150443+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:02:21.150443+0000","last_undegraded":"2024-04-23T19:02:21.150443+0000","last_fullsized":"2024-04-23T19:02:21.150443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147781+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:02:21.147781+0000","last_peered":"2024-04-23T19:02:21.147781+0000","last_clean":"2024-04-23T19:02:21.147781+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:02:21.147781+0000","last_undegraded":"2024-04-23T19:02:21.147781+0000","last_fullsized":"2024-04-23T19:02:21.147781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":264,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152139+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:02:21.152139+0000","last_peered":"2024-04-23T19:02:21.152139+0000","last_clean":"2024-04-23T19:02:21.152139+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:02:21.152139+0000","last_undegraded":"2024-04-23T19:02:21.152139+0000","last_fullsized":"2024-04-23T19:02:21.152139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"52'11","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398817+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:02:21.398817+0000","last_peered":"2024-04-23T19:02:21.398817+0000","last_clean":"2024-04-23T19:02:21.398817+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:02:21.398817+0000","last_undegraded":"2024-04-23T19:02:21.398817+0000","last_fullsized":"2024-04-23T19:02:21.398817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"75'107","reported_seq":282,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398708+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:02:21.398708+0000","last_peered":"2024-04-23T19:02:21.398708+0000","last_clean":"2024-04-23T19:02:21.398708+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:02:21.398708+0000","last_undegraded":"2024-04-23T19:02:21.398708+0000","last_fullsized":"2024-04-23T19:02:21.398708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147370+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:02:21.147370+0000","last_peered":"2024-04-23T19:02:21.147370+0000","last_clean":"2024-04-23T19:02:21.147370+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:02:21.147370+0000","last_undegraded":"2024-04-23T19:02:21.147370+0000","last_fullsized":"2024-04-23T19:02:21.147370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149563+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:02:21.149563+0000","last_peered":"2024-04-23T19:02:21.149563+0000","last_clean":"2024-04-23T19:02:21.149563+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:02:21.149563+0000","last_undegraded":"2024-04-23T19:02:21.149563+0000","last_fullsized":"2024-04-23T19:02:21.149563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"75'11","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398731+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:02:21.398731+0000","last_peered":"2024-04-23T19:02:21.398731+0000","last_clean":"2024-04-23T19:02:21.398731+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:02:21.398731+0000","last_undegraded":"2024-04-23T19:02:21.398731+0000","last_fullsized":"2024-04-23T19:02:21.398731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150176+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:02:21.150176+0000","last_peered":"2024-04-23T19:02:21.150176+0000","last_clean":"2024-04-23T19:02:21.150176+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:02:21.150176+0000","last_undegraded":"2024-04-23T19:02:21.150176+0000","last_fullsized":"2024-04-23T19:02:21.150176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149238+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:02:21.149238+0000","last_peered":"2024-04-23T19:02:21.149238+0000","last_clean":"2024-04-23T19:02:21.149238+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:02:21.149238+0000","last_undegraded":"2024-04-23T19:02:21.149238+0000","last_fullsized":"2024-04-23T19:02:21.149238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399935+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:02:21.399935+0000","last_peered":"2024-04-23T19:02:21.399935+0000","last_clean":"2024-04-23T19:02:21.399935+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:02:21.399935+0000","last_undegraded":"2024-04-23T19:02:21.399935+0000","last_fullsized":"2024-04-23T19:02:21.399935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147729+0000","last_change":"2024-04-23T19:00:25.337128+0000","last_active":"2024-04-23T19:02:21.147729+0000","last_peered":"2024-04-23T19:02:21.147729+0000","last_clean":"2024-04-23T19:02:21.147729+0000","last_became_active":"2024-04-23T19:00:25.336132+0000","last_became_peered":"2024-04-23T19:00:25.336132+0000","last_unstale":"2024-04-23T19:02:21.147729+0000","last_undegraded":"2024-04-23T19:02:21.147729+0000","last_fullsized":"2024-04-23T19:02:21.147729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:40.547819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399060+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:02:21.399060+0000","last_peered":"2024-04-23T19:02:21.399060+0000","last_clean":"2024-04-23T19:02:21.399060+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:02:21.399060+0000","last_undegraded":"2024-04-23T19:02:21.399060+0000","last_fullsized":"2024-04-23T19:02:21.399060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400615+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:02:21.400615+0000","last_peered":"2024-04-23T19:02:21.400615+0000","last_clean":"2024-04-23T19:02:21.400615+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:02:21.400615+0000","last_undegraded":"2024-04-23T19:02:21.400615+0000","last_fullsized":"2024-04-23T19:02:21.400615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148852+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:02:21.148852+0000","last_peered":"2024-04-23T19:02:21.148852+0000","last_clean":"2024-04-23T19:02:21.148852+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:02:21.148852+0000","last_undegraded":"2024-04-23T19:02:21.148852+0000","last_fullsized":"2024-04-23T19:02:21.148852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"74'11","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397428+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:02:21.397428+0000","last_peered":"2024-04-23T19:02:21.397428+0000","last_clean":"2024-04-23T19:02:21.397428+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:02:21.397428+0000","last_undegraded":"2024-04-23T19:02:21.397428+0000","last_fullsized":"2024-04-23T19:02:21.397428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398461+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:02:21.398461+0000","last_peered":"2024-04-23T19:02:21.398461+0000","last_clean":"2024-04-23T19:02:21.398461+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:02:21.398461+0000","last_undegraded":"2024-04-23T19:02:21.398461+0000","last_fullsized":"2024-04-23T19:02:21.398461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'31","reported_seq":161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152433+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:02:21.152433+0000","last_peered":"2024-04-23T19:02:21.152433+0000","last_clean":"2024-04-23T19:02:21.152433+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:02:21.152433+0000","last_undegraded":"2024-04-23T19:02:21.152433+0000","last_fullsized":"2024-04-23T19:02:21.152433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401206+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:02:21.401206+0000","last_peered":"2024-04-23T19:02:21.401206+0000","last_clean":"2024-04-23T19:02:21.401206+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:02:21.401206+0000","last_undegraded":"2024-04-23T19:02:21.401206+0000","last_fullsized":"2024-04-23T19:02:21.401206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397980+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:02:21.397980+0000","last_peered":"2024-04-23T19:02:21.397980+0000","last_clean":"2024-04-23T19:02:21.397980+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:02:21.397980+0000","last_undegraded":"2024-04-23T19:02:21.397980+0000","last_fullsized":"2024-04-23T19:02:21.397980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404123+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:02:21.404123+0000","last_peered":"2024-04-23T19:02:21.404123+0000","last_clean":"2024-04-23T19:02:21.404123+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:02:21.404123+0000","last_undegraded":"2024-04-23T19:02:21.404123+0000","last_fullsized":"2024-04-23T19:02:21.404123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400484+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:02:21.400484+0000","last_peered":"2024-04-23T19:02:21.400484+0000","last_clean":"2024-04-23T19:02:21.400484+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:02:21.400484+0000","last_undegraded":"2024-04-23T19:02:21.400484+0000","last_fullsized":"2024-04-23T19:02:21.400484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'13","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400002+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:02:21.400002+0000","last_peered":"2024-04-23T19:02:21.400002+0000","last_clean":"2024-04-23T19:02:21.400002+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:02:21.400002+0000","last_undegraded":"2024-04-23T19:02:21.400002+0000","last_fullsized":"2024-04-23T19:02:21.400002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152590+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:02:21.152590+0000","last_peered":"2024-04-23T19:02:21.152590+0000","last_clean":"2024-04-23T19:02:21.152590+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:02:21.152590+0000","last_undegraded":"2024-04-23T19:02:21.152590+0000","last_fullsized":"2024-04-23T19:02:21.152590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'111","reported_seq":304,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147864+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:02:21.147864+0000","last_peered":"2024-04-23T19:02:21.147864+0000","last_clean":"2024-04-23T19:02:21.147864+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:02:21.147864+0000","last_undegraded":"2024-04-23T19:02:21.147864+0000","last_fullsized":"2024-04-23T19:02:21.147864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":147,"num_read_kb":132,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398968+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:02:21.398968+0000","last_peered":"2024-04-23T19:02:21.398968+0000","last_clean":"2024-04-23T19:02:21.398968+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:02:21.398968+0000","last_undegraded":"2024-04-23T19:02:21.398968+0000","last_fullsized":"2024-04-23T19:02:21.398968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147322+0000","last_change":"2024-04-23T19:00:25.337116+0000","last_active":"2024-04-23T19:02:21.147322+0000","last_peered":"2024-04-23T19:02:21.147322+0000","last_clean":"2024-04-23T19:02:21.147322+0000","last_became_active":"2024-04-23T19:00:25.336196+0000","last_became_peered":"2024-04-23T19:00:25.336196+0000","last_unstale":"2024-04-23T19:02:21.147322+0000","last_undegraded":"2024-04-23T19:02:21.147322+0000","last_fullsized":"2024-04-23T19:02:21.147322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:14.525312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149672+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:02:21.149672+0000","last_peered":"2024-04-23T19:02:21.149672+0000","last_clean":"2024-04-23T19:02:21.149672+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:02:21.149672+0000","last_undegraded":"2024-04-23T19:02:21.149672+0000","last_fullsized":"2024-04-23T19:02:21.149672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397136+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:02:21.397136+0000","last_peered":"2024-04-23T19:02:21.397136+0000","last_clean":"2024-04-23T19:02:21.397136+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:02:21.397136+0000","last_undegraded":"2024-04-23T19:02:21.397136+0000","last_fullsized":"2024-04-23T19:02:21.397136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147506+0000","last_change":"2024-04-23T19:00:15.254230+0000","last_active":"2024-04-23T19:02:21.147506+0000","last_peered":"2024-04-23T19:02:21.147506+0000","last_clean":"2024-04-23T19:02:21.147506+0000","last_became_active":"2024-04-23T19:00:15.253857+0000","last_became_peered":"2024-04-23T19:00:15.253857+0000","last_unstale":"2024-04-23T19:02:21.147506+0000","last_undegraded":"2024-04-23T19:02:21.147506+0000","last_fullsized":"2024-04-23T19:02:21.147506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398435+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:02:21.398435+0000","last_peered":"2024-04-23T19:02:21.398435+0000","last_clean":"2024-04-23T19:02:21.398435+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:02:21.398435+0000","last_undegraded":"2024-04-23T19:02:21.398435+0000","last_fullsized":"2024-04-23T19:02:21.398435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'16","reported_seq":162,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399338+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:02:21.399338+0000","last_peered":"2024-04-23T19:02:21.399338+0000","last_clean":"2024-04-23T19:02:21.399338+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:02:21.399338+0000","last_undegraded":"2024-04-23T19:02:21.399338+0000","last_fullsized":"2024-04-23T19:02:21.399338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399587+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:02:21.399587+0000","last_peered":"2024-04-23T19:02:21.399587+0000","last_clean":"2024-04-23T19:02:21.399587+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:02:21.399587+0000","last_undegraded":"2024-04-23T19:02:21.399587+0000","last_fullsized":"2024-04-23T19:02:21.399587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400024+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:02:21.400024+0000","last_peered":"2024-04-23T19:02:21.400024+0000","last_clean":"2024-04-23T19:02:21.400024+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:02:21.400024+0000","last_undegraded":"2024-04-23T19:02:21.400024+0000","last_fullsized":"2024-04-23T19:02:21.400024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147912+0000","last_change":"2024-04-23T19:00:17.298132+0000","last_active":"2024-04-23T19:02:21.147912+0000","last_peered":"2024-04-23T19:02:21.147912+0000","last_clean":"2024-04-23T19:02:21.147912+0000","last_became_active":"2024-04-23T19:00:17.297866+0000","last_became_peered":"2024-04-23T19:00:17.297866+0000","last_unstale":"2024-04-23T19:02:21.147912+0000","last_undegraded":"2024-04-23T19:02:21.147912+0000","last_fullsized":"2024-04-23T19:02:21.147912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151713+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:02:21.151713+0000","last_peered":"2024-04-23T19:02:21.151713+0000","last_clean":"2024-04-23T19:02:21.151713+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:02:21.151713+0000","last_undegraded":"2024-04-23T19:02:21.151713+0000","last_fullsized":"2024-04-23T19:02:21.151713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147879+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:02:21.147879+0000","last_peered":"2024-04-23T19:02:21.147879+0000","last_clean":"2024-04-23T19:02:21.147879+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:02:21.147879+0000","last_undegraded":"2024-04-23T19:02:21.147879+0000","last_fullsized":"2024-04-23T19:02:21.147879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":190,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400770+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:02:21.400770+0000","last_peered":"2024-04-23T19:02:21.400770+0000","last_clean":"2024-04-23T19:02:21.400770+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:02:21.400770+0000","last_undegraded":"2024-04-23T19:02:21.400770+0000","last_fullsized":"2024-04-23T19:02:21.400770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397495+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:02:21.397495+0000","last_peered":"2024-04-23T19:02:21.397495+0000","last_clean":"2024-04-23T19:02:21.397495+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:02:21.397495+0000","last_undegraded":"2024-04-23T19:02:21.397495+0000","last_fullsized":"2024-04-23T19:02:21.397495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399328+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:02:21.399328+0000","last_peered":"2024-04-23T19:02:21.399328+0000","last_clean":"2024-04-23T19:02:21.399328+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:02:21.399328+0000","last_undegraded":"2024-04-23T19:02:21.399328+0000","last_fullsized":"2024-04-23T19:02:21.399328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"57'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146448+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:02:21.146448+0000","last_peered":"2024-04-23T19:02:21.146448+0000","last_clean":"2024-04-23T19:02:21.146448+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:02:21.146448+0000","last_undegraded":"2024-04-23T19:02:21.146448+0000","last_fullsized":"2024-04-23T19:02:21.146448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147816+0000","last_change":"2024-04-23T19:00:17.323700+0000","last_active":"2024-04-23T19:02:21.147816+0000","last_peered":"2024-04-23T19:02:21.147816+0000","last_clean":"2024-04-23T19:02:21.147816+0000","last_became_active":"2024-04-23T19:00:17.323443+0000","last_became_peered":"2024-04-23T19:00:17.323443+0000","last_unstale":"2024-04-23T19:02:21.147816+0000","last_undegraded":"2024-04-23T19:02:21.147816+0000","last_fullsized":"2024-04-23T19:02:21.147816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'9","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150396+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:02:21.150396+0000","last_peered":"2024-04-23T19:02:21.150396+0000","last_clean":"2024-04-23T19:02:21.150396+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:02:21.150396+0000","last_undegraded":"2024-04-23T19:02:21.150396+0000","last_fullsized":"2024-04-23T19:02:21.150396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148123+0000","last_change":"2024-04-23T19:00:09.584530+0000","last_active":"2024-04-23T19:02:21.148123+0000","last_peered":"2024-04-23T19:02:21.148123+0000","last_clean":"2024-04-23T19:02:21.148123+0000","last_became_active":"2024-04-23T19:00:09.584179+0000","last_became_peered":"2024-04-23T19:00:09.584179+0000","last_unstale":"2024-04-23T19:02:21.148123+0000","last_undegraded":"2024-04-23T19:02:21.148123+0000","last_fullsized":"2024-04-23T19:02:21.148123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400158+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:02:21.400158+0000","last_peered":"2024-04-23T19:02:21.400158+0000","last_clean":"2024-04-23T19:02:21.400158+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:02:21.400158+0000","last_undegraded":"2024-04-23T19:02:21.400158+0000","last_fullsized":"2024-04-23T19:02:21.400158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'30","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400612+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:02:21.400612+0000","last_peered":"2024-04-23T19:02:21.400612+0000","last_clean":"2024-04-23T19:02:21.400612+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:02:21.400612+0000","last_undegraded":"2024-04-23T19:02:21.400612+0000","last_fullsized":"2024-04-23T19:02:21.400612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146055+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:02:21.146055+0000","last_peered":"2024-04-23T19:02:21.146055+0000","last_clean":"2024-04-23T19:02:21.146055+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:02:21.146055+0000","last_undegraded":"2024-04-23T19:02:21.146055+0000","last_fullsized":"2024-04-23T19:02:21.146055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400831+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:02:21.400831+0000","last_peered":"2024-04-23T19:02:21.400831+0000","last_clean":"2024-04-23T19:02:21.400831+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:02:21.400831+0000","last_undegraded":"2024-04-23T19:02:21.400831+0000","last_fullsized":"2024-04-23T19:02:21.400831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400436+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:02:21.400436+0000","last_peered":"2024-04-23T19:02:21.400436+0000","last_clean":"2024-04-23T19:02:21.400436+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:02:21.400436+0000","last_undegraded":"2024-04-23T19:02:21.400436+0000","last_fullsized":"2024-04-23T19:02:21.400436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148049+0000","last_change":"2024-04-23T19:00:15.252825+0000","last_active":"2024-04-23T19:02:21.148049+0000","last_peered":"2024-04-23T19:02:21.148049+0000","last_clean":"2024-04-23T19:02:21.148049+0000","last_became_active":"2024-04-23T19:00:15.247413+0000","last_became_peered":"2024-04-23T19:00:15.247413+0000","last_unstale":"2024-04-23T19:02:21.148049+0000","last_undegraded":"2024-04-23T19:02:21.148049+0000","last_fullsized":"2024-04-23T19:02:21.148049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399914+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:02:21.399914+0000","last_peered":"2024-04-23T19:02:21.399914+0000","last_clean":"2024-04-23T19:02:21.399914+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:02:21.399914+0000","last_undegraded":"2024-04-23T19:02:21.399914+0000","last_fullsized":"2024-04-23T19:02:21.399914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398555+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:02:21.398555+0000","last_peered":"2024-04-23T19:02:21.398555+0000","last_clean":"2024-04-23T19:02:21.398555+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:02:21.398555+0000","last_undegraded":"2024-04-23T19:02:21.398555+0000","last_fullsized":"2024-04-23T19:02:21.398555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147256+0000","last_change":"2024-04-23T19:00:21.313162+0000","last_active":"2024-04-23T19:02:21.147256+0000","last_peered":"2024-04-23T19:02:21.147256+0000","last_clean":"2024-04-23T19:02:21.147256+0000","last_became_active":"2024-04-23T19:00:21.312313+0000","last_became_peered":"2024-04-23T19:00:21.312313+0000","last_unstale":"2024-04-23T19:02:21.147256+0000","last_undegraded":"2024-04-23T19:02:21.147256+0000","last_fullsized":"2024-04-23T19:02:21.147256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:05.309099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"75'107","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147697+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:02:21.147697+0000","last_peered":"2024-04-23T19:02:21.147697+0000","last_clean":"2024-04-23T19:02:21.147697+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:02:21.147697+0000","last_undegraded":"2024-04-23T19:02:21.147697+0000","last_fullsized":"2024-04-23T19:02:21.147697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401878+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:02:21.401878+0000","last_peered":"2024-04-23T19:02:21.401878+0000","last_clean":"2024-04-23T19:02:21.401878+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:02:21.401878+0000","last_undegraded":"2024-04-23T19:02:21.401878+0000","last_fullsized":"2024-04-23T19:02:21.401878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398269+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:02:21.398269+0000","last_peered":"2024-04-23T19:02:21.398269+0000","last_clean":"2024-04-23T19:02:21.398269+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:02:21.398269+0000","last_undegraded":"2024-04-23T19:02:21.398269+0000","last_fullsized":"2024-04-23T19:02:21.398269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"74'4","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401526+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:02:21.401526+0000","last_peered":"2024-04-23T19:02:21.401526+0000","last_clean":"2024-04-23T19:02:21.401526+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:02:21.401526+0000","last_undegraded":"2024-04-23T19:02:21.401526+0000","last_fullsized":"2024-04-23T19:02:21.401526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148678+0000","last_change":"2024-04-23T19:00:09.201611+0000","last_active":"2024-04-23T19:02:21.148678+0000","last_peered":"2024-04-23T19:02:21.148678+0000","last_clean":"2024-04-23T19:02:21.148678+0000","last_became_active":"2024-04-23T19:00:09.201271+0000","last_became_peered":"2024-04-23T19:00:09.201271+0000","last_unstale":"2024-04-23T19:02:21.148678+0000","last_undegraded":"2024-04-23T19:02:21.148678+0000","last_fullsized":"2024-04-23T19:02:21.148678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146648+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:02:21.146648+0000","last_peered":"2024-04-23T19:02:21.146648+0000","last_clean":"2024-04-23T19:02:21.146648+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:02:21.146648+0000","last_undegraded":"2024-04-23T19:02:21.146648+0000","last_fullsized":"2024-04-23T19:02:21.146648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147914+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:02:21.147914+0000","last_peered":"2024-04-23T19:02:21.147914+0000","last_clean":"2024-04-23T19:02:21.147914+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:02:21.147914+0000","last_undegraded":"2024-04-23T19:02:21.147914+0000","last_fullsized":"2024-04-23T19:02:21.147914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"75'107","reported_seq":321,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400664+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:02:21.400664+0000","last_peered":"2024-04-23T19:02:21.400664+0000","last_clean":"2024-04-23T19:02:21.400664+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:02:21.400664+0000","last_undegraded":"2024-04-23T19:02:21.400664+0000","last_fullsized":"2024-04-23T19:02:21.400664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399816+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:02:21.399816+0000","last_peered":"2024-04-23T19:02:21.399816+0000","last_clean":"2024-04-23T19:02:21.399816+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:02:21.399816+0000","last_undegraded":"2024-04-23T19:02:21.399816+0000","last_fullsized":"2024-04-23T19:02:21.399816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147280+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:02:21.147280+0000","last_peered":"2024-04-23T19:02:21.147280+0000","last_clean":"2024-04-23T19:02:21.147280+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:02:21.147280+0000","last_undegraded":"2024-04-23T19:02:21.147280+0000","last_fullsized":"2024-04-23T19:02:21.147280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'6","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404318+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:02:21.404318+0000","last_peered":"2024-04-23T19:02:21.404318+0000","last_clean":"2024-04-23T19:02:21.404318+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:02:21.404318+0000","last_undegraded":"2024-04-23T19:02:21.404318+0000","last_fullsized":"2024-04-23T19:02:21.404318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399682+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:02:21.399682+0000","last_peered":"2024-04-23T19:02:21.399682+0000","last_clean":"2024-04-23T19:02:21.399682+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:02:21.399682+0000","last_undegraded":"2024-04-23T19:02:21.399682+0000","last_fullsized":"2024-04-23T19:02:21.399682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398153+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:02:21.398153+0000","last_peered":"2024-04-23T19:02:21.398153+0000","last_clean":"2024-04-23T19:02:21.398153+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:02:21.398153+0000","last_undegraded":"2024-04-23T19:02:21.398153+0000","last_fullsized":"2024-04-23T19:02:21.398153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'37","reported_seq":170,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397480+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:02:21.397480+0000","last_peered":"2024-04-23T19:02:21.397480+0000","last_clean":"2024-04-23T19:02:21.397480+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:02:21.397480+0000","last_undegraded":"2024-04-23T19:02:21.397480+0000","last_fullsized":"2024-04-23T19:02:21.397480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397168+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:02:21.397168+0000","last_peered":"2024-04-23T19:02:21.397168+0000","last_clean":"2024-04-23T19:02:21.397168+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:02:21.397168+0000","last_undegraded":"2024-04-23T19:02:21.397168+0000","last_fullsized":"2024-04-23T19:02:21.397168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149138+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:02:21.149138+0000","last_peered":"2024-04-23T19:02:21.149138+0000","last_clean":"2024-04-23T19:02:21.149138+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:02:21.149138+0000","last_undegraded":"2024-04-23T19:02:21.149138+0000","last_fullsized":"2024-04-23T19:02:21.149138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401784+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:02:21.401784+0000","last_peered":"2024-04-23T19:02:21.401784+0000","last_clean":"2024-04-23T19:02:21.401784+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:02:21.401784+0000","last_undegraded":"2024-04-23T19:02:21.401784+0000","last_fullsized":"2024-04-23T19:02:21.401784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146951+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:02:21.146951+0000","last_peered":"2024-04-23T19:02:21.146951+0000","last_clean":"2024-04-23T19:02:21.146951+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:02:21.146951+0000","last_undegraded":"2024-04-23T19:02:21.146951+0000","last_fullsized":"2024-04-23T19:02:21.146951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"74'7","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148383+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:02:21.148383+0000","last_peered":"2024-04-23T19:02:21.148383+0000","last_clean":"2024-04-23T19:02:21.148383+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:02:21.148383+0000","last_undegraded":"2024-04-23T19:02:21.148383+0000","last_fullsized":"2024-04-23T19:02:21.148383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147903+0000","last_change":"2024-04-23T19:00:19.302914+0000","last_active":"2024-04-23T19:02:21.147903+0000","last_peered":"2024-04-23T19:02:21.147903+0000","last_clean":"2024-04-23T19:02:21.147903+0000","last_became_active":"2024-04-23T19:00:19.302271+0000","last_became_peered":"2024-04-23T19:00:19.302271+0000","last_unstale":"2024-04-23T19:02:21.147903+0000","last_undegraded":"2024-04-23T19:02:21.147903+0000","last_fullsized":"2024-04-23T19:02:21.147903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:39.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'17","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397588+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:02:21.397588+0000","last_peered":"2024-04-23T19:02:21.397588+0000","last_clean":"2024-04-23T19:02:21.397588+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:02:21.397588+0000","last_undegraded":"2024-04-23T19:02:21.397588+0000","last_fullsized":"2024-04-23T19:02:21.397588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397983+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:02:21.397983+0000","last_peered":"2024-04-23T19:02:21.397983+0000","last_clean":"2024-04-23T19:02:21.397983+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:02:21.397983+0000","last_undegraded":"2024-04-23T19:02:21.397983+0000","last_fullsized":"2024-04-23T19:02:21.397983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401360+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:02:21.401360+0000","last_peered":"2024-04-23T19:02:21.401360+0000","last_clean":"2024-04-23T19:02:21.401360+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:02:21.401360+0000","last_undegraded":"2024-04-23T19:02:21.401360+0000","last_fullsized":"2024-04-23T19:02:21.401360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147649+0000","last_change":"2024-04-23T19:00:17.321501+0000","last_active":"2024-04-23T19:02:21.147649+0000","last_peered":"2024-04-23T19:02:21.147649+0000","last_clean":"2024-04-23T19:02:21.147649+0000","last_became_active":"2024-04-23T19:00:17.321203+0000","last_became_peered":"2024-04-23T19:00:17.321203+0000","last_unstale":"2024-04-23T19:02:21.147649+0000","last_undegraded":"2024-04-23T19:02:21.147649+0000","last_fullsized":"2024-04-23T19:02:21.147649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'15","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399634+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:02:21.399634+0000","last_peered":"2024-04-23T19:02:21.399634+0000","last_clean":"2024-04-23T19:02:21.399634+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:02:21.399634+0000","last_undegraded":"2024-04-23T19:02:21.399634+0000","last_fullsized":"2024-04-23T19:02:21.399634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399937+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:02:21.399937+0000","last_peered":"2024-04-23T19:02:21.399937+0000","last_clean":"2024-04-23T19:02:21.399937+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:02:21.399937+0000","last_undegraded":"2024-04-23T19:02:21.399937+0000","last_fullsized":"2024-04-23T19:02:21.399937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"68'7","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401255+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:02:21.401255+0000","last_peered":"2024-04-23T19:02:21.401255+0000","last_clean":"2024-04-23T19:02:21.401255+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:02:21.401255+0000","last_undegraded":"2024-04-23T19:02:21.401255+0000","last_fullsized":"2024-04-23T19:02:21.401255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398041+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:02:21.398041+0000","last_peered":"2024-04-23T19:02:21.398041+0000","last_clean":"2024-04-23T19:02:21.398041+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:02:21.398041+0000","last_undegraded":"2024-04-23T19:02:21.398041+0000","last_fullsized":"2024-04-23T19:02:21.398041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398902+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:02:21.398902+0000","last_peered":"2024-04-23T19:02:21.398902+0000","last_clean":"2024-04-23T19:02:21.398902+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:02:21.398902+0000","last_undegraded":"2024-04-23T19:02:21.398902+0000","last_fullsized":"2024-04-23T19:02:21.398902+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"53'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397902+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:02:21.397902+0000","last_peered":"2024-04-23T19:02:21.397902+0000","last_clean":"2024-04-23T19:02:21.397902+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:02:21.397902+0000","last_undegraded":"2024-04-23T19:02:21.397902+0000","last_fullsized":"2024-04-23T19:02:21.397902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"75'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152334+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:02:21.152334+0000","last_peered":"2024-04-23T19:02:21.152334+0000","last_clean":"2024-04-23T19:02:21.152334+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:02:21.152334+0000","last_undegraded":"2024-04-23T19:02:21.152334+0000","last_fullsized":"2024-04-23T19:02:21.152334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397474+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:02:21.397474+0000","last_peered":"2024-04-23T19:02:21.397474+0000","last_clean":"2024-04-23T19:02:21.397474+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:02:21.397474+0000","last_undegraded":"2024-04-23T19:02:21.397474+0000","last_fullsized":"2024-04-23T19:02:21.397474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'19","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399740+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:02:21.399740+0000","last_peered":"2024-04-23T19:02:21.399740+0000","last_clean":"2024-04-23T19:02:21.399740+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:02:21.399740+0000","last_undegraded":"2024-04-23T19:02:21.399740+0000","last_fullsized":"2024-04-23T19:02:21.399740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398440+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:02:21.398440+0000","last_peered":"2024-04-23T19:02:21.398440+0000","last_clean":"2024-04-23T19:02:21.398440+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:02:21.398440+0000","last_undegraded":"2024-04-23T19:02:21.398440+0000","last_fullsized":"2024-04-23T19:02:21.398440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148355+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:02:21.148355+0000","last_peered":"2024-04-23T19:02:21.148355+0000","last_clean":"2024-04-23T19:02:21.148355+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:02:21.148355+0000","last_undegraded":"2024-04-23T19:02:21.148355+0000","last_fullsized":"2024-04-23T19:02:21.148355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398428+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:02:21.398428+0000","last_peered":"2024-04-23T19:02:21.398428+0000","last_clean":"2024-04-23T19:02:21.398428+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:02:21.398428+0000","last_undegraded":"2024-04-23T19:02:21.398428+0000","last_fullsized":"2024-04-23T19:02:21.398428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"75'5","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402140+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:02:21.402140+0000","last_peered":"2024-04-23T19:02:21.402140+0000","last_clean":"2024-04-23T19:02:21.402140+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:02:21.402140+0000","last_undegraded":"2024-04-23T19:02:21.402140+0000","last_fullsized":"2024-04-23T19:02:21.402140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399401+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:02:21.399401+0000","last_peered":"2024-04-23T19:02:21.399401+0000","last_clean":"2024-04-23T19:02:21.399401+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:02:21.399401+0000","last_undegraded":"2024-04-23T19:02:21.399401+0000","last_fullsized":"2024-04-23T19:02:21.399401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'15","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397326+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:02:21.397326+0000","last_peered":"2024-04-23T19:02:21.397326+0000","last_clean":"2024-04-23T19:02:21.397326+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:02:21.397326+0000","last_undegraded":"2024-04-23T19:02:21.397326+0000","last_fullsized":"2024-04-23T19:02:21.397326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399989+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:02:21.399989+0000","last_peered":"2024-04-23T19:02:21.399989+0000","last_clean":"2024-04-23T19:02:21.399989+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:02:21.399989+0000","last_undegraded":"2024-04-23T19:02:21.399989+0000","last_fullsized":"2024-04-23T19:02:21.399989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399608+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:02:21.399608+0000","last_peered":"2024-04-23T19:02:21.399608+0000","last_clean":"2024-04-23T19:02:21.399608+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:02:21.399608+0000","last_undegraded":"2024-04-23T19:02:21.399608+0000","last_fullsized":"2024-04-23T19:02:21.399608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'9","reported_seq":161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398632+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:02:21.398632+0000","last_peered":"2024-04-23T19:02:21.398632+0000","last_clean":"2024-04-23T19:02:21.398632+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:02:21.398632+0000","last_undegraded":"2024-04-23T19:02:21.398632+0000","last_fullsized":"2024-04-23T19:02:21.398632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404028+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:02:21.404028+0000","last_peered":"2024-04-23T19:02:21.404028+0000","last_clean":"2024-04-23T19:02:21.404028+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:02:21.404028+0000","last_undegraded":"2024-04-23T19:02:21.404028+0000","last_fullsized":"2024-04-23T19:02:21.404028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'25","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147784+0000","last_change":"2024-04-23T19:00:21.317917+0000","last_active":"2024-04-23T19:02:21.147784+0000","last_peered":"2024-04-23T19:02:21.147784+0000","last_clean":"2024-04-23T19:02:21.147784+0000","last_became_active":"2024-04-23T19:00:21.317050+0000","last_became_peered":"2024-04-23T19:00:21.317050+0000","last_unstale":"2024-04-23T19:02:21.147784+0000","last_undegraded":"2024-04-23T19:02:21.147784+0000","last_fullsized":"2024-04-23T19:02:21.147784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:14.398728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148926+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:02:21.148926+0000","last_peered":"2024-04-23T19:02:21.148926+0000","last_clean":"2024-04-23T19:02:21.148926+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:02:21.148926+0000","last_undegraded":"2024-04-23T19:02:21.148926+0000","last_fullsized":"2024-04-23T19:02:21.148926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396933+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:02:21.396933+0000","last_peered":"2024-04-23T19:02:21.396933+0000","last_clean":"2024-04-23T19:02:21.396933+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:02:21.396933+0000","last_undegraded":"2024-04-23T19:02:21.396933+0000","last_fullsized":"2024-04-23T19:02:21.396933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"53'4","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.404086+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:02:21.404086+0000","last_peered":"2024-04-23T19:02:21.404086+0000","last_clean":"2024-04-23T19:02:21.404086+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:02:21.404086+0000","last_undegraded":"2024-04-23T19:02:21.404086+0000","last_fullsized":"2024-04-23T19:02:21.404086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148139+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:02:21.148139+0000","last_peered":"2024-04-23T19:02:21.148139+0000","last_clean":"2024-04-23T19:02:21.148139+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:02:21.148139+0000","last_undegraded":"2024-04-23T19:02:21.148139+0000","last_fullsized":"2024-04-23T19:02:21.148139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399403+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:02:21.399403+0000","last_peered":"2024-04-23T19:02:21.399403+0000","last_clean":"2024-04-23T19:02:21.399403+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:02:21.399403+0000","last_undegraded":"2024-04-23T19:02:21.399403+0000","last_fullsized":"2024-04-23T19:02:21.399403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'22","reported_seq":148,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398234+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:02:21.398234+0000","last_peered":"2024-04-23T19:02:21.398234+0000","last_clean":"2024-04-23T19:02:21.398234+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:02:21.398234+0000","last_undegraded":"2024-04-23T19:02:21.398234+0000","last_fullsized":"2024-04-23T19:02:21.398234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148070+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:02:21.148070+0000","last_peered":"2024-04-23T19:02:21.148070+0000","last_clean":"2024-04-23T19:02:21.148070+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:02:21.148070+0000","last_undegraded":"2024-04-23T19:02:21.148070+0000","last_fullsized":"2024-04-23T19:02:21.148070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398230+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:02:21.398230+0000","last_peered":"2024-04-23T19:02:21.398230+0000","last_clean":"2024-04-23T19:02:21.398230+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:02:21.398230+0000","last_undegraded":"2024-04-23T19:02:21.398230+0000","last_fullsized":"2024-04-23T19:02:21.398230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400884+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:02:21.400884+0000","last_peered":"2024-04-23T19:02:21.400884+0000","last_clean":"2024-04-23T19:02:21.400884+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:02:21.400884+0000","last_undegraded":"2024-04-23T19:02:21.400884+0000","last_fullsized":"2024-04-23T19:02:21.400884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149032+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:02:21.149032+0000","last_peered":"2024-04-23T19:02:21.149032+0000","last_clean":"2024-04-23T19:02:21.149032+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:02:21.149032+0000","last_undegraded":"2024-04-23T19:02:21.149032+0000","last_fullsized":"2024-04-23T19:02:21.149032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150260+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:02:21.150260+0000","last_peered":"2024-04-23T19:02:21.150260+0000","last_clean":"2024-04-23T19:02:21.150260+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:02:21.150260+0000","last_undegraded":"2024-04-23T19:02:21.150260+0000","last_fullsized":"2024-04-23T19:02:21.150260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'18","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402106+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:02:21.402106+0000","last_peered":"2024-04-23T19:02:21.402106+0000","last_clean":"2024-04-23T19:02:21.402106+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:02:21.402106+0000","last_undegraded":"2024-04-23T19:02:21.402106+0000","last_fullsized":"2024-04-23T19:02:21.402106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148318+0000","last_change":"2024-04-23T19:00:23.344133+0000","last_active":"2024-04-23T19:02:21.148318+0000","last_peered":"2024-04-23T19:02:21.148318+0000","last_clean":"2024-04-23T19:02:21.148318+0000","last_became_active":"2024-04-23T19:00:23.343020+0000","last_became_peered":"2024-04-23T19:00:23.343020+0000","last_unstale":"2024-04-23T19:02:21.148318+0000","last_undegraded":"2024-04-23T19:02:21.148318+0000","last_fullsized":"2024-04-23T19:02:21.148318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:16.330420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"52'5","reported_seq":115,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148810+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:02:21.148810+0000","last_peered":"2024-04-23T19:02:21.148810+0000","last_clean":"2024-04-23T19:02:21.148810+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:02:21.148810+0000","last_undegraded":"2024-04-23T19:02:21.148810+0000","last_fullsized":"2024-04-23T19:02:21.148810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397385+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:02:21.397385+0000","last_peered":"2024-04-23T19:02:21.397385+0000","last_clean":"2024-04-23T19:02:21.397385+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:02:21.397385+0000","last_undegraded":"2024-04-23T19:02:21.397385+0000","last_fullsized":"2024-04-23T19:02:21.397385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399450+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:02:21.399450+0000","last_peered":"2024-04-23T19:02:21.399450+0000","last_clean":"2024-04-23T19:02:21.399450+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:02:21.399450+0000","last_undegraded":"2024-04-23T19:02:21.399450+0000","last_fullsized":"2024-04-23T19:02:21.399450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148299+0000","last_change":"2024-04-23T19:00:19.306559+0000","last_active":"2024-04-23T19:02:21.148299+0000","last_peered":"2024-04-23T19:02:21.148299+0000","last_clean":"2024-04-23T19:02:21.148299+0000","last_became_active":"2024-04-23T19:00:19.305854+0000","last_became_peered":"2024-04-23T19:00:19.305854+0000","last_unstale":"2024-04-23T19:02:21.148299+0000","last_undegraded":"2024-04-23T19:02:21.148299+0000","last_fullsized":"2024-04-23T19:02:21.148299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150137+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:02:21.150137+0000","last_peered":"2024-04-23T19:02:21.150137+0000","last_clean":"2024-04-23T19:02:21.150137+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:02:21.150137+0000","last_undegraded":"2024-04-23T19:02:21.150137+0000","last_fullsized":"2024-04-23T19:02:21.150137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"75'107","reported_seq":252,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399196+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:02:21.399196+0000","last_peered":"2024-04-23T19:02:21.399196+0000","last_clean":"2024-04-23T19:02:21.399196+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:02:21.399196+0000","last_undegraded":"2024-04-23T19:02:21.399196+0000","last_fullsized":"2024-04-23T19:02:21.399196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397307+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:02:21.397307+0000","last_peered":"2024-04-23T19:02:21.397307+0000","last_clean":"2024-04-23T19:02:21.397307+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:02:21.397307+0000","last_undegraded":"2024-04-23T19:02:21.397307+0000","last_fullsized":"2024-04-23T19:02:21.397307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146839+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:02:21.146839+0000","last_peered":"2024-04-23T19:02:21.146839+0000","last_clean":"2024-04-23T19:02:21.146839+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:02:21.146839+0000","last_undegraded":"2024-04-23T19:02:21.146839+0000","last_fullsized":"2024-04-23T19:02:21.146839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"57'3","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149640+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:02:21.149640+0000","last_peered":"2024-04-23T19:02:21.149640+0000","last_clean":"2024-04-23T19:02:21.149640+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:02:21.149640+0000","last_undegraded":"2024-04-23T19:02:21.149640+0000","last_fullsized":"2024-04-23T19:02:21.149640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397419+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:02:21.397419+0000","last_peered":"2024-04-23T19:02:21.397419+0000","last_clean":"2024-04-23T19:02:21.397419+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:02:21.397419+0000","last_undegraded":"2024-04-23T19:02:21.397419+0000","last_fullsized":"2024-04-23T19:02:21.397419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'21","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149069+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:02:21.149069+0000","last_peered":"2024-04-23T19:02:21.149069+0000","last_clean":"2024-04-23T19:02:21.149069+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:02:21.149069+0000","last_undegraded":"2024-04-23T19:02:21.149069+0000","last_fullsized":"2024-04-23T19:02:21.149069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400883+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:02:21.400883+0000","last_peered":"2024-04-23T19:02:21.400883+0000","last_clean":"2024-04-23T19:02:21.400883+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:02:21.400883+0000","last_undegraded":"2024-04-23T19:02:21.400883+0000","last_fullsized":"2024-04-23T19:02:21.400883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398905+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:02:21.398905+0000","last_peered":"2024-04-23T19:02:21.398905+0000","last_clean":"2024-04-23T19:02:21.398905+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:02:21.398905+0000","last_undegraded":"2024-04-23T19:02:21.398905+0000","last_fullsized":"2024-04-23T19:02:21.398905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"57'6","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148186+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:02:21.148186+0000","last_peered":"2024-04-23T19:02:21.148186+0000","last_clean":"2024-04-23T19:02:21.148186+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:02:21.148186+0000","last_undegraded":"2024-04-23T19:02:21.148186+0000","last_fullsized":"2024-04-23T19:02:21.148186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'7","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.396901+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:02:21.396901+0000","last_peered":"2024-04-23T19:02:21.396901+0000","last_clean":"2024-04-23T19:02:21.396901+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:02:21.396901+0000","last_undegraded":"2024-04-23T19:02:21.396901+0000","last_fullsized":"2024-04-23T19:02:21.396901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148443+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:02:21.148443+0000","last_peered":"2024-04-23T19:02:21.148443+0000","last_clean":"2024-04-23T19:02:21.148443+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:02:21.148443+0000","last_undegraded":"2024-04-23T19:02:21.148443+0000","last_fullsized":"2024-04-23T19:02:21.148443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'15","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400734+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:02:21.400734+0000","last_peered":"2024-04-23T19:02:21.400734+0000","last_clean":"2024-04-23T19:02:21.400734+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:02:21.400734+0000","last_undegraded":"2024-04-23T19:02:21.400734+0000","last_fullsized":"2024-04-23T19:02:21.400734+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398213+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:02:21.398213+0000","last_peered":"2024-04-23T19:02:21.398213+0000","last_clean":"2024-04-23T19:02:21.398213+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:02:21.398213+0000","last_undegraded":"2024-04-23T19:02:21.398213+0000","last_fullsized":"2024-04-23T19:02:21.398213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401477+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:02:21.401477+0000","last_peered":"2024-04-23T19:02:21.401477+0000","last_clean":"2024-04-23T19:02:21.401477+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:02:21.401477+0000","last_undegraded":"2024-04-23T19:02:21.401477+0000","last_fullsized":"2024-04-23T19:02:21.401477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":166,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398000+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:02:21.398000+0000","last_peered":"2024-04-23T19:02:21.398000+0000","last_clean":"2024-04-23T19:02:21.398000+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:02:21.398000+0000","last_undegraded":"2024-04-23T19:02:21.398000+0000","last_fullsized":"2024-04-23T19:02:21.398000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401783+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:02:21.401783+0000","last_peered":"2024-04-23T19:02:21.401783+0000","last_clean":"2024-04-23T19:02:21.401783+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:02:21.401783+0000","last_undegraded":"2024-04-23T19:02:21.401783+0000","last_fullsized":"2024-04-23T19:02:21.401783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.145916+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:02:21.145916+0000","last_peered":"2024-04-23T19:02:21.145916+0000","last_clean":"2024-04-23T19:02:21.145916+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:02:21.145916+0000","last_undegraded":"2024-04-23T19:02:21.145916+0000","last_fullsized":"2024-04-23T19:02:21.145916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'12","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400441+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:02:21.400441+0000","last_peered":"2024-04-23T19:02:21.400441+0000","last_clean":"2024-04-23T19:02:21.400441+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:02:21.400441+0000","last_undegraded":"2024-04-23T19:02:21.400441+0000","last_fullsized":"2024-04-23T19:02:21.400441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146540+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:02:21.146540+0000","last_peered":"2024-04-23T19:02:21.146540+0000","last_clean":"2024-04-23T19:02:21.146540+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:02:21.146540+0000","last_undegraded":"2024-04-23T19:02:21.146540+0000","last_fullsized":"2024-04-23T19:02:21.146540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399217+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:02:21.399217+0000","last_peered":"2024-04-23T19:02:21.399217+0000","last_clean":"2024-04-23T19:02:21.399217+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:02:21.399217+0000","last_undegraded":"2024-04-23T19:02:21.399217+0000","last_fullsized":"2024-04-23T19:02:21.399217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146213+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:02:21.146213+0000","last_peered":"2024-04-23T19:02:21.146213+0000","last_clean":"2024-04-23T19:02:21.146213+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:02:21.146213+0000","last_undegraded":"2024-04-23T19:02:21.146213+0000","last_fullsized":"2024-04-23T19:02:21.146213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'7","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401548+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:02:21.401548+0000","last_peered":"2024-04-23T19:02:21.401548+0000","last_clean":"2024-04-23T19:02:21.401548+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:02:21.401548+0000","last_undegraded":"2024-04-23T19:02:21.401548+0000","last_fullsized":"2024-04-23T19:02:21.401548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147296+0000","last_change":"2024-04-23T19:00:19.302840+0000","last_active":"2024-04-23T19:02:21.147296+0000","last_peered":"2024-04-23T19:02:21.147296+0000","last_clean":"2024-04-23T19:02:21.147296+0000","last_became_active":"2024-04-23T19:00:19.302069+0000","last_became_peered":"2024-04-23T19:00:19.302069+0000","last_unstale":"2024-04-23T19:02:21.147296+0000","last_undegraded":"2024-04-23T19:02:21.147296+0000","last_fullsized":"2024-04-23T19:02:21.147296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:15.157506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'16","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146961+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:02:21.146961+0000","last_peered":"2024-04-23T19:02:21.146961+0000","last_clean":"2024-04-23T19:02:21.146961+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:02:21.146961+0000","last_undegraded":"2024-04-23T19:02:21.146961+0000","last_fullsized":"2024-04-23T19:02:21.146961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399877+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:02:21.399877+0000","last_peered":"2024-04-23T19:02:21.399877+0000","last_clean":"2024-04-23T19:02:21.399877+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:02:21.399877+0000","last_undegraded":"2024-04-23T19:02:21.399877+0000","last_fullsized":"2024-04-23T19:02:21.399877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.146570+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:02:21.146570+0000","last_peered":"2024-04-23T19:02:21.146570+0000","last_clean":"2024-04-23T19:02:21.146570+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:02:21.146570+0000","last_undegraded":"2024-04-23T19:02:21.146570+0000","last_fullsized":"2024-04-23T19:02:21.146570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148639+0000","last_change":"2024-04-23T19:00:17.315323+0000","last_active":"2024-04-23T19:02:21.148639+0000","last_peered":"2024-04-23T19:02:21.148639+0000","last_clean":"2024-04-23T19:02:21.148639+0000","last_became_active":"2024-04-23T19:00:17.315077+0000","last_became_peered":"2024-04-23T19:00:17.315077+0000","last_unstale":"2024-04-23T19:02:21.148639+0000","last_undegraded":"2024-04-23T19:02:21.148639+0000","last_fullsized":"2024-04-23T19:02:21.148639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'10","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397658+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:02:21.397658+0000","last_peered":"2024-04-23T19:02:21.397658+0000","last_clean":"2024-04-23T19:02:21.397658+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:02:21.397658+0000","last_undegraded":"2024-04-23T19:02:21.397658+0000","last_fullsized":"2024-04-23T19:02:21.397658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148538+0000","last_change":"2024-04-23T19:00:17.297003+0000","last_active":"2024-04-23T19:02:21.148538+0000","last_peered":"2024-04-23T19:02:21.148538+0000","last_clean":"2024-04-23T19:02:21.148538+0000","last_became_active":"2024-04-23T19:00:17.295108+0000","last_became_peered":"2024-04-23T19:00:17.295108+0000","last_unstale":"2024-04-23T19:02:21.148538+0000","last_undegraded":"2024-04-23T19:02:21.148538+0000","last_fullsized":"2024-04-23T19:02:21.148538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"74'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397021+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:02:21.397021+0000","last_peered":"2024-04-23T19:02:21.397021+0000","last_clean":"2024-04-23T19:02:21.397021+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:02:21.397021+0000","last_undegraded":"2024-04-23T19:02:21.397021+0000","last_fullsized":"2024-04-23T19:02:21.397021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149572+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:02:21.149572+0000","last_peered":"2024-04-23T19:02:21.149572+0000","last_clean":"2024-04-23T19:02:21.149572+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:02:21.149572+0000","last_undegraded":"2024-04-23T19:02:21.149572+0000","last_fullsized":"2024-04-23T19:02:21.149572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151649+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:02:21.151649+0000","last_peered":"2024-04-23T19:02:21.151649+0000","last_clean":"2024-04-23T19:02:21.151649+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:02:21.151649+0000","last_undegraded":"2024-04-23T19:02:21.151649+0000","last_fullsized":"2024-04-23T19:02:21.151649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"53'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148070+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:02:21.148070+0000","last_peered":"2024-04-23T19:02:21.148070+0000","last_clean":"2024-04-23T19:02:21.148070+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:02:21.148070+0000","last_undegraded":"2024-04-23T19:02:21.148070+0000","last_fullsized":"2024-04-23T19:02:21.148070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399617+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:02:21.399617+0000","last_peered":"2024-04-23T19:02:21.399617+0000","last_clean":"2024-04-23T19:02:21.399617+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:02:21.399617+0000","last_undegraded":"2024-04-23T19:02:21.399617+0000","last_fullsized":"2024-04-23T19:02:21.399617+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":163,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400227+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:02:21.400227+0000","last_peered":"2024-04-23T19:02:21.400227+0000","last_clean":"2024-04-23T19:02:21.400227+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:02:21.400227+0000","last_undegraded":"2024-04-23T19:02:21.400227+0000","last_fullsized":"2024-04-23T19:02:21.400227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'12","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399480+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:02:21.399480+0000","last_peered":"2024-04-23T19:02:21.399480+0000","last_clean":"2024-04-23T19:02:21.399480+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:02:21.399480+0000","last_undegraded":"2024-04-23T19:02:21.399480+0000","last_fullsized":"2024-04-23T19:02:21.399480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148883+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:02:21.148883+0000","last_peered":"2024-04-23T19:02:21.148883+0000","last_clean":"2024-04-23T19:02:21.148883+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:02:21.148883+0000","last_undegraded":"2024-04-23T19:02:21.148883+0000","last_fullsized":"2024-04-23T19:02:21.148883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'13","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149821+0000","last_change":"2024-04-23T19:00:15.251155+0000","last_active":"2024-04-23T19:02:21.149821+0000","last_peered":"2024-04-23T19:02:21.149821+0000","last_clean":"2024-04-23T19:02:21.149821+0000","last_became_active":"2024-04-23T19:00:15.250798+0000","last_became_peered":"2024-04-23T19:00:15.250798+0000","last_unstale":"2024-04-23T19:02:21.149821+0000","last_undegraded":"2024-04-23T19:02:21.149821+0000","last_fullsized":"2024-04-23T19:02:21.149821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397859+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:02:21.397859+0000","last_peered":"2024-04-23T19:02:21.397859+0000","last_clean":"2024-04-23T19:02:21.397859+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:02:21.397859+0000","last_undegraded":"2024-04-23T19:02:21.397859+0000","last_fullsized":"2024-04-23T19:02:21.397859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'10","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399535+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:02:21.399535+0000","last_peered":"2024-04-23T19:02:21.399535+0000","last_clean":"2024-04-23T19:02:21.399535+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:02:21.399535+0000","last_undegraded":"2024-04-23T19:02:21.399535+0000","last_fullsized":"2024-04-23T19:02:21.399535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"53'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397534+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:02:21.397534+0000","last_peered":"2024-04-23T19:02:21.397534+0000","last_clean":"2024-04-23T19:02:21.397534+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:02:21.397534+0000","last_undegraded":"2024-04-23T19:02:21.397534+0000","last_fullsized":"2024-04-23T19:02:21.397534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'6","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.401783+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:02:21.401783+0000","last_peered":"2024-04-23T19:02:21.401783+0000","last_clean":"2024-04-23T19:02:21.401783+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:02:21.401783+0000","last_undegraded":"2024-04-23T19:02:21.401783+0000","last_fullsized":"2024-04-23T19:02:21.401783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402073+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:02:21.402073+0000","last_peered":"2024-04-23T19:02:21.402073+0000","last_clean":"2024-04-23T19:02:21.402073+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:02:21.402073+0000","last_undegraded":"2024-04-23T19:02:21.402073+0000","last_fullsized":"2024-04-23T19:02:21.402073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"75'19","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148535+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:02:21.148535+0000","last_peered":"2024-04-23T19:02:21.148535+0000","last_clean":"2024-04-23T19:02:21.148535+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:02:21.148535+0000","last_undegraded":"2024-04-23T19:02:21.148535+0000","last_fullsized":"2024-04-23T19:02:21.148535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":59,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"75'6","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.150282+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:02:21.150282+0000","last_peered":"2024-04-23T19:02:21.150282+0000","last_clean":"2024-04-23T19:02:21.150282+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:02:21.150282+0000","last_undegraded":"2024-04-23T19:02:21.150282+0000","last_fullsized":"2024-04-23T19:02:21.150282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"74'8","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398009+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:02:21.398009+0000","last_peered":"2024-04-23T19:02:21.398009+0000","last_clean":"2024-04-23T19:02:21.398009+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:02:21.398009+0000","last_undegraded":"2024-04-23T19:02:21.398009+0000","last_fullsized":"2024-04-23T19:02:21.398009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"52'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398289+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:02:21.398289+0000","last_peered":"2024-04-23T19:02:21.398289+0000","last_clean":"2024-04-23T19:02:21.398289+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:02:21.398289+0000","last_undegraded":"2024-04-23T19:02:21.398289+0000","last_fullsized":"2024-04-23T19:02:21.398289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.151471+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:02:21.151471+0000","last_peered":"2024-04-23T19:02:21.151471+0000","last_clean":"2024-04-23T19:02:21.151471+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:02:21.151471+0000","last_undegraded":"2024-04-23T19:02:21.151471+0000","last_fullsized":"2024-04-23T19:02:21.151471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.149139+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:02:21.149139+0000","last_peered":"2024-04-23T19:02:21.149139+0000","last_clean":"2024-04-23T19:02:21.149139+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:02:21.149139+0000","last_undegraded":"2024-04-23T19:02:21.149139+0000","last_fullsized":"2024-04-23T19:02:21.149139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'7","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400221+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:02:21.400221+0000","last_peered":"2024-04-23T19:02:21.400221+0000","last_clean":"2024-04-23T19:02:21.400221+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:02:21.400221+0000","last_undegraded":"2024-04-23T19:02:21.400221+0000","last_fullsized":"2024-04-23T19:02:21.400221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":146,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397871+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:02:21.397871+0000","last_peered":"2024-04-23T19:02:21.397871+0000","last_clean":"2024-04-23T19:02:21.397871+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:02:21.397871+0000","last_undegraded":"2024-04-23T19:02:21.397871+0000","last_fullsized":"2024-04-23T19:02:21.397871+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400118+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:02:21.400118+0000","last_peered":"2024-04-23T19:02:21.400118+0000","last_clean":"2024-04-23T19:02:21.400118+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:02:21.400118+0000","last_undegraded":"2024-04-23T19:02:21.400118+0000","last_fullsized":"2024-04-23T19:02:21.400118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399081+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:02:21.399081+0000","last_peered":"2024-04-23T19:02:21.399081+0000","last_clean":"2024-04-23T19:02:21.399081+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:02:21.399081+0000","last_undegraded":"2024-04-23T19:02:21.399081+0000","last_fullsized":"2024-04-23T19:02:21.399081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'10","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.399911+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:02:21.399911+0000","last_peered":"2024-04-23T19:02:21.399911+0000","last_clean":"2024-04-23T19:02:21.399911+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:02:21.399911+0000","last_undegraded":"2024-04-23T19:02:21.399911+0000","last_fullsized":"2024-04-23T19:02:21.399911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"75'8","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.397793+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:02:21.397793+0000","last_peered":"2024-04-23T19:02:21.397793+0000","last_clean":"2024-04-23T19:02:21.397793+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:02:21.397793+0000","last_undegraded":"2024-04-23T19:02:21.397793+0000","last_fullsized":"2024-04-23T19:02:21.397793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'7","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398554+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:02:21.398554+0000","last_peered":"2024-04-23T19:02:21.398554+0000","last_clean":"2024-04-23T19:02:21.398554+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:02:21.398554+0000","last_undegraded":"2024-04-23T19:02:21.398554+0000","last_fullsized":"2024-04-23T19:02:21.398554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.400371+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:02:21.400371+0000","last_peered":"2024-04-23T19:02:21.400371+0000","last_clean":"2024-04-23T19:02:21.400371+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:02:21.400371+0000","last_undegraded":"2024-04-23T19:02:21.400371+0000","last_fullsized":"2024-04-23T19:02:21.400371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.398707+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:02:21.398707+0000","last_peered":"2024-04-23T19:02:21.398707+0000","last_clean":"2024-04-23T19:02:21.398707+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:02:21.398707+0000","last_undegraded":"2024-04-23T19:02:21.398707+0000","last_fullsized":"2024-04-23T19:02:21.398707+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.148276+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:02:21.148276+0000","last_peered":"2024-04-23T19:02:21.148276+0000","last_clean":"2024-04-23T19:02:21.148276+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:02:21.148276+0000","last_undegraded":"2024-04-23T19:02:21.148276+0000","last_fullsized":"2024-04-23T19:02:21.148276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"53'4","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.402005+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:02:21.402005+0000","last_peered":"2024-04-23T19:02:21.402005+0000","last_clean":"2024-04-23T19:02:21.402005+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:02:21.402005+0000","last_undegraded":"2024-04-23T19:02:21.402005+0000","last_fullsized":"2024-04-23T19:02:21.402005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'12","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.147888+0000","last_change":"2024-04-23T19:00:15.270216+0000","last_active":"2024-04-23T19:02:21.147888+0000","last_peered":"2024-04-23T19:02:21.147888+0000","last_clean":"2024-04-23T19:02:21.147888+0000","last_became_active":"2024-04-23T19:00:15.269392+0000","last_became_peered":"2024-04-23T19:00:15.269392+0000","last_unstale":"2024-04-23T19:02:21.147888+0000","last_undegraded":"2024-04-23T19:02:21.147888+0000","last_fullsized":"2024-04-23T19:02:21.147888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-23T19:02:21.152166+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:02:21.152166+0000","last_peered":"2024-04-23T19:02:21.152166+0000","last_clean":"2024-04-23T19:02:21.152166+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:02:21.152166+0000","last_undegraded":"2024-04-23T19:02:21.152166+0000","last_fullsized":"2024-04-23T19:02:21.152166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":293,"num_read_kb":277,"num_write":246,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":145645,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":813,"num_read_kb":572,"num_write":449,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":243458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":354,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1250,"num_read_kb":1226,"num_write":256,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2113929216,"num_objects":506,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":506,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":578,"num_write_kb":2088960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4227858432,"data_stored":4227858432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595948,"kb_used_data":564756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93775892,"statfs":{"total":96636764160,"available":96026513408,"internally_reserved":0,"allocated":578310144,"data_stored":577834707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435596,"kb_used_data":404412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93936244,"statfs":{"total":96636764160,"available":96190713856,"internally_reserved":0,"allocated":414117888,"data_stored":413673071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583144,"kb_used_data":551956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93788696,"statfs":{"total":96636764160,"available":96039624704,"internally_reserved":0,"allocated":565202944,"data_stored":564717638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":652664,"kb_used_data":621480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93719176,"statfs":{"total":96636764160,"available":95968436224,"internally_reserved":0,"allocated":636395520,"data_stored":635969132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":724448,"kb_used_data":693264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93647392,"statfs":{"total":96636764160,"available":95894929408,"internally_reserved":0,"allocated":709902336,"data_stored":709430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380324,"kb_used_data":349144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93991516,"statfs":{"total":96636764160,"available":96247312384,"internally_reserved":0,"allocated":357523456,"data_stored":357097817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421336,"kb_used_data":390152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93950504,"statfs":{"total":96636764160,"available":96205316096,"internally_reserved":0,"allocated":399515648,"data_stored":399050685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":593852,"kb_used_data":562672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93777988,"statfs":{"total":96636764160,"available":96028659712,"internally_reserved":0,"allocated":576176128,"data_stored":575728576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":574619648,"data_stored":574619648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":398458880,"data_stored":398458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":708837376,"data_stored":708837376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":635437056,"data_stored":635437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":564133888,"data_stored":564133888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":413138944,"data_stored":413138944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":576716800,"data_stored":576716800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":59167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":59607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:02:26.078 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-23T19:02:26.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T19:02:26.078 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-23T19:02:26.078 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.209315 2024-04-23T19:02:26.078 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.20931486455881232 2024-04-23T19:02:26.128 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:26.128 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.223477398999997, 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.129 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:26.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.027086795000002, 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.135 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:26.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:26.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.914278101000001, 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.142 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:26.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:26.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:26.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.425705733999997, 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.148 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:26.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:26.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:26.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.275399514999997, 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:26.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.164950482000002, 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:26.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.613024838000001, 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.164 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:26.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:26.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:26.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.417526262999999, 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:26.170 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:26.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.175 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.323711046, 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.176 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:26.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.181050134000003, 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.182 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:26.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.187 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.160031594000003, 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:26.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:26.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.191 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.049686539, 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.192 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:26.197 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 49.995624905, 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.198 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:26.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:26.203 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.747810250000001, 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:26.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:26.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:26.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.209 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.173287007000001, 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.210 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:26.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:26.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2659 3.31 e74/20 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head v 74'9, mlcod=74'7)", 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.041214101, 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020828660999999998, 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085955+0000", 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5940000000000001e-06 2024-04-23T19:02:26.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093827+0000", 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078715069999999998 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093857+0000", 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9963000000000001e-05 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093873+0000", 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6609999999999999e-05 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094012+0000", 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013919099999999999 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094079+0000", 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6148000000000004e-05 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106678+0000", 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012599880000000001 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106781+0000", 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102768 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:26.220 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.95092606, 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:26.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:26.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.875308696999999, 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.225 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.226 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.227 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.228 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.229 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.230 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.782939893, 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.231 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:26.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.236 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.649802473999999, 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.237 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.238 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.242 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:26.244 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:26.245 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:26.241+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:26.345 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:26.341+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:26.372 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:26.372 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:26.372 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:26.372 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:26.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:26.445 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:26.445+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:26.510 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:26.511 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:26.511 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:26.525 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:26.574 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:26.576+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:26.648 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:26.648+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:26.650 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:26.650 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:26.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:26.650 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.787535309000006, 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:02:26.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:02:26.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:02:26.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2132 3.28 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.612306168000003, 2024-04-23T19:02:26.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021363914000000001, 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2132 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036340+0000", 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040181+0000", 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038414909999999998 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040205+0000", 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3711e-05 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040217+0000", 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1467e-05 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040291+0000", 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4610000000000006e-05 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040422+0000", 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131297 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040539+0000", 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011694899999999999 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.047401+0000", 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068619040000000003 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057538+0000", 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010136915999999999 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057634+0000", 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5923999999999998e-05 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057701+0000", 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7291000000000003e-05 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.426014062, 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.662 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:26.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:26.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.761661644, 2024-04-23T19:02:26.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:26.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:02:26.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:02:26.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:02:26.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.739503134000003, 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:26.680 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.591579019000001, 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:26.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.540637949000001, 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.690 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.536774749999999, 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.691 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:26.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:26.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:26.696 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.026752123000001, 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:26.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.700 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.007227669000002, 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:26.702 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:26.703 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:26.704 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:26.705 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.950694364999997, 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.706 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.707 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.708 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.709 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:26.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.711 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.875066969000002, 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.712 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.713 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.714 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:02:26.715 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:02:26.716 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.673978834000003, 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.717 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.718 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.719 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:26.720 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:26.721 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.465086753000001, 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:26.722 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.723 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:26.724 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:26.725 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:26.726 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.727 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.143708638, 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.728 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:26.729 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.730 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:26.731 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:26.732 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.551238358999999, 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.733 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.734 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:26.735 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:26.736 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.008847901999999, 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.737 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:26.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:26.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:26.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2726 3.30 3:0ce56bcb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.768041152, 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021924124999999999, 2024-04-23T19:02:26.742 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2726 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880606+0000", 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884605+0000", 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039984160000000003 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884644+0000", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8813000000000003e-05 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884662+0000", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8145999999999999e-05 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884745+0000", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2955999999999997e-05 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884863+0000", 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011857 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884968+0000", 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105176 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.889496+0000", 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004527522 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902433+0000", 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012937277 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902485+0000", 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2188000000000002e-05 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902527+0000", 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1260999999999997e-05 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2732 3.5 3:a290817c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.675692675000001, 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022383746999999999, 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2732 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972955+0000", 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7529999999999999e-06 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.976996+0000", 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040414190000000001 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977054+0000", 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8202000000000003e-05 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977081+0000", 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6533000000000002e-05 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977243+0000", 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016217400000000001 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977497+0000", 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025378800000000002 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977735+0000", 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839600000000001 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.989236+0000", 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011500776000000001 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995095+0000", 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058587800000000001 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995196+0000", 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010110799999999999 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995335+0000", 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138818 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.753 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2767 3.38 e75/20 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head v 75'8, mlcod=74'6)", 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.156439143, 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022125346000000001, 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:26.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496255+0000", 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040496459999999996 2024-04-23T19:02:26.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496290+0000", 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999000000000002e-05 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496307+0000", 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496440+0000", 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013291099999999999 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496482+0000", 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1802999999999999e-05 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514167+0000", 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685523000000002 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514330+0000", 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000162724 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.757 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.758 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.758 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:26.758 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:26.758 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:26.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:26.760 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:26.761+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:26.861 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:26.857+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:26.931 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:26.931 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:26.931 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:26.931 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:26.946 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:26.990 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:26.992+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:27.062 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:27.061+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:27.070 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:27.070 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:27.070 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:27.070 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:27.071 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:27.085 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:27.174 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:27.176+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:27.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:02:27.210 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.1 primary-affinity to 0.209315 (8137172) 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.163236245, 2024-04-23T19:02:27.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:27.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:27.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:27.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.572136055000001, 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.268 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:27.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:27.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:27.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:27.274 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.475857568999999, 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:27.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:02:27.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.278 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:02:27.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.280 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.212181547999997, 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.281 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:27.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:27.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.284 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:27.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.107067002000001, 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.287 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:27.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 50.960493819, 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.294 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:27.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:27.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.642656386000001, 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.301 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:27.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.633476028, 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:27.307 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:27.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:27.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:27.313 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.624013538, 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:27.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:27.319 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.604653289, 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:27.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:27.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.325 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.325 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:27.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:27.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.089519271, 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.333 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.078038045, 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:27.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:27.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:27.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2670 3.36 3:6da56ef5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.053873109, 2024-04-23T19:02:27.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021558461000000001, 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2670 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205488+0000", 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1559999999999999e-06 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210364+0000", 2024-04-23T19:02:27.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048764610000000003 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210390+0000", 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5599e-05 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210405+0000", 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5136999999999999e-05 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.342 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210541+0000", 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210854+0000", 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031316699999999999 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.211075+0000", 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022038 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226617+0000", 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015541721 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226809+0000", 2024-04-23T19:02:27.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019238999999999999 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226936+0000", 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012679400000000001 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.227043+0000", 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107475 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.345 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2679 3.a 3:53d5047c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.953240526, 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021012060999999999, 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2679 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306121+0000", 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4699999999999998e-06 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310690+0000", 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045696959999999998 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310727+0000", 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6040000000000001e-05 2024-04-23T19:02:27.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310743+0000", 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6841999999999999e-05 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310893+0000", 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014921800000000001 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311178+0000", 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028541500000000002 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311409+0000", 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023114300000000001 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.319813+0000", 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084038440000000006 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.326919+0000", 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071059540000000003 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327015+0000", 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5702e-05 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327129+0000", 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114737 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2696 3.26 3:64250b99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.78006186, 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023196560000000001, 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.352 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2696 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479299+0000", 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.576e-06 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483218+0000", 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003919774 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483251+0000", 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3145999999999997e-05 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483269+0000", 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7975999999999999e-05 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483360+0000", 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0916999999999997e-05 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483543+0000", 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183117 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483710+0000", 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016664100000000001 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.492065+0000", 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083545400000000006 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502380+0000", 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010315718 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502442+0000", 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1897999999999996e-05 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502493+0000", 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0256999999999997e-05 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.357 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2709 3.3f e74/20 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.642986943, 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021298837000000001, 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:27.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616373+0000", 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7579999999999999e-06 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618956+0000", 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025837170000000001 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618984+0000", 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7470999999999998e-05 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618998+0000", 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4527e-05 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619135+0000", 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013695499999999999 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619178+0000", 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2774000000000001e-05 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637529+0000", 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018350789999999999 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637670+0000", 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014084500000000001 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.639787738999999, 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:27.362 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:27.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:27.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.300560273, 2024-04-23T19:02:27.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:27.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:27.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2771 3.20 3:0642e822:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.715041928, 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020962379, 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2771 2024-04-23T19:02:27.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544319+0000", 2024-04-23T19:02:27.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.54e-06 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547645+0000", 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033258020000000001 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547682+0000", 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7058999999999999e-05 2024-04-23T19:02:27.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547701+0000", 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8450000000000001e-05 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547819+0000", 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118072 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547950+0000", 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013113999999999999 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.548056+0000", 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105782 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.554076+0000", 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060202390000000001 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565102+0000", 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011026144999999999 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565205+0000", 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102848 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565278+0000", 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3301999999999997e-05 2024-04-23T19:02:27.380 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2778 3.a 3:517c3c8c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.639679105999999, 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021706072, 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.381 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2778 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619682+0000", 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1200000000000002e-06 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623671+0000", 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887489999999998 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623703+0000", 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2465999999999997e-05 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623719+0000", 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6226e-05 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623882+0000", 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016293699999999999 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624278+0000", 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039613300000000001 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624707+0000", 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042824600000000002 2024-04-23T19:02:27.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.633735+0000", 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090279169999999999 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641200+0000", 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074658709999999998 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641297+0000", 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6644999999999994e-05 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641385+0000", 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7762000000000004e-05 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.387 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:27.389 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:27.389 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:27.388+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:27.489 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:27.489+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:27.562 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:27.562 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:27.562 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:27.562 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:27.576 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:27.622 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:27.624+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:27.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:27.691 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:27.692+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:27.698 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:27.698 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:27.698 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:27.698 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:27.698 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:27.712 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:27.790 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:27.791 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:27.789+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:27.808 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:27.808 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:27.824 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:27.824 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:27.841 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:27.841 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:27.861 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:27.881 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:27.882 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 144.715357052, 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.888 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:27.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:27.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:02:27.895 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 143.98290067100001, 2024-04-23T19:02:27.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:02:27.896 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.896 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:02:27.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:27.902 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 143.98285010500001, 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:02:27.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:27.908 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 143.982707766, 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:02:27.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:02:27.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:02:27.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:02:27.913 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 143.98250446500001, 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:27.914 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:27.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:27.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 143.982465281, 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:27.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:27.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:27.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:27.925 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2205 3.2d 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.088042143999999, 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021534458999999999, 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.926 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2205 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798421+0000", 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4370000000000001e-06 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802242+0000", 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038212939999999998 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802263+0000", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0543e-05 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802273+0000", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0248000000000001e-05 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802427+0000", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015376100000000001 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802688+0000", 2024-04-23T19:02:27.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026095699999999998 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802960+0000", 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027196700000000002 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.814078+0000", 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011118031 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819767+0000", 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056894629999999996 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819878+0000", 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011114499999999999 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819953+0000", 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4612999999999999e-05 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.931 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.803834187, 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021578863, 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.932 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:27.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:02:27.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:02:27.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103605+0000", 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012893465999999999 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103925+0000", 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032048599999999998 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104067+0000", 2024-04-23T19:02:27.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014224100000000001 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104205+0000", 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013803200000000001 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:27.938 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.769678556999999, 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:27.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:27.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:27.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:27.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2231 3.3f 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.658641439, 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021281242999999998, 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.944 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2231 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227821+0000", 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499999999999999e-06 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231570+0000", 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037486009999999998 2024-04-23T19:02:27.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231593+0000", 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3295999999999999e-05 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231602+0000", 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9330000000000007e-06 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231729+0000", 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012735200000000001 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232086+0000", 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000356635 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232429+0000", 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034333600000000002 2024-04-23T19:02:27.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.245402+0000", 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012972450999999999 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249012+0000", 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036096840000000002 2024-04-23T19:02:27.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249058+0000", 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6462999999999999e-05 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249100+0000", 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2441999999999998e-05 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.194093010000003, 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:27.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:27.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.121932712000003, 2024-04-23T19:02:27.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:27.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:27.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:27.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2295 3.12 e57/20 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head v 57'8, mlcod=56'6)", 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.814514893999998, 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020893219000000001, 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071949+0000", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5559999999999999e-06 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077385+0000", 2024-04-23T19:02:27.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054361019999999999 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077829+0000", 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044398899999999999 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.078932+0000", 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011023750000000001 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081607+0000", 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026748969999999999 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081654+0000", 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7644e-05 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092752+0000", 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011097164 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092839+0000", 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7491999999999995e-05 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2299 3.f 3:f2287333:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.772247280999999, 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023125123000000001, 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.966 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2299 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114216+0000", 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5100000000000001e-06 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119361+0000", 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051446879999999997 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119396+0000", 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5812999999999997e-05 2024-04-23T19:02:27.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119414+0000", 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7269999999999999e-05 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119583+0000", 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016943199999999999 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119990+0000", 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040668900000000001 2024-04-23T19:02:27.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.120394+0000", 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403755 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.129091+0000", 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086969969999999997 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137017+0000", 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079263489999999992 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137206+0000", 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018926500000000001 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137339+0000", 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013235499999999999 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2311 3.d 3:b2884c89:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:27.971 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 51.651404356, 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022499029, 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2311 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235060+0000", 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7759999999999999e-06 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238950+0000", 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038900689999999999 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238993+0000", 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3303000000000002e-05 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239013+0000", 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9879999999999999e-05 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239210+0000", 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019640400000000001 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239612+0000", 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040218900000000001 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.240031+0000", 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041938899999999999 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254300+0000", 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014269097 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257380+0000", 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003079104 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257481+0000", 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101325 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257555+0000", 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4493000000000007e-05 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2652 3.39 3:9c01ed3a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.988245+0000", 2024-04-23T19:02:27.977 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.898215712000001, 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02132655, 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2652 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.988245+0000", 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.988245+0000", 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.988249+0000", 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.992812+0000", 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004562918 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.992846+0000", 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4762999999999999e-05 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.992862+0000", 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5803000000000001e-05 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.993011+0000", 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014871700000000001 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.993278+0000", 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026674199999999999 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.993509+0000", 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023129199999999999 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.004325+0000", 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010816180999999999 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.009389+0000", 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005063807 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.009492+0000", 2024-04-23T19:02:27.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103155 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.009572+0000", 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9371999999999998e-05 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.983 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.601458832, 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.984 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:27.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.368214488, 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:27.990 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:27.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:27.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:27.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 15.276668492000001, 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:27.996 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:27.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:27.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:28.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2746 3.3f 3:fed341fe:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.195344+0000", 2024-04-23T19:02:28.002 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 14.691116614, 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020671393, 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2746 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.195344+0000", 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:28.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.195344+0000", 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.195347+0000", 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4279999999999999e-06 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199631+0000", 2024-04-23T19:02:28.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042849289999999998 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199651+0000", 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9769e-05 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199661+0000", 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3109999999999995e-06 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199728+0000", 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7854999999999993e-05 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199853+0000", 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124516 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199951+0000", 2024-04-23T19:02:28.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7955999999999995e-05 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.209126+0000", 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0091746940000000006 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.215880+0000", 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067540849999999999 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.215952+0000", 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1909999999999994e-05 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.216015+0000", 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3940000000000001e-05 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:28.008 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:28.009 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:28.009 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:28.010 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:28.011 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:28.011 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:28.008+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:28.011 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:28.013 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:28.111 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:28.112+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:28.184 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:28.185 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:28.191 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:02:28.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:28.212 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:28.212+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:28.313 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:28.312+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:28.330 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:28.330 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:28.345 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:28.414 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:28.416+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:28.468 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:28.468 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:28.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:28.516 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:28.516+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:28.525 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records in 2024-04-23T19:02:28.525 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records out 2024-04-23T19:02:28.525 INFO:tasks.workunit.client.0.smithi169.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.9556 s, 150 MB/s 2024-04-23T19:02:28.605 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:28.605 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:28.615 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:28.616+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:28.620 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:28.705 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_02_28 2024-04-23T19:02:28.716 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:28.713+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:28.787 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:28.787 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:28.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:28.850 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:28.849+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:28.860 INFO:tasks.workunit.client.0.smithi169.stdout:quota set for the bucket: buck_2024_03_23_19_02_28 2024-04-23T19:02:28.918 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:28.920+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:28.968 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:28.969 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:28.984 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:29.020 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:29.020+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:29.121 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:29.120+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:29.138 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:29.138 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:29.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:29.222 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:29.221+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:29.278 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:29.279 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:29.292 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:29.334 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:29.333+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:29.424 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:29.424+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:29.446 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:29.446 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:29.459 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:29.526 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:29.524+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:29.578 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:29.578 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:29.591 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:29.637 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:29.637+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:29.717 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:29.717 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:29.728 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:29.725+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:29.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:29.829 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:29.828+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:29.889 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:29.889 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:29.903 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:29.946 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:29.948+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:30.014 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:30.030 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:30.032+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:30.033 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:30.034 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:30.048 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:30.130 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:30.129+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:30.151 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:30.151 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:30.167 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:30.167 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:30.182 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:30.182 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:30.199 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:30.199 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:30.218 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:30.219 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:30.219 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:30.219 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:30.219 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:30.219 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:30.219 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:30.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:02:30.231 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:30.229+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:30.233 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:30.251 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:30.251 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:30.283 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:30.283 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:30.316 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:30.316 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:30.332 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:30.332+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:30.355 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:30.355 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.450787431000002, 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.356 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:30.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:30.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:30.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:30.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.254396827000001, 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:30.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:30.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.141588132999999, 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.367 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:30.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.371 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.653015766000003, 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:30.372 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:30.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:30.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.377 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.502709547000002, 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:30.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:30.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.392260514, 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.84033487, 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.387 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.391 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:30.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.644836294999998, 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.394 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.398 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.551021077999998, 2024-04-23T19:02:30.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.408360166000001, 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.387341626000001, 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.410 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.413 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.276996570999998, 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.414 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.419 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.222934936999998, 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.420 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:30.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:30.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.975120281999999, 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.425 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:30.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:30.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:30.430 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.400597039000001, 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2659 3.31 e74/20 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head v 74'9, mlcod=74'7)", 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.268524133, 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020828660999999998, 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.436 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085955+0000", 2024-04-23T19:02:30.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5940000000000001e-06 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093827+0000", 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078715069999999998 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093857+0000", 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9963000000000001e-05 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093873+0000", 2024-04-23T19:02:30.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6609999999999999e-05 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094012+0000", 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013919099999999999 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094079+0000", 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6148000000000004e-05 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106678+0000", 2024-04-23T19:02:30.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012599880000000001 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106781+0000", 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102768 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.178236091999999, 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:30.440 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:30.444 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.102618729, 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.449 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.010249925, 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.450 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:30.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:30.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:30.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.877112506, 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.456 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.461 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:30.463 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:30.463 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:30.461+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:30.563 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:30.561+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:30.632 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:30.632 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:30.632 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:30.646 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:30.664 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:30.661+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:30.765 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:30.761+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:30.770 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:30.770 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:30.770 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:30.770 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:30.770 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:30.785 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:30.865 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:30.864+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:02:30.911 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 70.048599129999999, 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:30.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:02:30.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:02:30.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:02:30.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:02:30.916 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2132 3.28 3:16449038:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.873369988999997, 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021363914000000001, 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.917 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2132 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036338+0000", 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.036340+0000", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3539999999999998e-06 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040181+0000", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038414909999999998 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040205+0000", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3711e-05 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040217+0000", 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1467e-05 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040291+0000", 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4610000000000006e-05 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040422+0000", 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131297 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.040539+0000", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011694899999999999 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.047401+0000", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068619040000000003 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057538+0000", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010136915999999999 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057634+0000", 2024-04-23T19:02:30.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5923999999999998e-05 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.057701+0000", 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7291000000000003e-05 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.687077883000001, 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:30.922 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:30.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:30.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:30.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:30.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.022725465000001, 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.928 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.000566954999996, 2024-04-23T19:02:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.852642840000001, 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.801701770000001, 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.944 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.797838571, 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.948 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:30.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:30.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.953 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.287815944000002, 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:30.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:30.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:30.957 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.268291490000003, 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.958 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:30.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:30.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:30.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.211758185999997, 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:30.963 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:30.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.968 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.136130790000003, 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:02:30.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:02:30.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:02:30.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:02:30.973 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.935042654999997, 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.974 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:30.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.726150574000002, 2024-04-23T19:02:30.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.984 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.404772459, 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.81230218, 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.990 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.269911723, 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:30.994 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:30.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:30.999 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2726 3.30 3:0ce56bcb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.029104972999999, 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021924124999999999, 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.000 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2726 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880606+0000", 2024-04-23T19:02:31.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884605+0000", 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039984160000000003 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884644+0000", 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8813000000000003e-05 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884662+0000", 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8145999999999999e-05 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884745+0000", 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2955999999999997e-05 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884863+0000", 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011857 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:31.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884968+0000", 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105176 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.889496+0000", 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004527522 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902433+0000", 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012937277 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902485+0000", 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2188000000000002e-05 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902527+0000", 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1260999999999997e-05 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2732 3.5 3:a290817c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.936756496000001, 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022383746999999999, 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2732 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972955+0000", 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7529999999999999e-06 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.976996+0000", 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040414190000000001 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977054+0000", 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8202000000000003e-05 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977081+0000", 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6533000000000002e-05 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977243+0000", 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016217400000000001 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977497+0000", 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025378800000000002 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977735+0000", 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839600000000001 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.989236+0000", 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011500776000000001 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995095+0000", 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058587800000000001 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995196+0000", 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010110799999999999 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995335+0000", 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138818 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2767 3.38 e75/20 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head v 75'8, mlcod=74'6)", 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.417502964000001, 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022125346000000001, 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.012 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:31.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496255+0000", 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040496459999999996 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496290+0000", 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999000000000002e-05 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496307+0000", 2024-04-23T19:02:31.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496440+0000", 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013291099999999999 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496482+0000", 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1802999999999999e-05 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514167+0000", 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685523000000002 2024-04-23T19:02:31.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514330+0000", 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000162724 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.016 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:31.018 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:31.018 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:31.016+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:31.118 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:31.120+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:31.185 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:31.186 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:31.186 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:31.200 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:31.243 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:31.244+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:31.252 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:02:31.320 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:31.317+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:31.370 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:31.370 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:31.370 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:31.370 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:31.370 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:31.384 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:31.421 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:31.417+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:31.508 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.410427036999998, 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:31.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:31.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:31.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:31.514 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.819326846999999, 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:31.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:31.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:31.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:31.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:31.519 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.723048360999996, 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.520 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:02:31.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.459372340000002, 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:31.525 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:31.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:31.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.354257793999999, 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.207684610999998, 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.536 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.541 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.889847178, 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.542 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:31.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.880666819999998, 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.547 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:31.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:31.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:31.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.552 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.871204330000001, 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.553 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:31.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:31.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:31.558 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.851844080999999, 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.563 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.336710063000002, 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.564 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:31.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:31.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:31.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.325228837000001, 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.569 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:31.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:31.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:31.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2670 3.36 3:6da56ef5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.301063900999999, 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021558461000000001, 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2670 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205485+0000", 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.205488+0000", 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1559999999999999e-06 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210364+0000", 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048764610000000003 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210390+0000", 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5599e-05 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210405+0000", 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5136999999999999e-05 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210541+0000", 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.210854+0000", 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031316699999999999 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.211075+0000", 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022038 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226617+0000", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015541721 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226809+0000", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019238999999999999 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.226936+0000", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012679400000000001 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.227043+0000", 2024-04-23T19:02:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000107475 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2679 3.a 3:53d5047c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.200431318, 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021012060999999999, 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2679 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306117+0000", 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.306121+0000", 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4699999999999998e-06 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310690+0000", 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045696959999999998 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310727+0000", 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6040000000000001e-05 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310743+0000", 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6841999999999999e-05 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310893+0000", 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014921800000000001 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311178+0000", 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028541500000000002 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.311409+0000", 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023114300000000001 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.319813+0000", 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084038440000000006 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.326919+0000", 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0071059540000000003 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327015+0000", 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5702e-05 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.327129+0000", 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000114737 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2696 3.26 3:64250b99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.027252652000001, 2024-04-23T19:02:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023196560000000001, 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2696 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479299+0000", 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.576e-06 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483218+0000", 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003919774 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483251+0000", 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3145999999999997e-05 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483269+0000", 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7975999999999999e-05 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483360+0000", 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0916999999999997e-05 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483543+0000", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183117 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483710+0000", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016664100000000001 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.492065+0000", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083545400000000006 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502380+0000", 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010315718 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502442+0000", 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1897999999999996e-05 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502493+0000", 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0256999999999997e-05 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2709 3.3f e74/20 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.890177735000002, 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021298837000000001, 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616371+0000", 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616373+0000", 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7579999999999999e-06 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618956+0000", 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025837170000000001 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618984+0000", 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7470999999999998e-05 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.618998+0000", 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4527e-05 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619135+0000", 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013695499999999999 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619178+0000", 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2774000000000001e-05 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637529+0000", 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018350789999999999 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637670+0000", 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014084500000000001 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.886978531, 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.547751065, 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2771 3.20 3:0642e822:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.962232719999999, 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020962379, 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2771 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544316+0000", 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.544319+0000", 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.54e-06 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547645+0000", 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0033258020000000001 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547682+0000", 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7058999999999999e-05 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547701+0000", 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8450000000000001e-05 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547819+0000", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118072 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.547950+0000", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013113999999999999 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.548056+0000", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105782 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.554076+0000", 2024-04-23T19:02:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060202390000000001 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565102+0000", 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011026144999999999 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565205+0000", 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102848 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.565278+0000", 2024-04-23T19:02:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3301999999999997e-05 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2778 3.a 3:517c3c8c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.886869898, 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021706072, 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2778 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619682+0000", 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1200000000000002e-06 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623671+0000", 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887489999999998 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623703+0000", 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2465999999999997e-05 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623719+0000", 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6226e-05 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623882+0000", 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016293699999999999 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624278+0000", 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039613300000000001 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624707+0000", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042824600000000002 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.633735+0000", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090279169999999999 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641200+0000", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074658709999999998 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641297+0000", 2024-04-23T19:02:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6644999999999994e-05 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641385+0000", 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7762000000000004e-05 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:31.616 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:31.618 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:31.618 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:31.617+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:31.719 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:31.720+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:31.743 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:31.743 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:31.743 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:31.743 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:31.757 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:31.821 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:31.817+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:31.920 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:31.920+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:31.925 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:31.925 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:31.925 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:31.925 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:31.925 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:31.940 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:32.021 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:32.021+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:32.110 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 148.93805373000001, 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.111 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:32.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:32.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:32.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.117 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.118 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 148.20559734899999, 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021329550999999999, 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 113 2024-04-23T19:02:32.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903560+0000", 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903561+0000", 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6599999999999994e-07 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903567+0000", 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3430000000000001e-06 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903580+0000", 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2947e-05 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903591+0000", 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0327e-05 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918019+0000", 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014428205 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918266+0000", 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024759499999999998 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.918663+0000", 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039655000000000002 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921756+0000", 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0030930559999999998 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924740+0000", 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002983557 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924823+0000", 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3739000000000006e-05 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924890+0000", 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6266000000000006e-05 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.124 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 148.20554678299999, 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021410067000000001, 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:32.125 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 114 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903611+0000", 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903612+0000", 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.24e-06 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903623+0000", 2024-04-23T19:02:32.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0716999999999999e-05 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903643+0000", 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0916000000000001e-05 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903658+0000", 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4387e-05 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920217+0000", 2024-04-23T19:02:32.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016559214999999999 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920451+0000", 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233718 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.920819+0000", 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036859700000000002 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924717+0000", 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00389785 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924904+0000", 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000186472 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924968+0000", 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4425999999999996e-05 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925021+0000", 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2528999999999998e-05 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 148.20540444400001, 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.131 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:32.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:02:32.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:02:32.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:02:32.137 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 148.20520114300001, 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:32.138 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:32.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 148.20516195900001, 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:32.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2205 3.2d 3:b4b39e6e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:32.149 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 57.310738821999998, 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021534458999999999, 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2205 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798419+0000", 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.798421+0000", 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4370000000000001e-06 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802242+0000", 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038212939999999998 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802263+0000", 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0543e-05 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802273+0000", 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0248000000000001e-05 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802427+0000", 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015376100000000001 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802688+0000", 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026095699999999998 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.802960+0000", 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027196700000000002 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.814078+0000", 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011118031 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819767+0000", 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056894629999999996 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819878+0000", 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011114499999999999 2024-04-23T19:02:32.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.819953+0000", 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4612999999999999e-05 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2220 3.3b 3:dcfb4f21:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 57.026530864999998, 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021578863, 2024-04-23T19:02:32.155 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2220 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082627+0000", 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.082630+0000", 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3330000000000001e-06 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090047+0000", 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074170659999999999 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090086+0000", 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9385999999999999e-05 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090103+0000", 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6926999999999999e-05 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090232+0000", 2024-04-23T19:02:32.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012863800000000001 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090484+0000", 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025174699999999997 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.090711+0000", 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000227541 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103605+0000", 2024-04-23T19:02:32.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012893465999999999 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.103925+0000", 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032048599999999998 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104067+0000", 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014224100000000001 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.104205+0000", 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013803200000000001 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.992375234999997, 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:32.163 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:32.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2231 3.3f 3:fd4fb736:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.881338116999999, 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021281242999999998, 2024-04-23T19:02:32.165 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2231 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227819+0000", 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.227821+0000", 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499999999999999e-06 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231570+0000", 2024-04-23T19:02:32.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037486009999999998 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231593+0000", 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3295999999999999e-05 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231602+0000", 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9330000000000007e-06 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.231729+0000", 2024-04-23T19:02:32.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012735200000000001 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232086+0000", 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000356635 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.232429+0000", 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034333600000000002 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.245402+0000", 2024-04-23T19:02:32.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012972450999999999 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249012+0000", 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036096840000000002 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249058+0000", 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6462999999999999e-05 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.249100+0000", 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2441999999999998e-05 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.416789688000001, 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.171 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.173 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.344629390000001, 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:32.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:32.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2295 3.12 e57/20 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head v 57'8, mlcod=56'6)", 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 56.037211571999997, 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020893219000000001, 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071946+0000", 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.071949+0000", 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5559999999999999e-06 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077385+0000", 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054361019999999999 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077829+0000", 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044398899999999999 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.078932+0000", 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011023750000000001 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081607+0000", 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026748969999999999 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.081654+0000", 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7644e-05 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092752+0000", 2024-04-23T19:02:32.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011097164 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.092839+0000", 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7491999999999995e-05 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2299 3.f 3:f2287333:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.994943958999997, 2024-04-23T19:02:32.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023125123000000001, 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2299 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114216+0000", 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5100000000000001e-06 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119361+0000", 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051446879999999997 2024-04-23T19:02:32.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119396+0000", 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5812999999999997e-05 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119414+0000", 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7269999999999999e-05 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119583+0000", 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016943199999999999 2024-04-23T19:02:32.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119990+0000", 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040668900000000001 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.120394+0000", 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403755 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.129091+0000", 2024-04-23T19:02:32.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086969969999999997 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137017+0000", 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079263489999999992 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137206+0000", 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018926500000000001 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137339+0000", 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013235499999999999 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2311 3.d 3:b2884c89:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.874101033999999, 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022499029, 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.192 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2311 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235060+0000", 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7759999999999999e-06 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238950+0000", 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038900689999999999 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238993+0000", 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3303000000000002e-05 2024-04-23T19:02:32.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239013+0000", 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9879999999999999e-05 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239210+0000", 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019640400000000001 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.195 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239612+0000", 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040218900000000001 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.240031+0000", 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041938899999999999 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254300+0000", 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014269097 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257380+0000", 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003079104 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257481+0000", 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101325 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257555+0000", 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4493000000000007e-05 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2652 3.39 3:9c01ed3a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.988245+0000", 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 20.120912390000001, 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02132655, 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2652 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.988245+0000", 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.988245+0000", 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.988249+0000", 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.992812+0000", 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004562918 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.992846+0000", 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4762999999999999e-05 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.992862+0000", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5803000000000001e-05 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.993011+0000", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014871700000000001 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.993278+0000", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026674199999999999 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.993509+0000", 2024-04-23T19:02:32.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023129199999999999 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.004325+0000", 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010816180999999999 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.009389+0000", 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005063807 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.009492+0000", 2024-04-23T19:02:32.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103155 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.009572+0000", 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9371999999999998e-05 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.824155510000001, 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:32.203 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:32.206 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.208 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.590911166000001, 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:32.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:32.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:32.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:32.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 19.499365170000001, 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.214 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:32.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:32.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:32.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:32.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.219 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2746 3.3f 3:fed341fe:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.195344+0000", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 18.913813292, 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020671393, 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2746 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.195344+0000", 2024-04-23T19:02:32.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.195344+0000", 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.195347+0000", 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4279999999999999e-06 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:32.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199631+0000", 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042849289999999998 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199651+0000", 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9769e-05 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199661+0000", 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3109999999999995e-06 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:32.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199728+0000", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7854999999999993e-05 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199853+0000", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124516 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.199951+0000", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7955999999999995e-05 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.209126+0000", 2024-04-23T19:02:32.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0091746940000000006 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.215880+0000", 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067540849999999999 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.215952+0000", 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1909999999999994e-05 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.216015+0000", 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3940000000000001e-05 2024-04-23T19:02:32.224 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.225 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.225 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.225 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:32.225 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:32.225 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:32.227 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:32.228 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:32.225+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:32.327 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:32.325+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:32.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:32.348 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:32.348 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:32.348 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:32.363 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:32.428 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:32.428+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:32.478 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:32.478 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:32.496 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:32.496 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:32.512 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:32.512 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:32.527 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:32.527 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:32.528 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:32.528+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:32.529 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:32.529 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:32.542 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:32.549 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:32.550 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:32.570 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:32.570 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:32.590 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:32.590 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:32.610 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:32.611 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:32.629 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:32.628+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:32.653 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:32.654 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:32.667 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:32.730 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:32.732+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:32.823 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:32.823 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:32.830 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:32.832+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:32.836 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:32.932 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:32.932+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:32.972 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:32.973 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:32.993 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:33.041 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:33.041+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:33.134 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:33.134 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:33.135 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:33.136+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:33.153 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:33.235 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:33.236+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:33.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:02:33.336 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:33.333+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:33.362 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:33.363 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:33.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:33.478 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:33.477+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:33.538 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:33.536+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:33.579 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:33.579 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:33.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:33.639 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:33.640+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:33.739 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:33.740+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:33.792 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:33.792 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:33.809 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:33.840 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:33.840+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:33.941 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:33.941+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:33.962 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:33.962 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:33.981 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:34.069 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:34.069+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:34.145 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:34.144+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:34.180 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:34.180 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:34.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:34.244 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:34.244+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:34.264 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:02:34.344 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:34.341+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:34.389 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:34.389 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:34.408 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:34.449 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:34.449+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:34.546 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:34.545+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:34.568 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:34.568 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:34.589 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:34.629 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:34.647 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:34.648+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:34.718 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:34.719 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:34.736 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:34.748 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:34.745+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:34.795 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:34.796 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:34.816 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:34.817 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:34.837 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:34.837 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:34.849 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:34.848+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:34.858 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:34.858 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:34.883 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:34.884 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:34.922 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:34.922 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:34.927 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:34.927 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:34.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:34.927 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:34.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.927 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.022330070000002, 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:34.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:34.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:34.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.825939466000001, 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:34.933 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:34.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:34.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:34.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2149 3.34 3:2cea273a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.713130772, 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021140994, 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.939 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2149 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212889+0000", 2024-04-23T19:02:34.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.212892+0000", 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.467e-06 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217205+0000", 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043131760000000002 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217228+0000", 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2418000000000001e-05 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217239+0000", 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1412e-05 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217318+0000", 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8702000000000006e-05 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217462+0000", 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000144709 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.217579+0000", 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116148 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.224348+0000", 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067698649999999999 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233883+0000", 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095350469999999996 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233966+0000", 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2929999999999994e-05 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.234030+0000", 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3120000000000006e-05 2024-04-23T19:02:34.944 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.224558405000003, 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.945 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.074252186000002, 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.951 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:34.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:34.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.963803153000001, 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:34.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:34.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.411877509, 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:34.961 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:34.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:34.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2268 3.14 3:2ba4b39e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.216378933999998, 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020214612999999999, 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2268 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709640+0000", 2024-04-23T19:02:34.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.709645+0000", 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9760000000000003e-06 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714829+0000", 2024-04-23T19:02:34.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005184063 2024-04-23T19:02:34.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714872+0000", 2024-04-23T19:02:34.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2616e-05 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.714892+0000", 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0196000000000001e-05 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715073+0000", 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018083500000000001 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715417+0000", 2024-04-23T19:02:34.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034398600000000001 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.715794+0000", 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037700899999999998 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.726789+0000", 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010995351 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729668+0000", 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002878673 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729767+0000", 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9122000000000004e-05 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.729855+0000", 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7786000000000003e-05 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.122563716999998, 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.974 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:34.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.979902805000002, 2024-04-23T19:02:34.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:34.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:34.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:34.986 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.958884265000002, 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:34.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:34.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.848539209999998, 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.991 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:34.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:34.993 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:34.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:34.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.997 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2301 3.1b 3:d9dbc542:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 58.794477575999998, 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020609056000000001, 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2301 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:34.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131542+0000", 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.131546+0000", 2024-04-23T19:02:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136048+0000", 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045015460000000004 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136084+0000", 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6519000000000001e-05 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136102+0000", 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7600000000000001e-05 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136302+0000", 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020015399999999999 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.136722+0000", 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042011000000000001 2024-04-23T19:02:35.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137159+0000", 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043732800000000001 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.147621+0000", 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010461939999999999 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.151975+0000", 2024-04-23T19:02:35.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043534840000000003 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152074+0000", 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9592000000000005e-05 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152151+0000", 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6463000000000003e-05 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.003 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.546662920999999, 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.004 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:35.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.972139678000001, 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.010 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:35.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:35.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:35.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2659 3.31 e74/20 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head v 74'9, mlcod=74'7)", 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.840066772, 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020828660999999998, 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085953+0000", 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.085955+0000", 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5940000000000001e-06 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093827+0000", 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078715069999999998 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093857+0000", 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9963000000000001e-05 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.093873+0000", 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6609999999999999e-05 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094012+0000", 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013919099999999999 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.094079+0000", 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6148000000000004e-05 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106678+0000", 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012599880000000001 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.106781+0000", 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102768 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:35.020 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.749778730999999, 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:35.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:35.024 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.674161368, 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.025 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:35.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:35.030 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.581792564000001, 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:35.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:35.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 21.448655145, 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.037 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.042 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.043 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.043 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.043 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.043 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:35.044 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:35.044 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:35.045 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:35.045 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:35.046 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:35.046 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:35.041+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:35.145 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:35.141+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:35.233 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:35.233 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:35.234 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:35.234 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:35.245 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:35.245+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:35.251 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:35.346 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:35.348+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:35.381 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:35.381 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:35.382 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:35.382 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:35.382 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:35.398 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:35.447 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:35.445+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:35.548 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:35.548+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:1110 3.5 3:a1ced413:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.1__shadow_.NRDn3c6Gn4cMM8QZRuLfvYeCt3PzlKZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-23T19:02:35.594 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 74.733027630999999, 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022305736999999999, 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1110 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861108+0000", 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.861112+0000", 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865351+0000", 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042393099999999996 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865379+0000", 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8552999999999999e-05 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865393+0000", 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3648e-05 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865588+0000", 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019488799999999999 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.865832+0000", 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024437299999999999 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.866087+0000", 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025493400000000001 2024-04-23T19:02:35.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.882113+0000", 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016025509 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883250+0000", 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011375790000000001 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883340+0000", 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9735999999999996e-05 2024-04-23T19:02:35.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:20.883414+0000", 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4018999999999997e-05 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.371506384, 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:35.600 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2210 3.3c 3:3e836e23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.707153966, 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021835849000000001, 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2210 2024-04-23T19:02:35.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886982+0000", 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.886987+0000", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1730000000000003e-06 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891003+0000", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040162210000000004 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891042+0000", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8621999999999997e-05 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891061+0000", 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8559999999999998e-05 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891198+0000", 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013758600000000001 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891445+0000", 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024675700000000001 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.891706+0000", 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026106300000000002 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.898584+0000", 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068777969999999997 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908514+0000", 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099306570000000007 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908692+0000", 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017737499999999999 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.908818+0000", 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126038 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:35.611 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.684995456000003, 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:35.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:35.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:35.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:35.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.537071341000001, 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.617 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:35.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:35.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:35.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.486130271, 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.627 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.482267071999999, 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.972244445000001, 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:35.633 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.637 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.952719991000002, 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:35.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:35.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.896186686999997, 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.643 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:35.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:35.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.647 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.648 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2273 3.c 3:32fdbe74:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.820559291000002, 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022260156999999999, 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2273 2024-04-23T19:02:35.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773577+0000", 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.773581+0000", 2024-04-23T19:02:35.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9740000000000004e-06 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779566+0000", 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059857310000000002 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779619+0000", 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2618999999999999e-05 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779647+0000", 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7603e-05 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779823+0000", 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017656200000000001 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780062+0000", 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.652 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.780286+0000", 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000224114 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787802+0000", 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075158550000000001 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795634+0000", 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078323049999999995 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.653 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795749+0000", 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115585 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.795837+0000", 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7418999999999998e-05 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.654 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.619471156000003, 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:35.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:35.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:35.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:35.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.410579075000001, 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.660 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:35.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.089200959999999, 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:35.666 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.667 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.668 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.669 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.670 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.671 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.496730680999999, 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:35.672 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.673 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:35.674 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:35.675 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.954340223999999, 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.676 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.677 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.678 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.679 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.680 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2726 3.30 3:0ce56bcb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.713533473999998, 2024-04-23T19:02:35.681 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021924124999999999, 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2726 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.682 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880603+0000", 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.880606+0000", 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8e-06 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884605+0000", 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039984160000000003 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.683 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884644+0000", 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8813000000000003e-05 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884662+0000", 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8145999999999999e-05 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884745+0000", 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2955999999999997e-05 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.684 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884863+0000", 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011857 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.884968+0000", 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105176 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.889496+0000", 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004527522 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.685 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902433+0000", 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012937277 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902485+0000", 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2188000000000002e-05 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.902527+0000", 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1260999999999997e-05 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.686 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2732 3.5 3:a290817c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.621184997, 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022383746999999999, 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2732 2024-04-23T19:02:35.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972951+0000", 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.972955+0000", 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7529999999999999e-06 2024-04-23T19:02:35.688 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.976996+0000", 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040414190000000001 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977054+0000", 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8202000000000003e-05 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977081+0000", 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6533000000000002e-05 2024-04-23T19:02:35.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977243+0000", 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016217400000000001 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977497+0000", 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025378800000000002 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977735+0000", 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023839600000000001 2024-04-23T19:02:35.690 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.989236+0000", 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011500776000000001 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995095+0000", 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058587800000000001 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995196+0000", 2024-04-23T19:02:35.691 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010110799999999999 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.995335+0000", 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138818 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2767 3.38 e75/20 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head v 75'8, mlcod=74'6)", 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.101931465, 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022125346000000001, 2024-04-23T19:02:35.692 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.693 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492205+0000", 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1999999999999998e-07 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496255+0000", 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040496459999999996 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496290+0000", 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999000000000002e-05 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.694 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496307+0000", 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496440+0000", 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013291099999999999 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.496482+0000", 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1802999999999999e-05 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.695 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514167+0000", 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017685523000000002 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.514330+0000", 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000162724 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3191 3.c 3:3340fe65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:35.696 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.53619082100000004, 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034282769999999997, 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3191 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:02:35.697 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057950+0000", 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5569999999999997e-06 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063293+0000", 2024-04-23T19:02:35.698 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053432419999999998 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063340+0000", 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7191999999999998e-05 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063367+0000", 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6347e-05 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063565+0000", 2024-04-23T19:02:35.699 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019835999999999999 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063919+0000", 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035387599999999998 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.064156+0000", 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023711700000000001 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.073363+0000", 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092073729999999996 2024-04-23T19:02:35.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092068+0000", 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018704971000000001 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092156+0000", 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7303000000000001e-05 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092228+0000", 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2432e-05 2024-04-23T19:02:35.701 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.702 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.702 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.702 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:35.702 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:35.702 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:35.703 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:35.704 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:35.704+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:35.805 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:35.801+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:35.880 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:35.881 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:35.881 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:35.881 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:35.899 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:35.905 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:35.905+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:36.006 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:36.008+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:36.027 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:36.027 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:36.028 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:36.028 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:36.028 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:36.047 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:36.135 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:36.136+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:36.208 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:36.205+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:36.230 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.132203748999999, 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:36.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.237 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.541103559, 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.238 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:36.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.243 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2274 3.2c 3:343816ad:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.444825072999997, 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022932381000000002, 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2274 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.244 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783500+0000", 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.783504+0000", 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9659999999999998e-06 2024-04-23T19:02:36.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787860+0000", 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043557650000000002 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787899+0000", 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8924000000000002e-05 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.787917+0000", 2024-04-23T19:02:36.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7816e-05 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788085+0000", 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168142 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788453+0000", 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036814500000000001 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788686+0000", 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023307699999999999 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.804646+0000", 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015960227 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806156+0000", 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0015099219999999999 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806316+0000", 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015984199999999999 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.806433+0000", 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116555 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.249 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.181149052000002, 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:36.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:36.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.252 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:36.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.076034505999999, 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.255 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:36.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:36.260 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 59.929461322999998, 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.261 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:36.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:36.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:36.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.611623890000001, 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.267 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:36.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:36.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.272 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.602443531999999, 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.273 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.274 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.275 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.276 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.277 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.592981042000002, 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.278 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.279 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.280 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.281 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:36.282 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:36.283 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.573620793, 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.284 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.285 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.286 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.287 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.288 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:36.289 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.058486774999999, 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.290 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.291 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.292 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:36.293 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:36.294 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.047005549000001, 2024-04-23T19:02:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:36.296 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.297 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.298 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.299 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:36.300 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2696 3.26 3:64250b99:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.749029363999998, 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023196560000000001, 2024-04-23T19:02:36.301 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2696 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.302 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479296+0000", 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.479299+0000", 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.576e-06 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483218+0000", 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003919774 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.303 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483251+0000", 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3145999999999997e-05 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483269+0000", 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7975999999999999e-05 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483360+0000", 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0916999999999997e-05 2024-04-23T19:02:36.304 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483543+0000", 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183117 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.483710+0000", 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016664100000000001 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.492065+0000", 2024-04-23T19:02:36.305 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083545400000000006 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502380+0000", 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010315718 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502442+0000", 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1897999999999996e-05 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.306 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.502493+0000", 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0256999999999997e-05 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.608755243000001, 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.307 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.308 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.309 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:36.310 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:36.311 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.312 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 23.269527777, 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.313 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:36.314 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:36.315 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.316 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:36.317 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.318 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2778 3.a 3:517c3c8c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 22.608646610000001, 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021706072, 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2778 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.319 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619679+0000", 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.320 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.619682+0000", 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1200000000000002e-06 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623671+0000", 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887489999999998 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623703+0000", 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2465999999999997e-05 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.321 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623719+0000", 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6226e-05 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.623882+0000", 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016293699999999999 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624278+0000", 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039613300000000001 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.322 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.624707+0000", 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042824600000000002 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.633735+0000", 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090279169999999999 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641200+0000", 2024-04-23T19:02:36.323 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074658709999999998 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641297+0000", 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6644999999999994e-05 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.641385+0000", 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7762000000000004e-05 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.324 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3232 3.35 3:acc6f285:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.68076473199999998, 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028471888000000001, 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3232 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.325 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.326 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547564+0000", 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5030000000000002e-06 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551650+0000", 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040853879999999997 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551687+0000", 2024-04-23T19:02:36.327 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551705+0000", 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8292999999999999e-05 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551811+0000", 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010588 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552012+0000", 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020039400000000001 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552177+0000", 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016578200000000001 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.560222+0000", 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080445789999999996 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.329 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575904+0000", 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015681898 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575974+0000", 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0353999999999998e-05 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.576032+0000", 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8273999999999998e-05 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.330 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3271 3.10 3:08e03d87:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_286:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.079464+0000", 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.14886112000000001, 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022675958, 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3271 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.331 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.079464+0000", 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.079464+0000", 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.079467+0000", 2024-04-23T19:02:36.332 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1159999999999999e-06 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.083432+0000", 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039646830000000001 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.083466+0000", 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3822999999999998e-05 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.083483+0000", 2024-04-23T19:02:36.333 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7367000000000002e-05 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.083616+0000", 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013255799999999999 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.083764+0000", 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014816699999999999 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.334 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.083892+0000", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012844500000000001 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.090990+0000", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070979950000000002 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.102003+0000", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011012747 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.102079+0000", 2024-04-23T19:02:36.335 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5888000000000003e-05 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.102140+0000", 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1168999999999997e-05 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3274 3.2c 3:3585b04d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_289:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.118988+0000", 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.10933743, 2024-04-23T19:02:36.336 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024029083999999999, 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3274 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.118988+0000", 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.337 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.118988+0000", 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.118992+0000", 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7730000000000001e-06 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.124436+0000", 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054438450000000001 2024-04-23T19:02:36.338 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.124474+0000", 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8132e-05 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.124490+0000", 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6736999999999999e-05 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.124583+0000", 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2118000000000001e-05 2024-04-23T19:02:36.339 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.124740+0000", 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.124869+0000", 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012962800000000001 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.132496+0000", 2024-04-23T19:02:36.340 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0076264990000000001 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.142845+0000", 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010349659000000001 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.142940+0000", 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4875000000000002e-05 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.341 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.143017+0000", 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6731999999999996e-05 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3277 3.20 3:07927c3a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.066738858999999998, 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025815983000000001, 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.342 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3277 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.343 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161590+0000", 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167310+0000", 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057198709999999996 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167348+0000", 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7756000000000002e-05 2024-04-23T19:02:36.344 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167366+0000", 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7966999999999999e-05 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167470+0000", 2024-04-23T19:02:36.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104619 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167656+0000", 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018610400000000001 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167824+0000", 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016765399999999999 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.346 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.175871+0000", 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080470520000000007 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187276+0000", 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011404765000000001 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187342+0000", 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6171000000000001e-05 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187402+0000", 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0324e-05 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.348 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:36.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:02:36.350 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:36.351 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:36.349+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:36.451 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:36.449+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:36.540 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:36.540 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:36.540 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:36.540 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:36.552 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:36.552+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:36.558 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:36.653 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:36.649+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:36.746 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:36.746 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:36.746 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:36.746 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:36.746 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:36.754 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:36.753+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:36.764 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:36.855 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:36.853+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:36.901 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 153.725656402, 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.902 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:36.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.908 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 152.993007116, 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022653952000000002, 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 115 2024-04-23T19:02:36.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903753+0000", 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903755+0000", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.103e-06 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903912+0000", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000156656 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903928+0000", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6460000000000002e-05 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903938+0000", 2024-04-23T19:02:36.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7429999999999997e-06 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.921885+0000", 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017947225000000001 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922025+0000", 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014004499999999999 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.922382+0000", 2024-04-23T19:02:36.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035667099999999997 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925157+0000", 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027752609999999998 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926269+0000", 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011117449999999999 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926346+0000", 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.7065999999999997e-05 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926407+0000", 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0977000000000002e-05 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:36.914 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 152.992803815, 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 152.992764631, 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.920 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:36.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:36.925 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.779977907000003, 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:36.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.20439236, 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:36.930 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:36.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:36.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.934 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 61.132232062, 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:36.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:36.939 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:36.940 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2299 3.f 3:f2287333:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.782546631000002, 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023125123000000001, 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.941 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2299 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114213+0000", 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.114216+0000", 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5100000000000001e-06 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119361+0000", 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051446879999999997 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119396+0000", 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5812999999999997e-05 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119414+0000", 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7269999999999999e-05 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119583+0000", 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016943199999999999 2024-04-23T19:02:36.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.119990+0000", 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040668900000000001 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.120394+0000", 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403755 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.129091+0000", 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086969969999999997 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137017+0000", 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079263489999999992 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137206+0000", 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018926500000000001 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.137339+0000", 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013235499999999999 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.947 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2311 3.d 3:b2884c89:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 60.661703705999997, 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022499029, 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2311 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235056+0000", 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.235060+0000", 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7759999999999999e-06 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238950+0000", 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038900689999999999 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.238993+0000", 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3303000000000002e-05 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239013+0000", 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9879999999999999e-05 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239210+0000", 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019640400000000001 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.239612+0000", 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040218900000000001 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.240031+0000", 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041938899999999999 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.254300+0000", 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014269097 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257380+0000", 2024-04-23T19:02:36.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003079104 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257481+0000", 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101325 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.257555+0000", 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4493000000000007e-05 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.953 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.611758181999999, 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:36.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:36.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.378513838, 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.962 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:36.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:36.968 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 24.286967841999999, 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:36.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:36.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3237 3.11 3:88eeb296:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_252:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.601945+0000", 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 1.294814951, 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022772522999999999, 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3237 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.601945+0000", 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.601945+0000", 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.601948+0000", 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.393e-06 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.607091+0000", 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051426450000000004 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.607128+0000", 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6473000000000001e-05 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.607153+0000", 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.552e-05 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.607319+0000", 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000165971 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.607709+0000", 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038955800000000003 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.607971+0000", 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026202700000000002 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.623743+0000", 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015772424 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.624367+0000", 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00062414299999999996 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.624577+0000", 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020980900000000001 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.624718+0000", 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014056 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.980 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3268 3.3b 3:dfb847be:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_283:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.037151+0000", 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.85960894300000001, 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023332707000000001, 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3268 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.037151+0000", 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.037151+0000", 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.037155+0000", 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4869999999999998e-06 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.041337+0000", 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041824160000000004 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.041384+0000", 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7139999999999999e-05 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.041414+0000", 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9696000000000002e-05 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.041570+0000", 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015654800000000001 2024-04-23T19:02:36.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.041891+0000", 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032101900000000002 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.042171+0000", 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027981399999999997 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.054181+0000", 2024-04-23T19:02:36.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012009847000000001 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.060296+0000", 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0061152489999999997 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.060400+0000", 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000103865 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.986 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.060484+0000", 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3626000000000002e-05 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3280 3.e 3:72bf3fdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.68898009599999999, 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024559213999999999, 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.987 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3280 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207813+0000", 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2722999999999998e-05 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212197+0000", 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004383957 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212238+0000", 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.125e-05 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212257+0000", 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9306000000000001e-05 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212433+0000", 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017601100000000001 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212836+0000", 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403015 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.213267+0000", 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043089499999999999 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.230772+0000", 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017505107999999998 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232238+0000", 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014662810000000001 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232301+0000", 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2293999999999997e-05 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232339+0000", 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8374000000000002e-05 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.992 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3287 3.37 3:ef4edada:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.57709049199999995, 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034068071999999998, 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.993 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3287 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319673+0000", 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1329999999999999e-06 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324894+0000", 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052214999999999996 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324940+0000", 2024-04-23T19:02:36.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5853000000000003e-05 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324960+0000", 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0182000000000001e-05 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325156+0000", 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195878 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:36.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325587+0000", 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000430455 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325994+0000", 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040785799999999998 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353421+0000", 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027426841 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353479+0000", 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7908999999999997e-05 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353578+0000", 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8381999999999994e-05 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353738+0000", 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016008099999999999 2024-04-23T19:02:36.998 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3288 3.37 3:ee2739c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.56129405300000001, 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029560090000000001, 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:36.999 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3288 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335469+0000", 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.416e-06 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342301+0000", 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00683207 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342341+0000", 2024-04-23T19:02:37.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0009999999999998e-05 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342368+0000", 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6913000000000001e-05 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342655+0000", 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028621000000000001 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:37.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343067+0000", 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041280100000000002 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343543+0000", 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047600700000000003 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.355012+0000", 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011468734 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:37.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364851+0000", 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098389810000000001 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364953+0000", 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010220199999999999 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.365026+0000", 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2745999999999998e-05 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3307 3.26 e88/20 3:6465c41c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_322:head v 88'17, mlcod=88'15)", 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.573950+0000", 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.32281011100000001, 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023079311000000002, 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573950+0000", 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573950+0000", 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573953+0000", 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9019999999999999e-06 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.576415+0000", 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002461918 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.576454+0000", 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8930999999999997e-05 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.576476+0000", 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2668e-05 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.576617+0000", 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140285 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.576666+0000", 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9110000000000002e-05 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.596897+0000", 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020231272000000002 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597029+0000", 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132225 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.008 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3310 3.f 3:f200fb1e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.600812+0000", 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.295947872, 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022382404000000002, 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:37.009 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3310 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.600812+0000", 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.600812+0000", 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.600814+0000", 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0619999999999999e-06 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.604489+0000", 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0036749040000000001 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.604508+0000", 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9191e-05 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.604519+0000", 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0978000000000001e-05 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.604694+0000", 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017460300000000001 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.604957+0000", 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026324999999999997 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.605245+0000", 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000287683 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.622625+0000", 2024-04-23T19:02:37.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017380542999999998 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.623048+0000", 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042250000000000002 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.623131+0000", 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3294000000000006e-05 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.623195+0000", 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3396000000000001e-05 2024-04-23T19:02:37.015 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3323 3.d 3:b18a8ac6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_338:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.739609+0000", 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 0.15715117300000001, 2024-04-23T19:02:37.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023453985, 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:37.017 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3323 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.739609+0000", 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.739609+0000", 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.739612+0000", 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.54e-06 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.743611+0000", 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039990590000000001 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.743653+0000", 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1749000000000003e-05 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.743672+0000", 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8790000000000001e-05 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.020 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.743770+0000", 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7894999999999997e-05 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.743990+0000", 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021974700000000001 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.744131+0000", 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014160799999999999 2024-04-23T19:02:37.021 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.759900+0000", 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015768671000000001 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.762897+0000", 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002997422 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.762990+0000", 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2930999999999995e-05 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.763063+0000", 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2572999999999998e-05 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:37.023 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:37.025 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:37.024+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:37.025 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:37.047 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:37.125 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:37.124+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:37.166 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:37.166 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:37.166 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:37.166 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:37.194 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:37.227 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:37.228+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:37.240 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:37.241 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:37.264 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:37.264 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:37.284 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:02:37.293 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:37.293 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:37.327 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:37.328 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:37.328 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:37.325+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:37.349 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:37.349 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:37.362 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:37.362 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:37.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:37.388 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:37.389 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:37.427 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:37.427 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:37.428 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:37.425+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:37.457 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:37.457 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:37.529 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:37.528+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:37.540 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:37.540 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:37.558 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:37.630 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:37.632+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:37.731 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:37.729+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:37.732 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:37.732 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:37.755 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:37.846 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:37.845+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:37.933 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:37.933+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:37.954 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:37.954 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:37.976 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:38.062 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:38.061+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:38.135 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:38.133+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:38.158 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:38.158 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:38.178 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:38.236 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:38.236+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:38.337 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:38.336+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:38.359 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:38.360 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:38.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:38.466 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:38.465+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:38.538 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:38.537+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:38.549 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:38.549 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:38.562 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:38.619 INFO:tasks.workunit.client.0.smithi169.stdout:quota disabled for the bucket: buck_2024_03_23_19_02_28 2024-04-23T19:02:38.619 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 2Gb. 2024-04-23T19:02:38.619 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:02:38.620 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:02:38.620 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-04-23T19:02:38.620 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:02:38.639 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:38.637+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:38.729 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:38.729 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:38.740 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:38.737+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:38.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:38.841 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:38.837+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:38.893 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:02:38.893 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:02:38.901 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:38.902 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:38.916 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:38.958 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:38.957+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:39.043 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:39.044+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:39.079 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:39.079 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:39.093 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:39.144 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:39.144+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:39.221 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:39.240 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:39.286 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:39.288+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:39.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:02:39.345 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:39.344+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:39.379 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:39.379 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:39.393 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:39.478 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:39.480+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:39.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:39.546 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:39.545+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:39.558 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:39.559 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:39.573 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:39.634 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:39.635 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:39.647 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:39.645+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:39.652 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:39.652 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:39.669 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:39.670 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:39.686 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:39.686 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:39.696 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:02:39.711 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:39.711 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:39.731 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:39.731 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:39.743 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:39.744 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:39.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:39.744 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:39.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2119 3.34 3:2fb5da45:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.838457886, 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021382766000000001, 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.745 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2119 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903689+0000", 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.903692+0000", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9239999999999999e-06 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907635+0000", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039425850000000002 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907661+0000", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5979999999999999e-05 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907676+0000", 2024-04-23T19:02:39.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4868000000000001e-05 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907768+0000", 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2268999999999994e-05 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.907925+0000", 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015739000000000001 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.908085+0000", 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015969899999999999 2024-04-23T19:02:39.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.921640+0000", 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013555529 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924926+0000", 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032854400000000001 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.924990+0000", 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4089000000000003e-05 2024-04-23T19:02:39.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:33.925072+0000", 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1992999999999999e-05 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2138 3.9 3:9298cf7f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.642067281999999, 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024416211, 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.750 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2138 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100080+0000", 2024-04-23T19:02:39.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.100102+0000", 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1807e-05 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108063+0000", 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079617179999999996 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108094+0000", 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0738999999999998e-05 2024-04-23T19:02:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108111+0000", 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7329999999999998e-05 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108211+0000", 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9988999999999994e-05 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108363+0000", 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015118299999999999 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.108479+0000", 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011643500000000001 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.115313+0000", 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068342180000000004 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124406+0000", 2024-04-23T19:02:39.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090923380000000002 2024-04-23T19:02:39.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124457+0000", 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.126e-05 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.124496+0000", 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9193999999999998e-05 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2200 3.1a 3:5aa85bd4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:39.756 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.040686221000001, 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022650719, 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2200 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701461+0000", 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.701464+0000", 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3859999999999999e-06 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707066+0000", 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005601867 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707109+0000", 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2432999999999998e-05 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707127+0000", 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8533e-05 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707213+0000", 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5728000000000003e-05 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707322+0000", 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010937099999999999 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.707419+0000", 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6628999999999999e-05 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.714350+0000", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069315069999999999 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724042+0000", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096914199999999992 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724081+0000", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9118000000000001e-05 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.724112+0000", 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0726999999999999e-05 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.890380002000001, 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.762 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2213 3.24 e56/20 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:39.767 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.779930969000006, 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023028956999999999, 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962216+0000", 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.962218+0000", 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9089999999999998e-06 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967194+0000", 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049758069999999996 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967222+0000", 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8377999999999998e-05 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967235+0000", 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2923e-05 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967371+0000", 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013552 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.967412+0000", 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1607000000000003e-05 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985156+0000", 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017743484 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.985245+0000", 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9328999999999998e-05 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.771 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2254 3.1a 3:5b440595:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.228005324999998, 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022480555999999999, 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2254 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:39.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514142+0000", 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.514144+0000", 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.458e-06 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518883+0000", 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0047388660000000004 2024-04-23T19:02:39.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518909+0000", 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5891e-05 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.518925+0000", 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5875e-05 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519010+0000", 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5189e-05 2024-04-23T19:02:39.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519156+0000", 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145668 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.519284+0000", 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128267 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.525636+0000", 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063522989999999996 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536305+0000", 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010668629000000001 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536501+0000", 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196345 2024-04-23T19:02:39.776 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.536622+0000", 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121069 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:39.777 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.938691532999997, 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:39.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:02:39.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.782 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.796030621, 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:02:39.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:39.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2286 3.1d e57/42 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head v 57'2, mlcod=0'0)", 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.775012081, 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021737731999999999, 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967135+0000", 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.967138+0000", 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8729999999999999e-06 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971600+0000", 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044624110000000003 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971654+0000", 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3338999999999999e-05 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2860000000000001e-05 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971826+0000", 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014913099999999999 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971878+0000", 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2596999999999998e-05 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988773+0000", 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016894822 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.988873+0000", 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9698999999999995e-05 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 63.664667026000004, 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.792 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:02:39.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.362790737000001, 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2649 3.34 3:2cdad181:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.788267493999999, 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022774553999999999, 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2649 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953880+0000", 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.953883+0000", 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.23e-06 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958872+0000", 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049887500000000001 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958911+0000", 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9388999999999998e-05 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.958929+0000", 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8176999999999999e-05 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959107+0000", 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017735299999999999 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959365+0000", 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025874200000000001 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.959605+0000", 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024000900000000001 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.974726+0000", 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015120487 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976351+0000", 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0016254660000000001 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976530+0000", 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017916699999999999 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.976654+0000", 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012378399999999999 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:39.808 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.565906547000001, 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:02:39.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:02:39.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:39.812 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.490289184000002, 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:39.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:02:39.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:39.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:02:39.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2683 3.14 3:296d46ca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.397920379999999, 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022100152000000001, 2024-04-23T19:02:39.818 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2683 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344227+0000", 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.344230+0000", 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:02:39.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349242+0000", 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050114779999999998 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349281+0000", 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8732000000000001e-05 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349301+0000", 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0043000000000001e-05 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349440+0000", 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139531 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349683+0000", 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024318199999999999 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.349912+0000", 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000228316 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.364458+0000", 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014546263 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366219+0000", 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0017615790000000001 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366269+0000", 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9223e-05 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.366327+0000", 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8221999999999999e-05 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 26.264782961000002, 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3281 3.14 3:2a562768:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_296:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.223866+0000", 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.5182814059999998, 2024-04-23T19:02:39.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024525669, 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3281 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.223866+0000", 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.223866+0000", 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.223869+0000", 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999999999999999e-06 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.231871+0000", 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080015090000000004 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.231903+0000", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2264999999999997e-05 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.231920+0000", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232083+0000", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016292100000000001 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232441+0000", 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035839200000000002 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232675+0000", 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234114 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.244276+0000", 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011600586 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.248264+0000", 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887610000000004 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.248334+0000", 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9078999999999994e-05 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.248391+0000", 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7844999999999999e-05 2024-04-23T19:02:39.835 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3351 3.f e88/20 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head v 88'17, mlcod=88'15)", 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.142186+0000", 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.5999607610000002, 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026165384, 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.142186+0000", 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.142186+0000", 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.142190+0000", 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148420+0000", 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0062304539999999999 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148472+0000", 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1706000000000003e-05 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148498+0000", 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6013e-05 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148699+0000", 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166100000000001 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148769+0000", 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9706e-05 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168211+0000", 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019441614999999999 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168352+0000", 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141049 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3353 3.1a 3:598f95a5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_368:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.156302+0000", 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.5858454800000001, 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022556716000000001, 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.840 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3353 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.156302+0000", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.156302+0000", 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.156305+0000", 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.27e-06 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.161998+0000", 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056926670000000002 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.162048+0000", 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0670000000000001e-05 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.162075+0000", 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7206e-05 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.162217+0000", 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141822 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.162477+0000", 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025962400000000002 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.162718+0000", 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024126 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.175548+0000", 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012830326 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.178689+0000", 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031402700000000001 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.178787+0000", 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8515000000000001e-05 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.178858+0000", 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1086000000000003e-05 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3355 3.3 3:c323f778:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_370:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.179169+0000", 2024-04-23T19:02:39.845 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.5629776469999999, 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024284851999999999, 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3355 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.179169+0000", 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.179169+0000", 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.179172+0000", 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.723e-06 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.183227+0000", 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040551490000000001 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.183264+0000", 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6633e-05 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.183287+0000", 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3153e-05 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.183439+0000", 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015180200000000001 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.183689+0000", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000249707 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.183915+0000", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022614299999999999 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.194161+0000", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010246254 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:39.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203242+0000", 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0090814039999999995 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203342+0000", 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9819000000000001e-05 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203454+0000", 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011206500000000001 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.850 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:39.851 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:39.851 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:39.851 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:39.852 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:39.852 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:39.853 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:39.853 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:39.852+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:39.854 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:39.952 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:39.949+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:40.022 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:40.023 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:40.023 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:40.023 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:40.037 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:40.054 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:40.053+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:40.155 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:40.156+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:40.161 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:40.161 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:40.161 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:40.175 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:40.256 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:40.253+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 66.120214378, 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.346 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.347 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.348 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.348 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:02:40.348 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.348 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.348 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.349 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.350 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:02:40.351 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:02:40.352 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.433703449999996, 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.353 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:02:40.354 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:02:40.355 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:02:40.356 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.357 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.358 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.285779335000001, 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.359 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.360 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.361 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:02:40.362 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.363 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.364 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.234838264999993, 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.365 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.366 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:02:40.367 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:02:40.368 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:02:40.369 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.370 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.230975065999999, 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.371 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.372 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:02:40.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:02:40.373 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.373 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.373 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.373 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:02:40.373 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:02:40.374 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.375 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.376 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.377 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:02:40.378 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2261 3.38 e57/20 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.720952439000001, 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023513808000000001, 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.379 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621892+0000", 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.380 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.621894+0000", 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1830000000000001e-06 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626372+0000", 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044787200000000003 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626399+0000", 2024-04-23T19:02:40.381 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6274e-05 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626415+0000", 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.588e-05 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626606+0000", 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191487 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.382 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.626650+0000", 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3835999999999998e-05 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645130+0000", 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018480164 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.645405+0000", 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000275264 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.383 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.701427984999995, 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.384 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.385 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.386 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.387 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:02:40.388 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:02:40.389 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.390 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2267 3.16 3:6819ea50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.644894680999997, 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023408195999999999, 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.391 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2267 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697949+0000", 2024-04-23T19:02:40.392 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.697953+0000", 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.014e-06 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702373+0000", 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044198350000000004 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.393 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702425+0000", 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1892999999999999e-05 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702445+0000", 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9576e-05 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702608+0000", 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163005 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.702905+0000", 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029755899999999997 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.703142+0000", 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023641100000000001 2024-04-23T19:02:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.716645+0000", 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013503128 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721119+0000", 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004474614 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721257+0000", 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013756599999999999 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.721358+0000", 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010059499999999999 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2287 3.16 3:6a51c60f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.368179150000003, 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023356503000000001, 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2287 2024-04-23T19:02:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974665+0000", 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.974670+0000", 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.826e-06 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982209+0000", 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075392890000000002 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982264+0000", 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4719999999999998e-05 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982292+0000", 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8092000000000001e-05 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982455+0000", 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163432 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982713+0000", 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025811299999999997 2024-04-23T19:02:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.982955+0000", 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241821 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.991043+0000", 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080874350000000005 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997784+0000", 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067409410000000003 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.997898+0000", 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011448899999999999 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.998021+0000", 2024-04-23T19:02:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012334499999999999 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2306 3.3c 3:3e031310:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.159287069000001, 2024-04-23T19:02:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023654026000000002, 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2306 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183557+0000", 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.183560+0000", 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4199999999999999e-06 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188853+0000", 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052923149999999997 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188899+0000", 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6536999999999998e-05 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.188919+0000", 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0112999999999999e-05 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189055+0000", 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000135251 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189326+0000", 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000270971 2024-04-23T19:02:40.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.189561+0000", 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023542800000000001 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.196521+0000", 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069598680000000001 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207032+0000", 2024-04-23T19:02:40.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010511598 2024-04-23T19:02:40.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.411 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.411 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207134+0000", 2024-04-23T19:02:40.411 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101536 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.207211+0000", 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6989000000000004e-05 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.412 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.837908954, 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.413 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:02:40.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:02:40.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:02:40.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2660 3.17 e74/20 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head v 74'3, mlcod=56'1)", 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.245438674999999, 2024-04-23T19:02:40.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024901515999999999, 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:40.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097405+0000", 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.097409+0000", 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4139999999999998e-06 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102699+0000", 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052907329999999997 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102747+0000", 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7961999999999999e-05 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102772+0000", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4805999999999999e-05 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.102941+0000", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016858699999999999 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.103010+0000", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9402999999999999e-05 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122166+0000", 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019156023000000001 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.122307+0000", 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000140588 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2712 3.3c 3:3f0ea552:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.703048217999999, 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023378809, 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.426 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2712 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:40.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639796+0000", 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.639798+0000", 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2570000000000002e-06 2024-04-23T19:02:40.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.643982+0000", 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041834819999999997 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644037+0000", 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5133000000000002e-05 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644062+0000", 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5643000000000002e-05 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644220+0000", 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015741099999999999 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644393+0000", 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173246 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644490+0000", 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7388999999999999e-05 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.651570+0000", 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0070799770000000003 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663096+0000", 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011526065 2024-04-23T19:02:40.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663140+0000", 2024-04-23T19:02:40.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3210000000000001e-05 2024-04-23T19:02:40.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.434 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.434 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.663175+0000", 2024-04-23T19:02:40.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4996000000000002e-05 2024-04-23T19:02:40.435 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.435 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.435 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.435 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3191 3.c 3:3340fe65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.284898815, 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034282769999999997, 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3191 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057950+0000", 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5569999999999997e-06 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063293+0000", 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053432419999999998 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063340+0000", 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7191999999999998e-05 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063367+0000", 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6347e-05 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063565+0000", 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019835999999999999 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063919+0000", 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035387599999999998 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.064156+0000", 2024-04-23T19:02:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023711700000000001 2024-04-23T19:02:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.073363+0000", 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092073729999999996 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092068+0000", 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018704971000000001 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092156+0000", 2024-04-23T19:02:40.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7303000000000001e-05 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092228+0000", 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2432e-05 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.442 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3232 3.35 e88/20 3:acc6f285:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_247:head v 88'18, mlcod=87'16)", 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.552335+0000", 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.790509439, 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023116438999999999, 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552335+0000", 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552335+0000", 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552337+0000", 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8100000000000002e-06 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.554895+0000", 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0025577400000000002 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.444 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.554932+0000", 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6949999999999997e-05 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.554955+0000", 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2603e-05 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.555114+0000", 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000159445 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.555158+0000", 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4286000000000003e-05 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575038+0000", 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01987951 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575451+0000", 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041309499999999999 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.447 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3292 3.1c 3:3a0f6221:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_307:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.390079+0000", 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.9527646709999997, 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023307397000000001, 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.448 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3292 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.390079+0000", 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.390079+0000", 2024-04-23T19:02:40.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.390083+0000", 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.395367+0000", 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052840200000000004 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.395413+0000", 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6495999999999997e-05 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.395440+0000", 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6772999999999999e-05 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.395590+0000", 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014983800000000001 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.395866+0000", 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027673999999999998 2024-04-23T19:02:40.452 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.396103+0000", 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023655700000000001 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.412989+0000", 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016885822000000002 2024-04-23T19:02:40.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.413210+0000", 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022154600000000001 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.413303+0000", 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2843000000000005e-05 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.413387+0000", 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3481999999999998e-05 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3361 3.d e88/20 3:b10ac292:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_376:head v 88'9, mlcod=88'7)", 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.248901+0000", 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0939431719999999, 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024414774, 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248901+0000", 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248901+0000", 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248904+0000", 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.05e-06 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252009+0000", 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0031051630000000002 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252057+0000", 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7722999999999997e-05 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252081+0000", 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119999999999999e-05 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252256+0000", 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017485800000000001 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252307+0000", 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0955999999999998e-05 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273187+0000", 2024-04-23T19:02:40.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020880171999999999 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273316+0000", 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000128732 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3362 3.2a 3:5595a52f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.253297+0000", 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0895471400000001, 2024-04-23T19:02:40.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030245859, 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3362 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.253297+0000", 2024-04-23T19:02:40.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.253297+0000", 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.253321+0000", 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4012999999999999e-05 2024-04-23T19:02:40.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258767+0000", 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054464559999999997 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258805+0000", 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7289000000000002e-05 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258821+0000", 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6350000000000001e-05 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258989+0000", 2024-04-23T19:02:40.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016816800000000001 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.259384+0000", 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525900000000002 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.259790+0000", 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040605200000000001 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274661+0000", 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014870229 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.283267+0000", 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086062329999999996 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.283431+0000", 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016417100000000001 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.283543+0000", 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011163900000000001 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.466 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.467 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.467 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3367 3.d e89/20 3:b3a04ccc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_382:head v 89'10, mlcod=88'8)", 2024-04-23T19:02:40.467 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.323863+0000", 2024-04-23T19:02:40.467 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0189811510000002, 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024391982, 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323863+0000", 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323863+0000", 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323864+0000", 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2600000000000001e-07 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.329444+0000", 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055804490000000003 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.329489+0000", 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4947999999999997e-05 2024-04-23T19:02:40.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.329514+0000", 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4728000000000001e-05 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.329664+0000", 2024-04-23T19:02:40.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014998499999999999 2024-04-23T19:02:40.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.329703+0000", 2024-04-23T19:02:40.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.909e-05 2024-04-23T19:02:40.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348129+0000", 2024-04-23T19:02:40.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018426393999999999 2024-04-23T19:02:40.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348255+0000", 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012546200000000001 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3368 3.3c 3:3fc98c7c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_383:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.326924+0000", 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0159198749999998, 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026740689000000002, 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.474 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3368 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.326924+0000", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.326924+0000", 2024-04-23T19:02:40.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.326928+0000", 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6339999999999999e-06 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335315+0000", 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083870019999999993 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335361+0000", 2024-04-23T19:02:40.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5933999999999998e-05 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335387+0000", 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6571e-05 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335515+0000", 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012788099999999999 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335770+0000", 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025488699999999997 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335995+0000", 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0002252 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.351549+0000", 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015553765000000001 2024-04-23T19:02:40.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353437+0000", 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001887878 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353586+0000", 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014861799999999999 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353665+0000", 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9319000000000004e-05 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.480 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:40.482 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:40.482 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:40.481+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:40.583 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:40.581+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:40.607 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:40.608 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:40.608 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:40.608 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:40.622 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:40.684 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:40.681+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:40.738 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:40.738 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:40.739 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:40.739 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:40.739 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:40.752 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:40.785 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:40.785+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.775049299000003, 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.871 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:40.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:40.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:40.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:40.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:40.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:40.880 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.183949108999997, 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:40.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:40.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:40.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:40.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.886 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.823994601999999, 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:40.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:40.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:40.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.718880056000003, 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.893 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:40.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:40.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 64.572306873000002, 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.899 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:40.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:40.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:40.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:40.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:40.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:40.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:40.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:40.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.254469440000001, 2024-04-23T19:02:40.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.908 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:40.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.909 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:40.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:40.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:40.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:40.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:40.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:40.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.918 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.245289081999999, 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.919 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:40.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:40.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.235826591999999, 2024-04-23T19:02:40.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:40.928 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:40.929 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.930 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.931 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.932 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.932 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:40.932 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:40.932 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.932 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.932 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.216466343, 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:40.933 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.934 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.934 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.934 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.935 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:40.936 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.937 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.938 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.939 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:40.940 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:40.941 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:40.942 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.943 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.944 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.945 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.701332324999999, 2024-04-23T19:02:40.946 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:40.947 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.948 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.949 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:40.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:40.950 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.950 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.950 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.950 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:40.950 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.951 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.952 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:40.953 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:40.954 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.689851098999998, 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.955 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.956 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.958 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:40.959 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:40.960 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.251600793000001, 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.961 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:40.962 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.964 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.965 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 27.912373327000001, 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:40.967 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.968 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.969 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.970 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.971 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.972 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3232 3.35 3:acc6f285:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3236102819999997, 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028471888000000001, 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.973 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3232 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.974 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547564+0000", 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5030000000000002e-06 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551650+0000", 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040853879999999997 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.975 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551687+0000", 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551705+0000", 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8292999999999999e-05 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551811+0000", 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010588 2024-04-23T19:02:40.976 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552012+0000", 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020039400000000001 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552177+0000", 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016578200000000001 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.560222+0000", 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080445789999999996 2024-04-23T19:02:40.977 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575904+0000", 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015681898 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575974+0000", 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0353999999999998e-05 2024-04-23T19:02:40.978 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.576032+0000", 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8273999999999998e-05 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3277 3.20 3:07927c3a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.7095844089999996, 2024-04-23T19:02:40.979 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025815983000000001, 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3277 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.980 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161590+0000", 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167310+0000", 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057198709999999996 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.981 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167348+0000", 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7756000000000002e-05 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167366+0000", 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7966999999999999e-05 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.982 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167470+0000", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104619 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167656+0000", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018610400000000001 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167824+0000", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016765399999999999 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.175871+0000", 2024-04-23T19:02:40.983 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080470520000000007 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187276+0000", 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011404765000000001 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187342+0000", 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6171000000000001e-05 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.984 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187402+0000", 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0324e-05 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.985 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3305 3.a 3:5316da8a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_320:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3242697989999996, 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024419376, 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.986 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3305 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:40.987 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546904+0000", 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1839999999999999e-06 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.988 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552039+0000", 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051346079999999997 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552087+0000", 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8086e-05 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552106+0000", 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8612999999999999e-05 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.989 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552230+0000", 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124144 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552413+0000", 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183038 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552568+0000", 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015564999999999999 2024-04-23T19:02:40.990 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.561294+0000", 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087256769999999994 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571125+0000", 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098313159999999997 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571238+0000", 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112794 2024-04-23T19:02:40.991 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571320+0000", 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2266000000000001e-05 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3307 3.26 3:6465c41c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3039360340000004, 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030265808000000002, 2024-04-23T19:02:40.992 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3307 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567238+0000", 2024-04-23T19:02:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5499999999999999e-06 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573052+0000", 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058136189999999999 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573083+0000", 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1223000000000002e-05 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573121+0000", 2024-04-23T19:02:40.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7732999999999999e-05 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573257+0000", 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013551899999999999 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573489+0000", 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023233999999999999 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:40.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573724+0000", 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023525999999999999 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597129+0000", 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023405171999999998 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597300+0000", 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000170252 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597436+0000", 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597501+0000", 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4958999999999999e-05 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.998 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3321 3.2c 3:34861722:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_336:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.1513638610000001, 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025667949999999998, 2024-04-23T19:02:40.999 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3321 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:41.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719810+0000", 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723833+0000", 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004022505 2024-04-23T19:02:41.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723869+0000", 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6683000000000001e-05 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723887+0000", 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7713000000000001e-05 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723971+0000", 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4363999999999994e-05 2024-04-23T19:02:41.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.724080+0000", 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108529 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.724180+0000", 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010008100000000001 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.732701+0000", 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085209250000000004 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.744950+0000", 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012249074 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.745315+0000", 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036473799999999998 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.745475+0000", 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160235 2024-04-23T19:02:41.004 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3360 3.20 3:05349dc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.6376289690000001, 2024-04-23T19:02:41.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.039605253, 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3360 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233545+0000", 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4970000000000001e-06 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243604+0000", 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010058675 2024-04-23T19:02:41.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243642+0000", 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8266000000000003e-05 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243669+0000", 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7013e-05 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243870+0000", 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020050800000000001 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244290+0000", 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420405 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244711+0000", 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420295 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.260882+0000", 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016171040000000001 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272810+0000", 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928789 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272970+0000", 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015951600000000001 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273147+0000", 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017724900000000001 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3370 3.a 3:5380419a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.5279681570000001, 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.043047185000000002, 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3370 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343207+0000", 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4599999999999996e-06 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347261+0000", 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040542390000000003 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347305+0000", 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3569999999999998e-05 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347324+0000", 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8539e-05 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347478+0000", 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154656 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:41.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347490+0000", 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2017e-05 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353197+0000", 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057065759999999997 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353532+0000", 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033513599999999998 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.016 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353883+0000", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000351202 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.367051+0000", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013167415999999999 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386045+0000", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018994938999999999 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386146+0000", 2024-04-23T19:02:41.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010012400000000001 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386250+0000", 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104311 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.018 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:41.020 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:41.021 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:41.017+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:41.121 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:41.120+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:41.148 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:41.148 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:41.148 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:41.148 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:41.162 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:41.251 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:41.252+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:41.322 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:41.324+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:41.331 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:41.332 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:41.332 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:41.332 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:41.332 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:41.347 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:41.423 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:41.421+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 158.34712130400001, 2024-04-23T19:02:41.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:41.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:41.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:41.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:41.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.526 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 157.61426871699999, 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 157.61422953300001, 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.533 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:41.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:41.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 66.401442809000002, 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:41.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.540 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:41.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:41.543 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.825857262, 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:41.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.549 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 65.753696964, 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.551 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:41.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.555 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.233223083999999, 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:41.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:41.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.561 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.99997874, 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:41.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.908432743999999, 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.568 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.573 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3280 3.e 3:72bf3fdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3104449980000004, 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024559213999999999, 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.574 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3280 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207813+0000", 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2722999999999998e-05 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212197+0000", 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004383957 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212238+0000", 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.125e-05 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212257+0000", 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9306000000000001e-05 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212433+0000", 2024-04-23T19:02:41.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017601100000000001 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212836+0000", 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403015 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.213267+0000", 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043089499999999999 2024-04-23T19:02:41.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.230772+0000", 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017505107999999998 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232238+0000", 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014662810000000001 2024-04-23T19:02:41.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232301+0000", 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2293999999999997e-05 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232339+0000", 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8374000000000002e-05 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3287 3.37 3:ef4edada:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1985553939999996, 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034068071999999998, 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3287 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319673+0000", 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1329999999999999e-06 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324894+0000", 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052214999999999996 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324940+0000", 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5853000000000003e-05 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324960+0000", 2024-04-23T19:02:41.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0182000000000001e-05 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325156+0000", 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195878 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325587+0000", 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000430455 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325994+0000", 2024-04-23T19:02:41.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040785799999999998 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353421+0000", 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027426841 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353479+0000", 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7908999999999997e-05 2024-04-23T19:02:41.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353578+0000", 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8381999999999994e-05 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353738+0000", 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016008099999999999 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3288 3.37 3:ee2739c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.1827589549999997, 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029560090000000001, 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3288 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335469+0000", 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.416e-06 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342301+0000", 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00683207 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342341+0000", 2024-04-23T19:02:41.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0009999999999998e-05 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342368+0000", 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6913000000000001e-05 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342655+0000", 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028621000000000001 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343067+0000", 2024-04-23T19:02:41.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041280100000000002 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343543+0000", 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047600700000000003 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.355012+0000", 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011468734 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364851+0000", 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098389810000000001 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364953+0000", 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010220199999999999 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.365026+0000", 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2745999999999998e-05 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.592 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3351 3.f 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3822819669999999, 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.032978032999999997, 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3351 2024-04-23T19:02:41.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135946+0000", 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.309e-06 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141166+0000", 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052200889999999998 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141208+0000", 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1329999999999999e-05 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141228+0000", 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499000000000001e-05 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141374+0000", 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145422 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141654+0000", 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028040999999999998 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141901+0000", 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024735099999999998 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.161851+0000", 2024-04-23T19:02:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019949643 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168711+0000", 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068600629999999996 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168810+0000", 2024-04-23T19:02:41.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9347999999999998e-05 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168921+0000", 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110569 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.599 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3357 3.e 3:7013f97c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_372:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3144106600000001, 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024580902000000002, 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3357 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:41.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203817+0000", 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7939999999999998e-06 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207802+0000", 2024-04-23T19:02:41.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039852459999999996 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207837+0000", 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5046999999999998e-05 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207855+0000", 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8063e-05 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208026+0000", 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017055799999999999 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208449+0000", 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000423022 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208861+0000", 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041173499999999999 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228106+0000", 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019245594000000001 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228170+0000", 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3219999999999994e-05 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228313+0000", 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014380799999999999 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228395+0000", 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1815000000000002e-05 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3358 3.f 3:f3cab0c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.3049477039999999, 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129927000000001, 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.605 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3358 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213281+0000", 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5329999999999999e-06 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217537+0000", 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004256124 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217590+0000", 2024-04-23T19:02:41.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3139000000000001e-05 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217615+0000", 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5466e-05 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217791+0000", 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017528199999999999 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218180+0000", 2024-04-23T19:02:41.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038883899999999998 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218419+0000", 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023947000000000001 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.235595+0000", 2024-04-23T19:02:41.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017176365999999998 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239185+0000", 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035899650000000001 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239331+0000", 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145084 2024-04-23T19:02:41.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239407+0000", 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6658999999999999e-05 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3359 3.3f 3:fec9f01f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.2943854750000003, 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028738053999999999, 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.611 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3359 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223844+0000", 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9799999999999998e-06 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229191+0000", 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053469520000000003 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229217+0000", 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5873000000000001e-05 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229231+0000", 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3246e-05 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229350+0000", 2024-04-23T19:02:41.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119975 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229684+0000", 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033336999999999999 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229901+0000", 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021713799999999999 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.241113+0000", 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011212111 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252378+0000", 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011264918000000001 2024-04-23T19:02:41.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252475+0000", 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6818999999999996e-05 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252578+0000", 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102672 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.618 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3361 3.d 3:b10ac292:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.2751904889999999, 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031560294000000003, 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.619 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3361 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243038+0000", 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2200000000000001e-06 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247434+0000", 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043965050000000002 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247482+0000", 2024-04-23T19:02:41.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7839000000000001e-05 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247501+0000", 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9219999999999999e-05 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247709+0000", 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000207431 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248155+0000", 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044614500000000001 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248622+0000", 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046713800000000003 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273993+0000", 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025371365999999999 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274330+0000", 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033670599999999998 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274483+0000", 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015333100000000001 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274595+0000", 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111393 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3367 3.d 3:b3a04ccc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.2063938250000001, 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037201347000000003, 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3367 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311834+0000", 2024-04-23T19:02:41.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.869e-06 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315933+0000", 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040989920000000001 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315975+0000", 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2299999999999998e-05 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315994+0000", 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8567e-05 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316174+0000", 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180271 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316185+0000", 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1163e-05 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323166+0000", 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069803240000000004 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323380+0000", 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000214708 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323594+0000", 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021368099999999999 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335136+0000", 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541635 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348704+0000", 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013568334 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348896+0000", 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019216099999999999 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.349032+0000", 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013634199999999999 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3371 3.14 e89/20 3:2ab2acf0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_386:head v 89'14, mlcod=88'12)", 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:41.631 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.1577463090000002, 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025224723000000001, 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360480+0000", 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.595e-06 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364241+0000", 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037611670000000002 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364278+0000", 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.612e-05 2024-04-23T19:02:41.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364295+0000", 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7166000000000001e-05 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364454+0000", 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000159381 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364495+0000", 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1025000000000001e-05 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385607+0000", 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021111659000000001 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385703+0000", 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6609999999999998e-05 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3376 3.37 3:ee765f31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 4.1107731559999996, 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025998674999999999, 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:41.636 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3376 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:41.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:41.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407488+0000", 2024-04-23T19:02:41.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.646e-05 2024-04-23T19:02:41.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:41.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412769+0000", 2024-04-23T19:02:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052809679999999996 2024-04-23T19:02:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412810+0000", 2024-04-23T19:02:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1233000000000003e-05 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412830+0000", 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.914e-05 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412967+0000", 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013691800000000001 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413258+0000", 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029166700000000001 2024-04-23T19:02:41.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413500+0000", 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241843 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:41.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.430500+0000", 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016999492000000001 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433276+0000", 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027760329999999998 2024-04-23T19:02:41.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433369+0000", 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3524999999999996e-05 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433450+0000", 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1396000000000005e-05 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.646 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:41.647 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:41.647 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:41.648 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:41.648+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:41.649 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:41.727 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:02:41.749 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:41.748+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:41.780 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:41.780 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:41.780 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:41.780 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:41.794 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:41.850 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:41.849+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:41.855 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:41.912 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:41.912 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:41.912 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:41.912 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:41.912 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:41.926 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:41.974 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:41.973+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:41.995 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:41.995 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:42.013 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:42.030 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:42.030 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:42.048 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.049 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.049 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:42.049 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:42.050 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:42.049+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:42.066 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:42.069 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:42.091 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:42.091 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:42.111 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:42.131 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:42.152 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:42.152+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:42.184 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.184 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:42.286 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:42.285+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:42.354 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:42.353+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:42.362 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.362 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:42.455 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:42.456+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:42.541 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.541 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.554 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:42.555 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:42.556+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:42.656 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:42.656+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:42.675 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.675 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.689 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:42.757 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:42.756+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:42.805 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.806 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.818 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:42.869 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:42.869+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:42.930 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:42.931 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:42.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:42.959 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:42.960+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:43.046 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:02:43.059 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:43.057+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:43.108 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:43.108 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:43.124 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:43.161 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:43.160+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:43.262 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:43.264+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:43.283 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:43.283 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:43.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:43.363 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:43.364+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:43.418 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:43.419 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:43.433 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:43.482 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:43.484+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:43.564 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:43.564+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:43.567 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:43.567 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:43.581 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:43.666 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:43.668+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:43.744 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:43.744 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:43.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:43.803 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:43.804+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:43.867 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:43.865+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:43.925 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:43.925 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:43.939 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:43.968 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:43.969+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:44.066 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:44.066 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:44.068 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:44.068+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:44.080 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:44.149 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:44.198 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:44.197+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:44.242 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:44.242 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:44.257 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:44.271 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:44.269+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:44.306 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:44.306 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:44.323 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:44.323 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:44.339 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:44.339 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:44.355 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:44.356 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:44.372 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:44.369+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:44.375 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:44.376 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:44.380 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:44.380 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:44.395 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:44.396 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:44.396 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:44.415 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:44.415 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:44.432 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:44.433 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:44.499 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:44.497+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:44.520 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:44.520 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:44.520 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:44.520 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:44.534 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:44.574 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:44.573+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:44.654 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:44.654 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:44.654 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:44.654 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:44.655 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:44.667 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:44.710 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:44.712+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:44.775 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:44.776+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:44.789 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 69.692186323000001, 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.790 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:44.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:44.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:44.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 69.101086132999995, 2024-04-23T19:02:44.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:44.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:44.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 68.741131625999998, 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.802 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:44.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:44.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:44.807 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 68.636017080000002, 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:44.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:44.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:44.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:44.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 68.489443897000001, 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:44.813 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:44.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.171606464, 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.819 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:44.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:44.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:44.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.162426105999998, 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.825 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:44.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:44.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:44.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:44.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.830 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.834 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.834 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.152963616000001, 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.133603366999999, 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.840 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.845 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.618469349000002, 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.846 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:44.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:44.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:44.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:44.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.606988123000001, 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.851 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:44.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:44.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.856 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.168737817, 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 31.829510351, 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.862 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3232 3.35 3:acc6f285:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:44.867 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.2407473059999994, 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028471888000000001, 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3232 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547564+0000", 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5030000000000002e-06 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551650+0000", 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040853879999999997 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551687+0000", 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551705+0000", 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8292999999999999e-05 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551811+0000", 2024-04-23T19:02:44.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010588 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552012+0000", 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020039400000000001 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552177+0000", 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016578200000000001 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.560222+0000", 2024-04-23T19:02:44.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080445789999999996 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575904+0000", 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015681898 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575974+0000", 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0353999999999998e-05 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.576032+0000", 2024-04-23T19:02:44.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8273999999999998e-05 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3277 3.20 3:07927c3a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.6267214330000002, 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025815983000000001, 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.873 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3277 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161590+0000", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167310+0000", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057198709999999996 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167348+0000", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7756000000000002e-05 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.875 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167366+0000", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7966999999999999e-05 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167470+0000", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104619 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167656+0000", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018610400000000001 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167824+0000", 2024-04-23T19:02:44.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016765399999999999 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.175871+0000", 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080470520000000007 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187276+0000", 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011404765000000001 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187342+0000", 2024-04-23T19:02:44.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6171000000000001e-05 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187402+0000", 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0324e-05 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3305 3.a 3:5316da8a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_320:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.2414068230000002, 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024419376, 2024-04-23T19:02:44.878 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3305 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546904+0000", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1839999999999999e-06 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552039+0000", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051346079999999997 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552087+0000", 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8086e-05 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552106+0000", 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8612999999999999e-05 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552230+0000", 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124144 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552413+0000", 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183038 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552568+0000", 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015564999999999999 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.561294+0000", 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087256769999999994 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571125+0000", 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098313159999999997 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571238+0000", 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112794 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571320+0000", 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2266000000000001e-05 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.883 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3307 3.26 3:6465c41c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.221073058, 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030265808000000002, 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3307 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.884 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567238+0000", 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5499999999999999e-06 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573052+0000", 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058136189999999999 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573083+0000", 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1223000000000002e-05 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573121+0000", 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7732999999999999e-05 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573257+0000", 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013551899999999999 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573489+0000", 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023233999999999999 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573724+0000", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023525999999999999 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597129+0000", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023405171999999998 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597300+0000", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000170252 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597436+0000", 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597501+0000", 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4958999999999999e-05 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3321 3.2c 3:34861722:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_336:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0685008850000006, 2024-04-23T19:02:44.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025667949999999998, 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3321 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719810+0000", 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723833+0000", 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004022505 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723869+0000", 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6683000000000001e-05 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723887+0000", 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7713000000000001e-05 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723971+0000", 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4363999999999994e-05 2024-04-23T19:02:44.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.724080+0000", 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108529 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.724180+0000", 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010008100000000001 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.732701+0000", 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085209250000000004 2024-04-23T19:02:44.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.744950+0000", 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012249074 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.745315+0000", 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036473799999999998 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.745475+0000", 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160235 2024-04-23T19:02:44.894 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3360 3.20 3:05349dc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.5547659930000002, 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.039605253, 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.895 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3360 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233545+0000", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4970000000000001e-06 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243604+0000", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010058675 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243642+0000", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8266000000000003e-05 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243669+0000", 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7013e-05 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243870+0000", 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020050800000000001 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244290+0000", 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420405 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:44.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244711+0000", 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420295 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.260882+0000", 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016171040000000001 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272810+0000", 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928789 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272970+0000", 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015951600000000001 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273147+0000", 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017724900000000001 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3370 3.a 3:5380419a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.4451051809999997, 2024-04-23T19:02:44.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.043047185000000002, 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3370 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343207+0000", 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4599999999999996e-06 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347261+0000", 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040542390000000003 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347305+0000", 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3569999999999998e-05 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347324+0000", 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8539e-05 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347478+0000", 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154656 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347490+0000", 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2017e-05 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353197+0000", 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057065759999999997 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353532+0000", 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033513599999999998 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353883+0000", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000351202 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.367051+0000", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013167415999999999 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386045+0000", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018994938999999999 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:44.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386146+0000", 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010012400000000001 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386250+0000", 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104311 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:44.906 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:44.908 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:44.908 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:44.905+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:45.009 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:45.008+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:45.066 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:02:45.077 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:45.077 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:45.077 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:45.078 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:45.093 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:45.114 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:45.113+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:45.210 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:45.209+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:45.260 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:45.260 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:45.260 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:45.260 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:45.260 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:45.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:45.318 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:45.320+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:45.404 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:45.404 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:45.404 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:45.404 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:45.404 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.404 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 162.23151534499999, 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.405 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.406 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:45.407 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:45.408 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:45.409 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:45.410 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:45.411 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.411 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.411 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.411 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.411 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.411 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:45.412 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:45.412 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 161.49866275799999, 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:45.413 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:45.414 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:45.414 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.414 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.414 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.414 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.414 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.415 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:45.416 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:45.417 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:45.418 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.419 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.420 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 161.49862357399999, 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:45.421 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.422 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:45.423 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:45.424 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.425 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.426 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.427 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.428 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 70.285836849999995, 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.429 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.430 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:45.431 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.432 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.432 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.432 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:45.432 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:45.432 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.433 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 69.710251303000007, 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.434 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.435 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.436 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.437 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:45.438 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 69.638091005000007, 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.439 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.440 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.441 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:45.442 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:45.443 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.444 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.444 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.445 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 33.117617125000002, 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.446 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.447 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.448 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:45.449 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.450 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.451 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.452 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.452 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:45.452 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:45.452 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.452 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.452 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.884372781000003, 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.453 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:45.454 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.456 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.457 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.458 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 32.792826785000003, 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.459 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.460 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:45.461 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:45.462 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:45.463 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.464 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3280 3.e 3:72bf3fdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.1948390389999997, 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024559213999999999, 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3280 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.465 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.466 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207813+0000", 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2722999999999998e-05 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212197+0000", 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004383957 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212238+0000", 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.125e-05 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.467 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212257+0000", 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9306000000000001e-05 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212433+0000", 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017601100000000001 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212836+0000", 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403015 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.468 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.213267+0000", 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043089499999999999 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.230772+0000", 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017505107999999998 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232238+0000", 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014662810000000001 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.469 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232301+0000", 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2293999999999997e-05 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232339+0000", 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8374000000000002e-05 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3287 3.37 3:ef4edada:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:45.470 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.0829494349999997, 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034068071999999998, 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3287 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.471 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319673+0000", 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1329999999999999e-06 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324894+0000", 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052214999999999996 2024-04-23T19:02:45.472 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324940+0000", 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5853000000000003e-05 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324960+0000", 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0182000000000001e-05 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325156+0000", 2024-04-23T19:02:45.473 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195878 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325587+0000", 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000430455 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325994+0000", 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040785799999999998 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.474 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353421+0000", 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027426841 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353479+0000", 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7908999999999997e-05 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353578+0000", 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8381999999999994e-05 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.475 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353738+0000", 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016008099999999999 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3288 3.37 3:ee2739c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 9.0671529960000008, 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029560090000000001, 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.476 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3288 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.477 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335469+0000", 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.416e-06 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342301+0000", 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00683207 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342341+0000", 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0009999999999998e-05 2024-04-23T19:02:45.478 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342368+0000", 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6913000000000001e-05 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342655+0000", 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028621000000000001 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343067+0000", 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041280100000000002 2024-04-23T19:02:45.479 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343543+0000", 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047600700000000003 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.355012+0000", 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011468734 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364851+0000", 2024-04-23T19:02:45.480 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098389810000000001 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364953+0000", 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010220199999999999 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.365026+0000", 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2745999999999998e-05 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.481 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3351 3.f 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.2666760079999992, 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.032978032999999997, 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.482 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3351 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135946+0000", 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.309e-06 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141166+0000", 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052200889999999998 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141208+0000", 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1329999999999999e-05 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.484 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141228+0000", 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499000000000001e-05 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141374+0000", 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145422 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141654+0000", 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028040999999999998 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.485 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141901+0000", 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024735099999999998 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.161851+0000", 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019949643 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168711+0000", 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068600629999999996 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.486 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168810+0000", 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9347999999999998e-05 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168921+0000", 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110569 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3357 3.e 3:7013f97c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_372:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.487 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1988047010000003, 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024580902000000002, 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3357 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.488 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203817+0000", 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7939999999999998e-06 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.489 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207802+0000", 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039852459999999996 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207837+0000", 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5046999999999998e-05 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207855+0000", 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8063e-05 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.490 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208026+0000", 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017055799999999999 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208449+0000", 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000423022 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208861+0000", 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041173499999999999 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.491 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228106+0000", 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019245594000000001 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228170+0000", 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3219999999999994e-05 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228313+0000", 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014380799999999999 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.492 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228395+0000", 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1815000000000002e-05 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3358 3.f 3:f3cab0c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1893417450000001, 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129927000000001, 2024-04-23T19:02:45.493 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3358 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.494 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213281+0000", 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5329999999999999e-06 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217537+0000", 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004256124 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.495 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217590+0000", 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3139000000000001e-05 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217615+0000", 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5466e-05 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217791+0000", 2024-04-23T19:02:45.496 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017528199999999999 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218180+0000", 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038883899999999998 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218419+0000", 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023947000000000001 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.497 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.235595+0000", 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017176365999999998 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239185+0000", 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035899650000000001 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239331+0000", 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145084 2024-04-23T19:02:45.498 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239407+0000", 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6658999999999999e-05 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3359 3.3f 3:fec9f01f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1787795160000005, 2024-04-23T19:02:45.499 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028738053999999999, 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3359 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.500 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223844+0000", 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9799999999999998e-06 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229191+0000", 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053469520000000003 2024-04-23T19:02:45.501 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229217+0000", 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5873000000000001e-05 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229231+0000", 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3246e-05 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229350+0000", 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119975 2024-04-23T19:02:45.502 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229684+0000", 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033336999999999999 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229901+0000", 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021713799999999999 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.241113+0000", 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011212111 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.503 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252378+0000", 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011264918000000001 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252475+0000", 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6818999999999996e-05 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252578+0000", 2024-04-23T19:02:45.504 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102672 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3361 3.d 3:b10ac292:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1595845300000001, 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031560294000000003, 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.505 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3361 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:45.506 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243038+0000", 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2200000000000001e-06 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247434+0000", 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043965050000000002 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.507 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247482+0000", 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7839000000000001e-05 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247501+0000", 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9219999999999999e-05 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247709+0000", 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000207431 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.508 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248155+0000", 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044614500000000001 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248622+0000", 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046713800000000003 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273993+0000", 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025371365999999999 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.509 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274330+0000", 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033670599999999998 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274483+0000", 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015333100000000001 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274595+0000", 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111393 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.510 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3367 3.d 3:b3a04ccc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0907878659999994, 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037201347000000003, 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3367 2024-04-23T19:02:45.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311834+0000", 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.869e-06 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315933+0000", 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040989920000000001 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315975+0000", 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2299999999999998e-05 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315994+0000", 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8567e-05 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316174+0000", 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180271 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316185+0000", 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1163e-05 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323166+0000", 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069803240000000004 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323380+0000", 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000214708 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323594+0000", 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021368099999999999 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335136+0000", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541635 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348704+0000", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013568334 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348896+0000", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019216099999999999 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.349032+0000", 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013634199999999999 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3371 3.14 e89/20 3:2ab2acf0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_386:head v 89'14, mlcod=88'12)", 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0421403500000004, 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025224723000000001, 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360480+0000", 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.595e-06 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364241+0000", 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037611670000000002 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364278+0000", 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.612e-05 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364295+0000", 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7166000000000001e-05 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364454+0000", 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000159381 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364495+0000", 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1025000000000001e-05 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385607+0000", 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021111659000000001 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385703+0000", 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6609999999999998e-05 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3376 3.37 3:ee765f31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.9951671969999998, 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025998674999999999, 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:45.521 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3376 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:45.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407488+0000", 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.646e-05 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412769+0000", 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052809679999999996 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412810+0000", 2024-04-23T19:02:45.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1233000000000003e-05 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412830+0000", 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.914e-05 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412967+0000", 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013691800000000001 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413258+0000", 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029166700000000001 2024-04-23T19:02:45.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413500+0000", 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241843 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.430500+0000", 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016999492000000001 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433276+0000", 2024-04-23T19:02:45.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027760329999999998 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433369+0000", 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3524999999999996e-05 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433450+0000", 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1396000000000005e-05 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.526 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:45.527 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:45.527 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:45.528 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:45.529 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:45.525+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:45.629 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:45.628+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:45.659 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:45.659 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:45.659 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:45.660 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:45.673 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:45.730 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:45.732+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:45.790 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:45.790 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:45.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:45.850 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:45.849+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:45.932 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:45.932 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 72.104237381999994, 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.933 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.938 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 71.015336198, 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:02:45.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.885173369, 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.943 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:45.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:02:45.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.949 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 70.547664814000001, 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:02:45.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:02:45.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:02:45.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 69.860541845, 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:02:45.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:02:45.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:02:45.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2596 3.1 3:823f69c9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.570414196000002, 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022656223, 2024-04-23T19:02:45.961 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2596 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359677+0000", 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2619999999999999e-06 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361558+0000", 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018805149999999999 2024-04-23T19:02:45.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361596+0000", 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8875000000000003e-05 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361611+0000", 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4299e-05 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361689+0000", 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8535000000000006e-05 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361805+0000", 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115553 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361944+0000", 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013969699999999999 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.368991+0000", 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070468509999999998 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382225+0000", 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013233945 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382278+0000", 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2445999999999999e-05 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382330+0000", 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244999999999999e-05 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.966 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2599 3.1b 3:d87bc61c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.541658964, 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020622194999999999, 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.967 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2599 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388431+0000", 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390022+0000", 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001591433 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390046+0000", 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3689e-05 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390057+0000", 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0393e-05 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390120+0000", 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3456999999999999e-05 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390252+0000", 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013155600000000001 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390348+0000", 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6415000000000004e-05 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.396827+0000", 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006478864 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408927+0000", 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012099903 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408998+0000", 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1734000000000001e-05 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.409051+0000", 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2703e-05 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2625 3.20 e74/58 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head v 74'4, mlcod=57'2)", 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 34.269812662, 2024-04-23T19:02:45.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020962752000000001, 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660277+0000", 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7129999999999999e-06 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666091+0000", 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058138119999999998 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666121+0000", 2024-04-23T19:02:45.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0335999999999999e-05 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666132+0000", 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1268e-05 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666209+0000", 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6118000000000005e-05 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666232+0000", 2024-04-23T19:02:45.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3163000000000002e-05 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681139+0000", 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014907689999999999 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681238+0000", 2024-04-23T19:02:45.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8652000000000003e-05 2024-04-23T19:02:45.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.977 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.978 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2650 3.2b 3:d6d56598:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.978 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:45.978 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.965901989999999, 2024-04-23T19:02:45.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020158368999999999, 2024-04-23T19:02:45.978 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2650 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964189+0000", 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.818e-06 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966693+0000", 2024-04-23T19:02:45.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025037919999999999 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966729+0000", 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6117e-05 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966745+0000", 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5897e-05 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966850+0000", 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105567 2024-04-23T19:02:45.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.967064+0000", 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021383700000000001 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.967240+0000", 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017609200000000001 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.975026+0000", 2024-04-23T19:02:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077862920000000002 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984268+0000", 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092416170000000006 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984311+0000", 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3214000000000003e-05 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984344+0000", 2024-04-23T19:02:45.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3126000000000001e-05 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2655 3.1b 3:d98e5ec2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:45.989 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.899392827, 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020591821999999999, 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:45.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:45.991 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:45.991 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2655 2024-04-23T19:02:45.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.991 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:45.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:45.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:45.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:45.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:45.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:45.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:45.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030697+0000", 2024-04-23T19:02:45.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.323e-06 2024-04-23T19:02:45.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:45.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032435+0000", 2024-04-23T19:02:45.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017377060000000001 2024-04-23T19:02:45.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:45.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032478+0000", 2024-04-23T19:02:45.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3220000000000003e-05 2024-04-23T19:02:45.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:45.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032493+0000", 2024-04-23T19:02:45.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4453999999999999e-05 2024-04-23T19:02:45.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:45.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032567+0000", 2024-04-23T19:02:45.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4571000000000001e-05 2024-04-23T19:02:45.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:45.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032681+0000", 2024-04-23T19:02:45.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113533 2024-04-23T19:02:45.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:45.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:45.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032795+0000", 2024-04-23T19:02:45.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011422 2024-04-23T19:02:45.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:45.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.037255+0000", 2024-04-23T19:02:46.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044602840000000001 2024-04-23T19:02:46.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051196+0000", 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013940365 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051237+0000", 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1273000000000003e-05 2024-04-23T19:02:46.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051287+0000", 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9873000000000002e-05 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2658 3.1 3:8084a442:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.858064552000002, 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020774183000000002, 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.003 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2658 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072027+0000", 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000001e-06 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073852+0000", 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001824677 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073881+0000", 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8858000000000001e-05 2024-04-23T19:02:46.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073895+0000", 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4297999999999999e-05 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073972+0000", 2024-04-23T19:02:46.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7188999999999996e-05 2024-04-23T19:02:46.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074120+0000", 2024-04-23T19:02:46.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014745099999999999 2024-04-23T19:02:46.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074221+0000", 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101402 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.078775+0000", 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045542129999999997 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092594+0000", 2024-04-23T19:02:46.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013818983999999999 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092716+0000", 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121742 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092798+0000", 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1398999999999998e-05 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2660 3.17 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.834767788999997, 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027624744999999999, 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.014 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2660 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:46.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095323+0000", 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.326e-06 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096763+0000", 2024-04-23T19:02:46.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439409 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096798+0000", 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5089999999999998e-05 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096816+0000", 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8016000000000002e-05 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096934+0000", 2024-04-23T19:02:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117774 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097184+0000", 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025011199999999998 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:46.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097415+0000", 2024-04-23T19:02:46.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000230702 2024-04-23T19:02:46.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.103253+0000", 2024-04-23T19:02:46.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058384910000000003 2024-04-23T19:02:46.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122813+0000", 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019560371 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122889+0000", 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5838000000000001e-05 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122945+0000", 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5615999999999997e-05 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2678 3.1 3:833103ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 33.633646171000002, 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020666644000000001, 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.025 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2678 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296445+0000", 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.779e-06 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298083+0000", 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016387019999999999 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298112+0000", 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8796e-05 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298122+0000", 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0263e-05 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298189+0000", 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7077999999999997e-05 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298296+0000", 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106996 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298409+0000", 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112594 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.304486+0000", 2024-04-23T19:02:46.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060767750000000004 2024-04-23T19:02:46.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.316951+0000", 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012465100999999999 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317043+0000", 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2150000000000004e-05 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317108+0000", 2024-04-23T19:02:46.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5409999999999999e-05 2024-04-23T19:02:46.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2737 3.12 3:4b5e657b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:46.034 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:46.034 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.863239622999998, 2024-04-23T19:02:46.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024833089999999999, 2024-04-23T19:02:46.035 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.035 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.035 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.035 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2737 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:46.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066852+0000", 2024-04-23T19:02:46.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1130000000000003e-06 2024-04-23T19:02:46.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070879+0000", 2024-04-23T19:02:46.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004026656 2024-04-23T19:02:46.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070928+0000", 2024-04-23T19:02:46.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8442000000000001e-05 2024-04-23T19:02:46.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070951+0000", 2024-04-23T19:02:46.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3529000000000001e-05 2024-04-23T19:02:46.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071119+0000", 2024-04-23T19:02:46.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016777200000000001 2024-04-23T19:02:46.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071487+0000", 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036776499999999999 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071877+0000", 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039011999999999999 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.090667+0000", 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018790774999999999 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091411+0000", 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00074399600000000002 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091595+0000", 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183504 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091681+0000", 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6417999999999998e-05 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2766 3.3 e75/20 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head v 75'4, mlcod=57'2)", 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.447331392000002, 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019403538000000001, 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482758+0000", 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8309999999999999e-06 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488183+0000", 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054248029999999997 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488215+0000", 2024-04-23T19:02:46.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1962000000000003e-05 2024-04-23T19:02:46.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488229+0000", 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488316+0000", 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6718000000000006e-05 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488343+0000", 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7523999999999999e-05 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.502066+0000", 2024-04-23T19:02:46.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013722892 2024-04-23T19:02:46.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.502160+0000", 2024-04-23T19:02:46.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3768000000000001e-05 2024-04-23T19:02:46.050 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.051 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.051 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2775 3.12 3:4a72dfe0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:46.051 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:46.052 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 32.341647279999997, 2024-04-23T19:02:46.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020412445000000001, 2024-04-23T19:02:46.052 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.052 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.052 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.052 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2775 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:46.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588444+0000", 2024-04-23T19:02:46.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.399e-06 2024-04-23T19:02:46.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590332+0000", 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018882300000000001 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590360+0000", 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7474000000000002e-05 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590373+0000", 2024-04-23T19:02:46.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2771e-05 2024-04-23T19:02:46.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590462+0000", 2024-04-23T19:02:46.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9511000000000004e-05 2024-04-23T19:02:46.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590646+0000", 2024-04-23T19:02:46.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018425900000000001 2024-04-23T19:02:46.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:46.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590833+0000", 2024-04-23T19:02:46.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018679699999999999 2024-04-23T19:02:46.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.597142+0000", 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063092759999999999 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608728+0000", 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011585300999999999 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608800+0000", 2024-04-23T19:02:46.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2476000000000002e-05 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608853+0000", 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2951000000000002e-05 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3192 3.3d 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:46.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 10.864293687, 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028337180999999999, 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3192 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065796+0000", 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.074e-06 2024-04-23T19:02:46.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068360+0000", 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002563348 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068394+0000", 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4654999999999999e-05 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068408+0000", 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3621000000000001e-05 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068536+0000", 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012814799999999999 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068718+0000", 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000181576 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068871+0000", 2024-04-23T19:02:46.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015303699999999999 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.091073+0000", 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022202537000000001 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094026+0000", 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029526470000000001 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094083+0000", 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7371999999999999e-05 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094131+0000", 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8165999999999999e-05 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3266 3.1 3:813560fc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.9127323569999994, 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025108429000000002, 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3266 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017360+0000", 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3529999999999997e-06 2024-04-23T19:02:46.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020806+0000", 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034463530000000001 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020857+0000", 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0618999999999998e-05 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020884+0000", 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7555999999999998e-05 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021046+0000", 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021305+0000", 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025975500000000002 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021548+0000", 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024253600000000001 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.035795+0000", 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014247345999999999 2024-04-23T19:02:46.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042324+0000", 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065290180000000001 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042395+0000", 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1018000000000003e-05 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042464+0000", 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8755000000000002e-05 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3289 3.2b 3:d7f50467:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5844064440000007, 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024819753, 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.075 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3289 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345686+0000", 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2570000000000001e-06 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348576+0000", 2024-04-23T19:02:46.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028902260000000001 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348611+0000", 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5342999999999997e-05 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348625+0000", 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3995999999999999e-05 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348720+0000", 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4877999999999995e-05 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348893+0000", 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017255100000000001 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.349051+0000", 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015808700000000001 2024-04-23T19:02:46.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.357084+0000", 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080328499999999994 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370386+0000", 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013302619999999999 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370444+0000", 2024-04-23T19:02:46.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8010000000000002e-05 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370501+0000", 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6935000000000003e-05 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3291 3.12 3:48c04dc1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_306:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 9.5515357400000003, 2024-04-23T19:02:46.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020911669000000001, 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3291 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:46.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:46.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378556+0000", 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380698+0000", 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021416180000000001 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380733+0000", 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5759000000000001e-05 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:46.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380750+0000", 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6633000000000002e-05 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380851+0000", 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010135499999999999 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381030+0000", 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178942 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381189+0000", 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159111 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:46.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.389668+0000", 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084788350000000005 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399384+0000", 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097162150000000003 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399428+0000", 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3748000000000002e-05 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399464+0000", 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5753000000000001e-05 2024-04-23T19:02:46.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.089 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.089 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:46.089 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:46.089 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:46.090 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:45.932+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:46.091 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:46.092+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:46.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:46.093 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:02:46.192 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:46.189+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:46.262 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:46.263 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:46.263 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:46.263 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:46.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:46.293 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:46.292+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:46.394 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:46.393+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:46.443 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:46.443 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:46.444 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:46.444 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:46.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:46.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:46.495 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:46.496+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:46.592 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:46.593 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:46.596 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:46.593+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:46.609 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:46.610 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:46.626 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:46.626 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:46.630 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:46.631 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:46.643 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:46.643 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:46.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:46.664 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:46.664 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:46.684 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:46.685 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:46.697 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:46.696+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:46.705 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:46.705 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:46.726 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:46.726 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:46.781 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:46.781 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:46.796 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:46.798 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:46.800+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:46.899 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:46.900+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:46.962 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:46.962 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:46.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:47.000 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:47.000+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:47.101 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:47.097+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:47.105 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:47.105 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:47.120 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:47.202 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:47.200+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:47.290 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:47.291 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:47.303 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:47.304+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:47.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:47.404 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:47.401+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:47.430 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:47.430 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:47.444 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:47.505 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:47.504+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:47.606 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:47.605+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:47.607 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:47.607 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:47.621 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:47.707 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:47.708+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:47.751 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:47.751 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:47.765 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:47.808 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:47.805+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:47.908 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:47.908+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:47.933 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:47.933 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:47.948 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:48.010 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:48.009+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:48.096 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:02:48.114 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:48.115 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:48.129 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:48.146 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:48.145+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:48.212 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:48.212+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:48.252 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:48.252 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:48.266 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:48.312 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:48.312+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:48.413 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:48.412+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:48.434 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:48.434 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:48.449 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:48.515 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:48.513+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:48.611 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:48.612 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:48.618 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:48.613+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:48.626 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:48.716 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:48.716+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:48.745 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:48.749 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:48.750 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:48.764 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:48.850 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:48.852+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:48.898 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:48.898 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:48.914 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:48.915 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:48.918 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:48.916+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:48.927 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:48.928 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:48.930 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:48.931 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:48.943 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:48.949 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:48.949 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:48.965 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:48.966 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:48.986 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:48.986 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:49.005 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:49.005 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:49.021 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:49.022 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:49.034 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:49.036+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:49.059 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:02:49.116 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 74.018649271000001, 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.117 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 73.427549080999995, 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.123 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.128 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 73.067594573999997, 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:02:49.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:02:49.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:02:49.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:02:49.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:02:49.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2303 3.35 3:ad51a2c2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 72.962480028000002, 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024449996000000002, 2024-04-23T19:02:49.134 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2303 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152291+0000", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.152294+0000", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6200000000000001e-06 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156708+0000", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044139069999999999 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156747+0000", 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8186000000000003e-05 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156764+0000", 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7195999999999999e-05 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.156921+0000", 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015708599999999999 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157200+0000", 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027964 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.157447+0000", 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024614999999999999 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.169036+0000", 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011589113 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176451+0000", 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074151140000000004 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176630+0000", 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000179288 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.176741+0000", 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110696 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.139 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 72.815906845000001, 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:02:49.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:02:49.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.142 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.143 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:02:49.144 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.145 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.498069412, 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.146 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:02:49.147 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:02:49.148 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:02:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:02:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.149 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:02:49.150 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.151 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.152 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2622 3.a 3:52629033:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.153 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.488889053999998, 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026583318000000002, 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2622 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:49.154 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625882+0000", 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.625941+0000", 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.9614999999999998e-05 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630929+0000", 2024-04-23T19:02:49.155 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049872040000000003 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630964+0000", 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5778999999999997e-05 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.156 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.630982+0000", 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7609999999999999e-05 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.157 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631151+0000", 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000168837 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631557+0000", 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040630199999999999 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.158 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.631965+0000", 2024-04-23T19:02:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040806300000000001 2024-04-23T19:02:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.159 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.649771+0000", 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017805667000000001 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652117+0000", 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.002346033 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652298+0000", 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018088199999999999 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.160 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.652465+0000", 2024-04-23T19:02:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000167326 2024-04-23T19:02:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.161 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2623 3.26 3:658a2688:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.162 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.479426564000001, 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024855393999999999, 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.163 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2623 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.164 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635344+0000", 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.165 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.635347+0000", 2024-04-23T19:02:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.886e-06 2024-04-23T19:02:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642345+0000", 2024-04-23T19:02:49.166 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069979830000000002 2024-04-23T19:02:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642378+0000", 2024-04-23T19:02:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3275999999999998e-05 2024-04-23T19:02:49.167 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642397+0000", 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8223000000000002e-05 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642585+0000", 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018814299999999999 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.168 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.642931+0000", 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034597399999999998 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643264+0000", 2024-04-23T19:02:49.169 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033289000000000002 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.653498+0000", 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010234345000000001 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659879+0000", 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0063810780000000001 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.170 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660054+0000", 2024-04-23T19:02:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000174694 2024-04-23T19:02:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.171 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.660200+0000", 2024-04-23T19:02:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145902 2024-04-23T19:02:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.172 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.460066314999999, 2024-04-23T19:02:49.173 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.174 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.175 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:02:49.176 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.177 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.178 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.179 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.944932297000001, 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.180 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.181 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.182 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.183 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.184 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2668 3.36 3:6c46f34f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.933451071, 2024-04-23T19:02:49.185 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026607776, 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2668 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.186 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181320+0000", 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.181323+0000", 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5870000000000001e-06 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189382+0000", 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080584639999999996 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.187 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189423+0000", 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1050000000000002e-05 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189449+0000", 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5999e-05 2024-04-23T19:02:49.188 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189617+0000", 2024-04-23T19:02:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016793299999999999 2024-04-23T19:02:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.189 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.189993+0000", 2024-04-23T19:02:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037595100000000002 2024-04-23T19:02:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.190 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.190219+0000", 2024-04-23T19:02:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000225749 2024-04-23T19:02:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.191 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206340+0000", 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016121443999999999 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207793+0000", 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014531679999999999 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.192 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207875+0000", 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2274999999999994e-05 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207928+0000", 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2156e-05 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.193 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.194 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.194 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.194 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.194 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2710 3.2c 3:35c4e34c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.195 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:49.195 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.495200765, 2024-04-23T19:02:49.195 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024745314000000001, 2024-04-23T19:02:49.195 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.195 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.195 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.196 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.196 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.196 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.196 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2710 2024-04-23T19:02:49.196 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.197 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619570+0000", 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.619583+0000", 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3125999999999999e-05 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.198 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623394+0000", 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0038106289999999998 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623422+0000", 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8560000000000001e-05 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.199 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.200 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.200 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623437+0000", 2024-04-23T19:02:49.200 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4762e-05 2024-04-23T19:02:49.200 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.200 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.201 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623540+0000", 2024-04-23T19:02:49.201 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010233100000000001 2024-04-23T19:02:49.201 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.201 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.201 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.623834+0000", 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029449599999999999 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.624030+0000", 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000196014 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.641293+0000", 2024-04-23T19:02:49.202 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017262758999999999 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644172+0000", 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00287952 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.203 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644253+0000", 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.644315+0000", 2024-04-23T19:02:49.204 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2201999999999998e-05 2024-04-23T19:02:49.205 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.205 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.205 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.205 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.205 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.206 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2731 3.2c 3:34175430:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.206 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:49.206 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 36.155973299000003, 2024-04-23T19:02:49.206 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025880488, 2024-04-23T19:02:49.206 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.206 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2731 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.207 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958798+0000", 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.958801+0000", 2024-04-23T19:02:49.208 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2030000000000001e-06 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964761+0000", 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059598910000000001 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.209 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964803+0000", 2024-04-23T19:02:49.210 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2329000000000001e-05 2024-04-23T19:02:49.210 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.210 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.210 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.210 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.964827+0000", 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3932999999999999e-05 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965012+0000", 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000185334 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.211 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965443+0000", 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043094900000000002 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.965854+0000", 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041124899999999998 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.212 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.977063+0000", 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011208565 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984496+0000", 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074327020000000002 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.213 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984596+0000", 2024-04-23T19:02:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100505 2024-04-23T19:02:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.215 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.215 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.984678+0000", 2024-04-23T19:02:49.215 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1828000000000003e-05 2024-04-23T19:02:49.215 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3232 3.35 3:acc6f285:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.567210254000001, 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028471888000000001, 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.216 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3232 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:49.217 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.218 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547564+0000", 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5030000000000002e-06 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551650+0000", 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040853879999999997 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.219 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551687+0000", 2024-04-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.220 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551705+0000", 2024-04-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8292999999999999e-05 2024-04-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.221 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551811+0000", 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010588 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552012+0000", 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020039400000000001 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.222 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552177+0000", 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016578200000000001 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.560222+0000", 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080445789999999996 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.223 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575904+0000", 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015681898 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575974+0000", 2024-04-23T19:02:49.224 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0353999999999998e-05 2024-04-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.576032+0000", 2024-04-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8273999999999998e-05 2024-04-23T19:02:49.225 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3277 3.20 3:07927c3a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_292:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:49.226 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.953184381, 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025815983000000001, 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3277 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.227 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:49.229 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.229 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161586+0000", 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.230 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.161590+0000", 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167310+0000", 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057198709999999996 2024-04-23T19:02:49.231 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.232 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.232 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167348+0000", 2024-04-23T19:02:49.232 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7756000000000002e-05 2024-04-23T19:02:49.232 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.232 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.233 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167366+0000", 2024-04-23T19:02:49.233 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7966999999999999e-05 2024-04-23T19:02:49.233 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.233 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.233 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167470+0000", 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104619 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167656+0000", 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018610400000000001 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.234 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.167824+0000", 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016765399999999999 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.175871+0000", 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080470520000000007 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.235 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187276+0000", 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011404765000000001 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187342+0000", 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6171000000000001e-05 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.236 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.237 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.187402+0000", 2024-04-23T19:02:49.237 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0324e-05 2024-04-23T19:02:49.237 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.237 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.237 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.237 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.238 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.238 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3305 3.a 3:5316da8a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_320:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.238 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:49.238 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.567869771, 2024-04-23T19:02:49.238 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024419376, 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3305 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.239 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546901+0000", 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.240 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.546904+0000", 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1839999999999999e-06 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552039+0000", 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051346079999999997 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.241 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552087+0000", 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8086e-05 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552106+0000", 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8612999999999999e-05 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.242 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552230+0000", 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124144 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552413+0000", 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000183038 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.552568+0000", 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015564999999999999 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.243 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.561294+0000", 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087256769999999994 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571125+0000", 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098313159999999997 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.244 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571238+0000", 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112794 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.571320+0000", 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2266000000000001e-05 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3307 3.26 3:6465c41c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.547536006, 2024-04-23T19:02:49.245 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030265808000000002, 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3307 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.246 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567238+0000", 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5499999999999999e-06 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573052+0000", 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058136189999999999 2024-04-23T19:02:49.247 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573083+0000", 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1223000000000002e-05 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573121+0000", 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7732999999999999e-05 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573257+0000", 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013551899999999999 2024-04-23T19:02:49.248 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573489+0000", 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023233999999999999 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573724+0000", 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023525999999999999 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597129+0000", 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023405171999999998 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.249 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597300+0000", 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000170252 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597436+0000", 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.250 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597501+0000", 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4958999999999999e-05 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.251 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3321 3.2c 3:34861722:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_336:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.394963833, 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025667949999999998, 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.252 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3321 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.253 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:49.254 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.254 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.254 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.254 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.254 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719807+0000", 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.719810+0000", 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.255 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723833+0000", 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004022505 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.256 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723869+0000", 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6683000000000001e-05 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723887+0000", 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7713000000000001e-05 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.257 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.723971+0000", 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.4363999999999994e-05 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.258 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.724080+0000", 2024-04-23T19:02:49.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108529 2024-04-23T19:02:49.259 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.259 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.259 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.259 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.724180+0000", 2024-04-23T19:02:49.259 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010008100000000001 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.732701+0000", 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0085209250000000004 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.744950+0000", 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012249074 2024-04-23T19:02:49.260 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.745315+0000", 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036473799999999998 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.745475+0000", 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160235 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.261 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3360 3.20 3:05349dc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.881228941, 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.039605253, 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3360 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.262 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233545+0000", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4970000000000001e-06 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.263 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243604+0000", 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010058675 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243642+0000", 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8266000000000003e-05 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243669+0000", 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7013e-05 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.264 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243870+0000", 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020050800000000001 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244290+0000", 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420405 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244711+0000", 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420295 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.265 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.260882+0000", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016171040000000001 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272810+0000", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928789 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272970+0000", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015951600000000001 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273147+0000", 2024-04-23T19:02:49.266 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017724900000000001 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3370 3.a 3:5380419a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 11.771568129, 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.043047185000000002, 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.267 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3370 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.268 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343207+0000", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4599999999999996e-06 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347261+0000", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040542390000000003 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347305+0000", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3569999999999998e-05 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347324+0000", 2024-04-23T19:02:49.269 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8539e-05 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347478+0000", 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154656 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347490+0000", 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2017e-05 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353197+0000", 2024-04-23T19:02:49.270 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057065759999999997 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353532+0000", 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033513599999999998 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353883+0000", 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000351202 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.367051+0000", 2024-04-23T19:02:49.271 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013167415999999999 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386045+0000", 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018994938999999999 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386146+0000", 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010012400000000001 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386250+0000", 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104311 2024-04-23T19:02:49.272 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.273 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.273 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.273 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.273 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.273 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:49.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:49.275 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:49.276+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:49.375 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:49.373+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:02:49.455 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:49.469 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:49.476 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:49.473+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:49.577 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:49.573+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:49.594 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:49.594 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:02:49.594 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:02:49.594 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:02:49.594 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:49.608 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:49.678 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:49.676+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:49.737 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 166.56507540600001, 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.738 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.739 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:49.740 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:49.741 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:49.742 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:49.743 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 165.83222281900001, 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.744 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:49.745 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.746 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.746 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.746 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:49.746 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:49.746 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.747 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.748 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.749 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:49.750 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 165.83218363500001, 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.751 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:49.752 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.753 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:49.754 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:49.755 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:49.756 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.757 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 74.619396910999995, 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.758 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.759 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:49.760 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:49.761 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 74.043811364000007, 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.762 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.763 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.764 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:49.764 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.764 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.764 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.764 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:49.765 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:49.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.766 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.766 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.766 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:49.766 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:49.766 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.767 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.767 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:49.767 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:49.767 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.767 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.768 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:49.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:49.769 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.769 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.769 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.769 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:49.769 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:49.770 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.770 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.770 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.770 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:49.770 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:49.770 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.771 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.771 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.771 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.771 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.771 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:49.771 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 73.971651066000007, 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.772 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.773 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.773 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:49.773 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.773 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.773 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.773 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:49.774 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.774 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.774 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.774 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.774 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:49.775 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.776 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.776 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.776 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:49.776 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:49.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.777 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.777 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.777 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:49.777 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:49.777 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:49.778 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:49.779 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:49.780 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.451177186000002, 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.781 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.782 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.783 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:49.784 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:49.785 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.217932842000003, 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:49.786 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.787 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.788 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.789 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.790 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.791 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 37.126386846000003, 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.792 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.793 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.794 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.795 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.796 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3280 3.e 3:72bf3fdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.5283991, 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024559213999999999, 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.797 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3280 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.798 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207813+0000", 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2722999999999998e-05 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212197+0000", 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004383957 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212238+0000", 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.125e-05 2024-04-23T19:02:49.799 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212257+0000", 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9306000000000001e-05 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212433+0000", 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017601100000000001 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212836+0000", 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403015 2024-04-23T19:02:49.800 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.213267+0000", 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043089499999999999 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.230772+0000", 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017505107999999998 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232238+0000", 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014662810000000001 2024-04-23T19:02:49.801 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232301+0000", 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2293999999999997e-05 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232339+0000", 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8374000000000002e-05 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.802 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3287 3.37 3:ef4edada:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.416509496, 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034068071999999998, 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3287 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.803 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319673+0000", 2024-04-23T19:02:49.804 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1329999999999999e-06 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324894+0000", 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052214999999999996 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324940+0000", 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5853000000000003e-05 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324960+0000", 2024-04-23T19:02:49.805 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0182000000000001e-05 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325156+0000", 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195878 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325587+0000", 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000430455 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.806 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325994+0000", 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040785799999999998 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353421+0000", 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027426841 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353479+0000", 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7908999999999997e-05 2024-04-23T19:02:49.807 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353578+0000", 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8381999999999994e-05 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353738+0000", 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016008099999999999 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.808 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3288 3.37 3:ee2739c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 13.400713057000001, 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029560090000000001, 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3288 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:49.809 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335469+0000", 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.416e-06 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342301+0000", 2024-04-23T19:02:49.810 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00683207 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342341+0000", 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0009999999999998e-05 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342368+0000", 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6913000000000001e-05 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342655+0000", 2024-04-23T19:02:49.811 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028621000000000001 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343067+0000", 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041280100000000002 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343543+0000", 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047600700000000003 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.355012+0000", 2024-04-23T19:02:49.812 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011468734 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364851+0000", 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098389810000000001 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364953+0000", 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010220199999999999 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.365026+0000", 2024-04-23T19:02:49.813 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2745999999999998e-05 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3351 3.f 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.600236068999999, 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.032978032999999997, 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.814 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3351 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.815 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135946+0000", 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.309e-06 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141166+0000", 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052200889999999998 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141208+0000", 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1329999999999999e-05 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.816 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141228+0000", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499000000000001e-05 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141374+0000", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145422 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141654+0000", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028040999999999998 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.817 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141901+0000", 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024735099999999998 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.161851+0000", 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019949643 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168711+0000", 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068600629999999996 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.818 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168810+0000", 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9347999999999998e-05 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168921+0000", 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110569 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3357 3.e 3:7013f97c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_372:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.532364762, 2024-04-23T19:02:49.819 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024580902000000002, 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3357 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.820 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203817+0000", 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7939999999999998e-06 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207802+0000", 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039852459999999996 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.821 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207837+0000", 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5046999999999998e-05 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207855+0000", 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8063e-05 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208026+0000", 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017055799999999999 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.822 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208449+0000", 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000423022 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208861+0000", 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041173499999999999 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228106+0000", 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019245594000000001 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228170+0000", 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3219999999999994e-05 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228313+0000", 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014380799999999999 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228395+0000", 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1815000000000002e-05 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3358 3.f 3:f3cab0c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.522901806, 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129927000000001, 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.825 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3358 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213281+0000", 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5329999999999999e-06 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217537+0000", 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004256124 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217590+0000", 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3139000000000001e-05 2024-04-23T19:02:49.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217615+0000", 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5466e-05 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217791+0000", 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017528199999999999 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218180+0000", 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038883899999999998 2024-04-23T19:02:49.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218419+0000", 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023947000000000001 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.235595+0000", 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017176365999999998 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239185+0000", 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035899650000000001 2024-04-23T19:02:49.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239331+0000", 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145084 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239407+0000", 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6658999999999999e-05 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.830 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3359 3.3f 3:fec9f01f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.512339577000001, 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028738053999999999, 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3359 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:49.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223844+0000", 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9799999999999998e-06 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229191+0000", 2024-04-23T19:02:49.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053469520000000003 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229217+0000", 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5873000000000001e-05 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229231+0000", 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3246e-05 2024-04-23T19:02:49.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229350+0000", 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119975 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229684+0000", 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033336999999999999 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.834 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229901+0000", 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021713799999999999 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.241113+0000", 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011212111 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252378+0000", 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011264918000000001 2024-04-23T19:02:49.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252475+0000", 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6818999999999996e-05 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252578+0000", 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102672 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3361 3.d 3:b10ac292:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.493144591, 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031560294000000003, 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3361 2024-04-23T19:02:49.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243038+0000", 2024-04-23T19:02:49.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2200000000000001e-06 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247434+0000", 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043965050000000002 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247482+0000", 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7839000000000001e-05 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247501+0000", 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9219999999999999e-05 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247709+0000", 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000207431 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248155+0000", 2024-04-23T19:02:49.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044614500000000001 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248622+0000", 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046713800000000003 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273993+0000", 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025371365999999999 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274330+0000", 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033670599999999998 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274483+0000", 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015333100000000001 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274595+0000", 2024-04-23T19:02:49.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111393 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3367 3.d 3:b3a04ccc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.424347926999999, 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037201347000000003, 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.847 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3367 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311834+0000", 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.869e-06 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315933+0000", 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040989920000000001 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315975+0000", 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2299999999999998e-05 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315994+0000", 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8567e-05 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316174+0000", 2024-04-23T19:02:49.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180271 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316185+0000", 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1163e-05 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323166+0000", 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069803240000000004 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323380+0000", 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000214708 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323594+0000", 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021368099999999999 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335136+0000", 2024-04-23T19:02:49.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541635 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348704+0000", 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013568334 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348896+0000", 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019216099999999999 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.349032+0000", 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013634199999999999 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3371 3.14 e89/20 3:2ab2acf0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_386:head v 89'14, mlcod=88'12)", 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.375700411, 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025224723000000001, 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360480+0000", 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.595e-06 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364241+0000", 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037611670000000002 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364278+0000", 2024-04-23T19:02:49.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.612e-05 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364295+0000", 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7166000000000001e-05 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364454+0000", 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000159381 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364495+0000", 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1025000000000001e-05 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385607+0000", 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021111659000000001 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385703+0000", 2024-04-23T19:02:49.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6609999999999998e-05 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3376 3.37 3:ee765f31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 12.328727258000001, 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025998674999999999, 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:49.859 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3376 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407488+0000", 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.646e-05 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412769+0000", 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052809679999999996 2024-04-23T19:02:49.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412810+0000", 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1233000000000003e-05 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412830+0000", 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.914e-05 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:49.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412967+0000", 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013691800000000001 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413258+0000", 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029166700000000001 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413500+0000", 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241843 2024-04-23T19:02:49.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.430500+0000", 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016999492000000001 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433276+0000", 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027760329999999998 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:49.864 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433369+0000", 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3524999999999996e-05 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433450+0000", 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1396000000000005e-05 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:49.865 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:49.867 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:49.868+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:49.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:49.968 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:49.965+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:50.001 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:50.001 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:50.001 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:50.001 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:50.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:50.069 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:50.068+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:50.170 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:50.169+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:50.182 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:50.182 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:50.182 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:50.182 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:50.182 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:50.196 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:50.286 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:50.285+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:50.361 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.534831170000004, 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:02:50.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:02:50.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:02:50.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:02:50.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.445929985999996, 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.369 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.315767156999996, 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:02:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.978258601999997, 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:02:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.291135632999996, 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:02:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:02:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:02:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2596 3.1 3:823f69c9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.001007983999997, 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022656223, 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2596 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359677+0000", 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2619999999999999e-06 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361558+0000", 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018805149999999999 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361596+0000", 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8875000000000003e-05 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361611+0000", 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4299e-05 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361689+0000", 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8535000000000006e-05 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361805+0000", 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115553 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361944+0000", 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013969699999999999 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.368991+0000", 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070468509999999998 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382225+0000", 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013233945 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382278+0000", 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2445999999999999e-05 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382330+0000", 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244999999999999e-05 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2599 3.1b 3:d87bc61c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.972252752000003, 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020622194999999999, 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2599 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388431+0000", 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390022+0000", 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001591433 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390046+0000", 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3689e-05 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390057+0000", 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0393e-05 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390120+0000", 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3456999999999999e-05 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390252+0000", 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013155600000000001 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390348+0000", 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6415000000000004e-05 2024-04-23T19:02:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.396827+0000", 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006478864 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408927+0000", 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012099903 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408998+0000", 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1734000000000001e-05 2024-04-23T19:02:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.409051+0000", 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2703e-05 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2625 3.20 e74/58 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head v 74'4, mlcod=57'2)", 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.700406450000003, 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020962752000000001, 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660277+0000", 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7129999999999999e-06 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666091+0000", 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058138119999999998 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666121+0000", 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0335999999999999e-05 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666132+0000", 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1268e-05 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666209+0000", 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6118000000000005e-05 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666232+0000", 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3163000000000002e-05 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681139+0000", 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014907689999999999 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681238+0000", 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8652000000000003e-05 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2650 3.2b 3:d6d56598:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.396495778000002, 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020158368999999999, 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2650 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964189+0000", 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.818e-06 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966693+0000", 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025037919999999999 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966729+0000", 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6117e-05 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966745+0000", 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5897e-05 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966850+0000", 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105567 2024-04-23T19:02:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.967064+0000", 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021383700000000001 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.967240+0000", 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017609200000000001 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.975026+0000", 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077862920000000002 2024-04-23T19:02:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984268+0000", 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092416170000000006 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984311+0000", 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3214000000000003e-05 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984344+0000", 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3126000000000001e-05 2024-04-23T19:02:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2655 3.1b 3:d98e5ec2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.329986615000003, 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020591821999999999, 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2655 2024-04-23T19:02:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030697+0000", 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.323e-06 2024-04-23T19:02:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032435+0000", 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017377060000000001 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032478+0000", 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3220000000000003e-05 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032493+0000", 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4453999999999999e-05 2024-04-23T19:02:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032567+0000", 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4571000000000001e-05 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032681+0000", 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113533 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032795+0000", 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011422 2024-04-23T19:02:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.037255+0000", 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044602840000000001 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051196+0000", 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013940365 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051237+0000", 2024-04-23T19:02:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1273000000000003e-05 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051287+0000", 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9873000000000002e-05 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2658 3.1 3:8084a442:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.288658339999998, 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020774183000000002, 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2658 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072027+0000", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000001e-06 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073852+0000", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001824677 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073881+0000", 2024-04-23T19:02:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8858000000000001e-05 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073895+0000", 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4297999999999999e-05 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073972+0000", 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7188999999999996e-05 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074120+0000", 2024-04-23T19:02:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014745099999999999 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074221+0000", 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101402 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.078775+0000", 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045542129999999997 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092594+0000", 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013818983999999999 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092716+0000", 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121742 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092798+0000", 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1398999999999998e-05 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2660 3.17 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.265361577, 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027624744999999999, 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2660 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095323+0000", 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.326e-06 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096763+0000", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439409 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096798+0000", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5089999999999998e-05 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096816+0000", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8016000000000002e-05 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096934+0000", 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117774 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097184+0000", 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025011199999999998 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097415+0000", 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000230702 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.103253+0000", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058384910000000003 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122813+0000", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019560371 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122889+0000", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5838000000000001e-05 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122945+0000", 2024-04-23T19:02:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5615999999999997e-05 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2678 3.1 3:833103ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.064239958999998, 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020666644000000001, 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2678 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296445+0000", 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.779e-06 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298083+0000", 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016387019999999999 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298112+0000", 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8796e-05 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298122+0000", 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0263e-05 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298189+0000", 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7077999999999997e-05 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298296+0000", 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106996 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298409+0000", 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112594 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.304486+0000", 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060767750000000004 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.316951+0000", 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012465100999999999 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317043+0000", 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2150000000000004e-05 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317108+0000", 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5409999999999999e-05 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2737 3.12 3:4b5e657b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.293833411000001, 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024833089999999999, 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2737 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066852+0000", 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1130000000000003e-06 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070879+0000", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004026656 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070928+0000", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8442000000000001e-05 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070951+0000", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3529000000000001e-05 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071119+0000", 2024-04-23T19:02:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016777200000000001 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071487+0000", 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036776499999999999 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071877+0000", 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039011999999999999 2024-04-23T19:02:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.090667+0000", 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018790774999999999 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091411+0000", 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00074399600000000002 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091595+0000", 2024-04-23T19:02:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183504 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091681+0000", 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6417999999999998e-05 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2766 3.3 e75/20 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head v 75'4, mlcod=57'2)", 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.877925179999998, 2024-04-23T19:02:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019403538000000001, 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482758+0000", 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8309999999999999e-06 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488183+0000", 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054248029999999997 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488215+0000", 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1962000000000003e-05 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488229+0000", 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488316+0000", 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6718000000000006e-05 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488343+0000", 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7523999999999999e-05 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.502066+0000", 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013722892 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.502160+0000", 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3768000000000001e-05 2024-04-23T19:02:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2775 3.12 3:4a72dfe0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 36.772241068, 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020412445000000001, 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2775 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588444+0000", 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.399e-06 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590332+0000", 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018882300000000001 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590360+0000", 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7474000000000002e-05 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590373+0000", 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2771e-05 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590462+0000", 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9511000000000004e-05 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590646+0000", 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018425900000000001 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590833+0000", 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018679699999999999 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.597142+0000", 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063092759999999999 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608728+0000", 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011585300999999999 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608800+0000", 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2476000000000002e-05 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608853+0000", 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2951000000000002e-05 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3192 3.3d 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:50.445 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.294887474999999, 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028337180999999999, 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3192 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:50.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065796+0000", 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.074e-06 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068360+0000", 2024-04-23T19:02:50.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002563348 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068394+0000", 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4654999999999999e-05 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068408+0000", 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3621000000000001e-05 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068536+0000", 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012814799999999999 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068718+0000", 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000181576 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068871+0000", 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015303699999999999 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.091073+0000", 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022202537000000001 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094026+0000", 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029526470000000001 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094083+0000", 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7371999999999999e-05 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094131+0000", 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8165999999999999e-05 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3266 3.1 3:813560fc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.343326145000001, 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025108429000000002, 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.451 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3266 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:50.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017360+0000", 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3529999999999997e-06 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020806+0000", 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034463530000000001 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020857+0000", 2024-04-23T19:02:50.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0618999999999998e-05 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020884+0000", 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7555999999999998e-05 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021046+0000", 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021305+0000", 2024-04-23T19:02:50.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025975500000000002 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021548+0000", 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024253600000000001 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.035795+0000", 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014247345999999999 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042324+0000", 2024-04-23T19:02:50.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065290180000000001 2024-04-23T19:02:50.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042395+0000", 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1018000000000003e-05 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042464+0000", 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8755000000000002e-05 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3289 3.2b 3:d7f50467:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:50.458 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.015000232, 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024819753, 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3289 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:50.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345686+0000", 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2570000000000001e-06 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348576+0000", 2024-04-23T19:02:50.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028902260000000001 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348611+0000", 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5342999999999997e-05 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348625+0000", 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3995999999999999e-05 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348720+0000", 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4877999999999995e-05 2024-04-23T19:02:50.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348893+0000", 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017255100000000001 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.349051+0000", 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015808700000000001 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.357084+0000", 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080328499999999994 2024-04-23T19:02:50.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370386+0000", 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013302619999999999 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370444+0000", 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8010000000000002e-05 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370501+0000", 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6935000000000003e-05 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.463 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3291 3.12 3:48c04dc1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_306:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 13.982129528, 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020911669000000001, 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.464 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3291 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378556+0000", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380698+0000", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021416180000000001 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380733+0000", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5759000000000001e-05 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380750+0000", 2024-04-23T19:02:50.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6633000000000002e-05 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380851+0000", 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010135499999999999 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381030+0000", 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178942 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381189+0000", 2024-04-23T19:02:50.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159111 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.389668+0000", 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084788350000000005 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399384+0000", 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097162150000000003 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399428+0000", 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3748000000000002e-05 2024-04-23T19:02:50.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399464+0000", 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5753000000000001e-05 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.469 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:50.470 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:50.471 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:50.472+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:50.572 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:50.569+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:50.634 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:50.634 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:50.634 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:50.634 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:50.647 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:50.673 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:50.672+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:50.773 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:50.772+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:50.801 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:50.801 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:50.801 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:50.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:50.874 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:50.873+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:50.943 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:50.943 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.689394046000004, 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.944 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:02:50.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:02:50.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:02:50.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.949 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.374781381000005, 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.950 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:02:50.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:02:50.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:50.956 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.083168696000001, 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:02:50.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 76.006219924000007, 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.961 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.962 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 75.080533982999995, 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:02:50.967 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:02:50.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:02:50.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:02:50.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 74.843249088999997, 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.974 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:02:50.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2586 3.31 3:8c4455ea:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.695402188000003, 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018926205000000001, 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2586 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246390+0000", 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7100000000000001e-06 2024-04-23T19:02:50.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248240+0000", 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018495810000000001 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248264+0000", 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.476e-05 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248275+0000", 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0747999999999999e-05 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248354+0000", 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8510000000000006e-05 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248522+0000", 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000168651 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248675+0000", 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015274599999999999 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.255206+0000", 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00653077 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265176+0000", 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099700750000000001 2024-04-23T19:02:50.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265256+0000", 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0178000000000004e-05 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265313+0000", 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6475999999999999e-05 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2600 3.31 3:8ee85512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.543105738999998, 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017851713000000002, 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2600 2024-04-23T19:02:50.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398685+0000", 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.334e-06 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400252+0000", 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566642 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400278+0000", 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6046000000000001e-05 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400288+0000", 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400365+0000", 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6396999999999994e-05 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400530+0000", 2024-04-23T19:02:50.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165055 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400633+0000", 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103291 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.407340+0000", 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067068079999999999 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416396+0000", 2024-04-23T19:02:50.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090564879999999997 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416479+0000", 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3095000000000003e-05 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416534+0000", 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5104e-05 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.991 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2611 3.4 3:21f36fcf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.427201484999998, 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017422110000000001, 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2611 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.992 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:50.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514590+0000", 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.016e-06 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516644+0000", 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002053699 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516668+0000", 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4193e-05 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516678+0000", 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0318e-05 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516753+0000", 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5090000000000001e-05 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516890+0000", 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136446 2024-04-23T19:02:50.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516984+0000", 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4457999999999996e-05 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.528495+0000", 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011510471 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531862+0000", 2024-04-23T19:02:50.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033677730000000001 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531929+0000", 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6870000000000002e-05 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.532009+0000", 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9776000000000003e-05 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:50.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2626 3.19 3:9b312c7b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 39.276357812999997, 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017263579000000001, 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:50.998 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2626 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:50.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665434+0000", 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2040000000000002e-06 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667901+0000", 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002467169 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667933+0000", 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667949+0000", 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6001000000000001e-05 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668036+0000", 2024-04-23T19:02:51.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6717000000000003e-05 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668203+0000", 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016684299999999999 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668363+0000", 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016080900000000001 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681546+0000", 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013182395 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682575+0000", 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001029259 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682640+0000", 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4766999999999998e-05 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682694+0000", 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4528999999999999e-05 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2659 3.31 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.858315122, 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023940570000000001, 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.004 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2659 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083476+0000", 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.83e-06 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085230+0000", 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017538969999999999 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085264+0000", 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4066000000000002e-05 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085280+0000", 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5637999999999998e-05 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085389+0000", 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010945199999999999 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085662+0000", 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027317500000000001 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085863+0000", 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000200733 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.093539+0000", 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076757409999999998 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107287+0000", 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013747962000000001 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107358+0000", 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1068000000000005e-05 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107414+0000", 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6008000000000003e-05 2024-04-23T19:02:51.009 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2662 3.0 3:0108030e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.824447143999997, 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019529844000000001, 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.010 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2662 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117345+0000", 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1640000000000001e-06 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119138+0000", 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017937369999999999 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119172+0000", 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3822000000000002e-05 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119188+0000", 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6330000000000001e-05 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119270+0000", 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1479999999999999e-05 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119413+0000", 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014276800000000001 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119551+0000", 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013783900000000001 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.130669+0000", 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118795000000001 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136739+0000", 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060699910000000003 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136814+0000", 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5137999999999998e-05 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136871+0000", 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6780000000000002e-05 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2684 3.31 3:8e22aa27:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:51.015 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.587195020000003, 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020907834, 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2684 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354596+0000", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9359999999999999e-06 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356193+0000", 2024-04-23T19:02:51.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001596374 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356226+0000", 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2832e-05 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356242+0000", 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.615e-05 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356318+0000", 2024-04-23T19:02:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6515999999999997e-05 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356488+0000", 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016932399999999999 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356596+0000", 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010820299999999999 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.362305+0000", 2024-04-23T19:02:51.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057088470000000004 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375375+0000", 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013069852999999999 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375444+0000", 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9456999999999996e-05 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375501+0000", 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7342000000000001e-05 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2703 3.4 3:235c0b5d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 38.394258473000001, 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021312615, 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.021 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2703 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547534+0000", 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7730000000000001e-06 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549032+0000", 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001498161 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549069+0000", 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549082+0000", 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2938999999999999e-05 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549153+0000", 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0568000000000006e-05 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549287+0000", 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013435199999999999 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549415+0000", 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012801500000000001 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568210+0000", 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018794621000000001 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568706+0000", 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049601300000000001 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568782+0000", 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6829000000000006e-05 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568843+0000", 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0253000000000001e-05 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.026 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2738 3.19 3:9abdf106:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.852830550999997, 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016779401999999999, 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2738 2024-04-23T19:02:51.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088962+0000", 2024-04-23T19:02:51.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.386e-06 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092904+0000", 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039414419999999999 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092934+0000", 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0666000000000001e-05 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092949+0000", 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4197e-05 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093056+0000", 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107723 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093256+0000", 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000199402 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093445+0000", 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018897400000000001 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.104564+0000", 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118911 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105662+0000", 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010983639999999999 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105702+0000", 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0040999999999998e-05 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105737+0000", 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5296000000000002e-05 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2742 3.31 3:8fd366ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:51.032 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.800076386000001, 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019009742, 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2742 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141716+0000", 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2919999999999997e-06 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143446+0000", 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017294890000000001 2024-04-23T19:02:51.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143479+0000", 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.328e-05 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143495+0000", 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5866999999999999e-05 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143592+0000", 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6906999999999999e-05 2024-04-23T19:02:51.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143794+0000", 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020222400000000001 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143989+0000", 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019437799999999999 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.151434+0000", 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074457100000000003 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160595+0000", 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091610270000000004 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160665+0000", 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9774e-05 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160722+0000", 2024-04-23T19:02:51.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6793999999999999e-05 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2754 3.31 3:8f206ba5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 37.648569055000003, 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018831686, 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.038 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2754 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293223+0000", 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296670+0000", 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003447571 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296714+0000", 2024-04-23T19:02:51.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4197999999999999e-05 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296738+0000", 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3578999999999999e-05 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296882+0000", 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144435 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297176+0000", 2024-04-23T19:02:51.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029393699999999997 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297475+0000", 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029916900000000001 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304021+0000", 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065450780000000002 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311877+0000", 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078560780000000007 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311972+0000", 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5487000000000002e-05 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.312051+0000", 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9050999999999999e-05 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3208 3.8 e88/20 3:10281bce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_223:head v 88'14, mlcod=87'12)", 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.688758563, 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016901868, 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253032+0000", 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7430000000000001e-06 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254616+0000", 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015843649999999999 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254636+0000", 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0122000000000001e-05 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254646+0000", 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5599999999999999e-06 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254719+0000", 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3751000000000006e-05 2024-04-23T19:02:51.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254748+0000", 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8513999999999998e-05 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.269553+0000", 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014805451000000001 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.269932+0000", 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037836199999999998 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.047 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3221 3.19 3:9815806e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 15.52879149, 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018791437000000001, 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.048 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3221 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.413000+0000", 2024-04-23T19:02:51.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1930000000000002e-06 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414602+0000", 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016017430000000001 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414643+0000", 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0782999999999999e-05 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414663+0000", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0721999999999999e-05 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414777+0000", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011350500000000001 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415034+0000", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025707900000000001 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415345+0000", 2024-04-23T19:02:51.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031061199999999999 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431169+0000", 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015824222999999998 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431625+0000", 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045608999999999998 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431697+0000", 2024-04-23T19:02:51.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1526000000000006e-05 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431788+0000", 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1960999999999996e-05 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3286 3.19 3:9871ec9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 14.63890415, 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020318066999999999, 2024-04-23T19:02:51.053 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3286 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302888+0000", 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-06 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306883+0000", 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039948960000000004 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306908+0000", 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5239e-05 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306922+0000", 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3918e-05 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307018+0000", 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5740000000000002e-05 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307215+0000", 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019719599999999999 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307397+0000", 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000182055 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.319179+0000", 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011781514 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.322991+0000", 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038125390000000002 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323138+0000", 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014664600000000001 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323202+0000", 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4579999999999995e-05 2024-04-23T19:02:51.058 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.059 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.059 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.059 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:51.059 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:51.059 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:51.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:51.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:51.061 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:51.057+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:51.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:02:51.161 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:51.157+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:51.229 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:51.229 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:51.229 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:51.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:51.249 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:51.249 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:51.266 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:51.266 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:51.266 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:51.265+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:51.284 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:51.301 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:51.301 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:51.322 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:51.322 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:51.343 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:51.343 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:51.361 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:51.361 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:51.363 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:51.363 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:51.364 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:51.364+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:51.374 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:51.384 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:51.384 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:51.464 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:51.464+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:51.499 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:51.499 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:51.513 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:51.565 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:51.561+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:51.629 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:51.629 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:51.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:51.666 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:51.668+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:51.767 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:51.765+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:51.802 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:51.802 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:51.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:51.906 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:51.905+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:51.969 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:51.968+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:51.987 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:51.987 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.002 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:52.071 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:52.069+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:52.077 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:02:52.139 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:52.139 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.153 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:52.199 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:52.200+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:52.273 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:52.269+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:52.275 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:52.275 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.289 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:52.373 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:52.373+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:52.447 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:52.447 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.462 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:52.474 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:52.473+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:52.576 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:52.573+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:52.579 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:52.579 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.594 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:52.677 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:52.676+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:52.717 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:52.718 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.732 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:52.819 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:52.820+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:52.878 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:52.877+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:52.898 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:52.912 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:53.003 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:53.004+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:53.079 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:53.080+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:53.080 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:53.080 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:53.094 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:53.181 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:53.177+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:53.261 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:53.261 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:53.275 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:53.281 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:53.281+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:53.382 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:53.381+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:53.400 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:53.400 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:53.402 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:53.415 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:53.484 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:53.481+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:53.542 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:53.542 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:53.554 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:53.558 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:53.559 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:53.576 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:53.576 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:53.584 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:53.581+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:53.593 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:53.593 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:53.611 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:53.611 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:53.631 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:53.631 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:53.652 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:53.652 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:53.673 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:53.673 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:53.676 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:53.676 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:53.685 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:53.681+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:53.687 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records in 2024-04-23T19:02:53.687 INFO:tasks.workunit.client.0.smithi169.stderr:200+0 records out 2024-04-23T19:02:53.687 INFO:tasks.workunit.client.0.smithi169.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 14.5725 s, 144 MB/s 2024-04-23T19:02:53.691 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:53.696 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:53.696 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:53.786 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:53.785+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:53.821 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:53.821 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 170.650453723, 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:53.822 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.823 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.824 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.825 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.826 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.827 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 169.917601136, 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024577900999999999, 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.828 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 116 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903956+0000", 2024-04-23T19:02:53.829 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903957+0000", 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.0139999999999999e-06 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903963+0000", 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.003e-06 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903976+0000", 2024-04-23T19:02:53.830 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.305e-05 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903984+0000", 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.5700000000000004e-06 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923712+0000", 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019728591 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.923863+0000", 2024-04-23T19:02:53.831 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150808 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.924071+0000", 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020746299999999999 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926506+0000", 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0024351139999999999 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928372+0000", 2024-04-23T19:02:53.832 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001865776 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928467+0000", 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5668999999999995e-05 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.928534+0000", 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6842999999999997e-05 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.833 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 169.917561952, 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.834 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.835 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.836 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.837 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.838 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2222 3.2a e57/20 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 78.704775228000003, 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025929087999999999, 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.839 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116782+0000", 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116786+0000", 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6229999999999999e-06 2024-04-23T19:02:53.840 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120315+0000", 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003528804 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120345+0000", 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0397000000000001e-05 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120364+0000", 2024-04-23T19:02:53.841 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8689999999999999e-05 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120520+0000", 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015632499999999999 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.120556+0000", 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5676000000000002e-05 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142649+0000", 2024-04-23T19:02:53.842 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022093181999999999 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142711+0000", 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2391000000000006e-05 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2266 3.26 e57/20 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 78.129189681, 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025346239999999999, 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.843 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692368+0000", 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.844 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692371+0000", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0599999999999999e-06 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696398+0000", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040270469999999997 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696452+0000", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.4148999999999999e-05 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696479+0000", 2024-04-23T19:02:53.845 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6656e-05 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696667+0000", 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018794499999999999 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.696716+0000", 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9246000000000003e-05 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717534+0000", 2024-04-23T19:02:53.846 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020818566 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.717714+0000", 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017957100000000001 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2272 3.f 3:f0976e76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:53.847 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 78.057029383, 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02483194, 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2272 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:53.848 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764528+0000", 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.764531+0000", 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9730000000000002e-06 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769459+0000", 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049282800000000002 2024-04-23T19:02:53.849 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769497+0000", 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7826e-05 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769515+0000", 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7689999999999998e-05 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769704+0000", 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018883800000000001 2024-04-23T19:02:53.850 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.769955+0000", 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025166400000000002 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.770178+0000", 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022249699999999999 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.779729+0000", 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0095510119999999993 2024-04-23T19:02:53.851 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.788991+0000", 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092617900000000006 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789174+0000", 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018388200000000001 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.789360+0000", 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018548800000000001 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.852 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2677 3.37 3:ee73e0c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.536555503000002, 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025415575999999999, 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2677 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.853 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285002+0000", 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.285006+0000", 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3599999999999998e-06 2024-04-23T19:02:53.854 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293707+0000", 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0087003949999999997 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293746+0000", 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9882999999999997e-05 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293765+0000", 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8822999999999999e-05 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.855 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.293967+0000", 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166300000000001 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294235+0000", 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267762 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.294471+0000", 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000236739 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.856 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.305162+0000", 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010690511 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310183+0000", 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.005020811 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310293+0000", 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110135 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.857 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.310417+0000", 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124494 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2700 3.37 3:ed1d7adc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.303311159000003, 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024257186, 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.858 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2700 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518246+0000", 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.859 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.518250+0000", 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6830000000000001e-06 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522236+0000", 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039857729999999997 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522277+0000", 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0966e-05 2024-04-23T19:02:53.860 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522298+0000", 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939000000000001e-05 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522423+0000", 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000124981 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522560+0000", 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013736999999999999 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.861 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.522670+0000", 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000109986 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.529296+0000", 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0066259960000000003 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542412+0000", 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013115987000000001 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.862 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542458+0000", 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6223000000000001e-05 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.542503+0000", 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5281999999999998e-05 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:53.863 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 41.211765163000003, 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.864 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.865 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:02:53.866 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:02:53.867 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:02:53.868 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.869 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3280 3.e 3:72bf3fdf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.613777417000001, 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024559213999999999, 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3280 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.870 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207780+0000", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.207813+0000", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2722999999999998e-05 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212197+0000", 2024-04-23T19:02:53.871 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004383957 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212238+0000", 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.125e-05 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212257+0000", 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9306000000000001e-05 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212433+0000", 2024-04-23T19:02:53.872 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017601100000000001 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.212836+0000", 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000403015 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.213267+0000", 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043089499999999999 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.230772+0000", 2024-04-23T19:02:53.873 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017505107999999998 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232238+0000", 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0014662810000000001 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232301+0000", 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.2293999999999997e-05 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232339+0000", 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8374000000000002e-05 2024-04-23T19:02:53.874 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3287 3.37 3:ef4edada:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.501887813, 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034068071999999998, 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.875 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3287 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319673+0000", 2024-04-23T19:02:53.876 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1329999999999999e-06 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324894+0000", 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052214999999999996 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324940+0000", 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5853000000000003e-05 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324960+0000", 2024-04-23T19:02:53.877 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0182000000000001e-05 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325156+0000", 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195878 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325587+0000", 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000430455 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325994+0000", 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040785799999999998 2024-04-23T19:02:53.878 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353421+0000", 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027426841 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353479+0000", 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7908999999999997e-05 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353578+0000", 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8381999999999994e-05 2024-04-23T19:02:53.879 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353738+0000", 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016008099999999999 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3288 3.37 3:ee2739c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 17.486091374000001, 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029560090000000001, 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.880 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3288 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.881 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335469+0000", 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.416e-06 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342301+0000", 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00683207 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342341+0000", 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0009999999999998e-05 2024-04-23T19:02:53.882 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342368+0000", 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6913000000000001e-05 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342655+0000", 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028621000000000001 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343067+0000", 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041280100000000002 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.883 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343543+0000", 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047600700000000003 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.355012+0000", 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011468734 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364851+0000", 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098389810000000001 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.884 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364953+0000", 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010220199999999999 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.365026+0000", 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2745999999999998e-05 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3351 3.f 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:53.885 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.685614386000001, 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.032978032999999997, 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3351 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:53.886 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135946+0000", 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.309e-06 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141166+0000", 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052200889999999998 2024-04-23T19:02:53.887 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141208+0000", 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1329999999999999e-05 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141228+0000", 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499000000000001e-05 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141374+0000", 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145422 2024-04-23T19:02:53.888 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141654+0000", 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028040999999999998 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141901+0000", 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024735099999999998 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.161851+0000", 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019949643 2024-04-23T19:02:53.889 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168711+0000", 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068600629999999996 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168810+0000", 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9347999999999998e-05 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168921+0000", 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110569 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.890 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3357 3.e 3:7013f97c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_372:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.617743079, 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024580902000000002, 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3357 2024-04-23T19:02:53.891 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203814+0000", 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.203817+0000", 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7939999999999998e-06 2024-04-23T19:02:53.892 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207802+0000", 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039852459999999996 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207837+0000", 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5046999999999998e-05 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.207855+0000", 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8063e-05 2024-04-23T19:02:53.893 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208026+0000", 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017055799999999999 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208449+0000", 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000423022 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.208861+0000", 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041173499999999999 2024-04-23T19:02:53.894 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228106+0000", 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019245594000000001 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228170+0000", 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.3219999999999994e-05 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228313+0000", 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014380799999999999 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.895 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.228395+0000", 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1815000000000002e-05 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3358 3.f 3:f3cab0c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.608280123, 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129927000000001, 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.896 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3358 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.897 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213281+0000", 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5329999999999999e-06 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217537+0000", 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004256124 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.898 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217590+0000", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3139000000000001e-05 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217615+0000", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5466e-05 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217791+0000", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017528199999999999 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218180+0000", 2024-04-23T19:02:53.899 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038883899999999998 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218419+0000", 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023947000000000001 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.235595+0000", 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017176365999999998 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239185+0000", 2024-04-23T19:02:53.900 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035899650000000001 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239331+0000", 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145084 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239407+0000", 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6658999999999999e-05 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.901 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3359 3.3f 3:fec9f01f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.597717893999999, 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028738053999999999, 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3359 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.902 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223844+0000", 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9799999999999998e-06 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.903 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229191+0000", 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053469520000000003 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229217+0000", 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5873000000000001e-05 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229231+0000", 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3246e-05 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.904 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229350+0000", 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119975 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229684+0000", 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033336999999999999 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229901+0000", 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021713799999999999 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.905 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.241113+0000", 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011212111 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252378+0000", 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011264918000000001 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252475+0000", 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6818999999999996e-05 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.906 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252578+0000", 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102672 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3361 3.d 3:b10ac292:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.578522908, 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031560294000000003, 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.907 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3361 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.908 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243038+0000", 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2200000000000001e-06 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247434+0000", 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043965050000000002 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247482+0000", 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7839000000000001e-05 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.909 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247501+0000", 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9219999999999999e-05 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247709+0000", 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000207431 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248155+0000", 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044614500000000001 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.910 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248622+0000", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046713800000000003 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273993+0000", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025371365999999999 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274330+0000", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033670599999999998 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.911 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274483+0000", 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015333100000000001 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274595+0000", 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111393 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3367 3.d 3:b3a04ccc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.509726243999999, 2024-04-23T19:02:53.912 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037201347000000003, 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3367 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.913 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311834+0000", 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.869e-06 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315933+0000", 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040989920000000001 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.914 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315975+0000", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2299999999999998e-05 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315994+0000", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8567e-05 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316174+0000", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180271 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:02:53.915 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316185+0000", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1163e-05 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323166+0000", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069803240000000004 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323380+0000", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000214708 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323594+0000", 2024-04-23T19:02:53.916 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021368099999999999 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335136+0000", 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541635 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348704+0000", 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013568334 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348896+0000", 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019216099999999999 2024-04-23T19:02:53.917 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.349032+0000", 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013634199999999999 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3371 3.14 e89/20 3:2ab2acf0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_386:head v 89'14, mlcod=88'12)", 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.461078728, 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025224723000000001, 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.918 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360479+0000", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.360480+0000", 2024-04-23T19:02:53.919 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.595e-06 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364241+0000", 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0037611670000000002 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364278+0000", 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.612e-05 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364295+0000", 2024-04-23T19:02:53.920 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7166000000000001e-05 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364454+0000", 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000159381 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.364495+0000", 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1025000000000001e-05 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385607+0000", 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021111659000000001 2024-04-23T19:02:53.921 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.385703+0000", 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6609999999999998e-05 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3376 3.37 3:ee765f31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 16.414105575000001, 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025998674999999999, 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:02:53.922 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3376 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407452+0000", 2024-04-23T19:02:53.923 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.407488+0000", 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.646e-05 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412769+0000", 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052809679999999996 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412810+0000", 2024-04-23T19:02:53.924 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1233000000000003e-05 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412830+0000", 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.914e-05 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.412967+0000", 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013691800000000001 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413258+0000", 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029166700000000001 2024-04-23T19:02:53.925 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.413500+0000", 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000241843 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.430500+0000", 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016999492000000001 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433276+0000", 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0027760329999999998 2024-04-23T19:02:53.926 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433369+0000", 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3524999999999996e-05 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.433450+0000", 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1396000000000005e-05 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:02:53.927 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:53.928 INFO:tasks.workunit.client.0.smithi169.stdout:Bucket Created: buck_2024_03_23_19_02_53 2024-04-23T19:02:53.929 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:53.928+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:53.929 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:54.030 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:54.028+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:54.068 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:54.068 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:54.068 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:54.068 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:54.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:54.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:02:54.134 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:54.133+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:54.147 INFO:tasks.workunit.client.0.smithi169.stdout:bucket quota max size set for the given user: buck_2024_03_23_19_02_53 2024-04-23T19:02:54.206 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:54.206 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:54.206 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:54.206 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:54.206 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:54.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:54.266 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:54.265+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:54.332 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:54.329+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:54.382 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:54.382 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.556712363000003, 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:02:54.383 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.385 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:02:54.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:02:54.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:02:54.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.467811178999995, 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:02:54.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:02:54.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.337648349999995, 2024-04-23T19:02:54.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:54.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:02:54.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:02:54.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.000139794999996, 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 78.313016825999995, 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.404 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:02:54.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2596 3.1 3:823f69c9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.022889177000003, 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022656223, 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.411 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2596 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:54.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359677+0000", 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2619999999999999e-06 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361558+0000", 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018805149999999999 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361596+0000", 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8875000000000003e-05 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361611+0000", 2024-04-23T19:02:54.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4299e-05 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361689+0000", 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8535000000000006e-05 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361805+0000", 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115553 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361944+0000", 2024-04-23T19:02:54.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013969699999999999 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.368991+0000", 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070468509999999998 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382225+0000", 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013233945 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382278+0000", 2024-04-23T19:02:54.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2445999999999999e-05 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382330+0000", 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244999999999999e-05 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.420 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2599 3.1b 3:d87bc61c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.994133945000002, 2024-04-23T19:02:54.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020622194999999999, 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2599 2024-04-23T19:02:54.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.423 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388431+0000", 2024-04-23T19:02:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390022+0000", 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001591433 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390046+0000", 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3689e-05 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390057+0000", 2024-04-23T19:02:54.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0393e-05 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390120+0000", 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3456999999999999e-05 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390252+0000", 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013155600000000001 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390348+0000", 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6415000000000004e-05 2024-04-23T19:02:54.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.396827+0000", 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006478864 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408927+0000", 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012099903 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408998+0000", 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1734000000000001e-05 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.409051+0000", 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2703e-05 2024-04-23T19:02:54.430 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2625 3.20 e74/58 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head v 74'4, mlcod=57'2)", 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:54.431 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.722287643000001, 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020962752000000001, 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:54.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660277+0000", 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7129999999999999e-06 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666091+0000", 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058138119999999998 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666121+0000", 2024-04-23T19:02:54.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0335999999999999e-05 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666132+0000", 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1268e-05 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666209+0000", 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6118000000000005e-05 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666232+0000", 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3163000000000002e-05 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681139+0000", 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014907689999999999 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681238+0000", 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8652000000000003e-05 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.435 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2650 3.2b 3:d6d56598:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.418376971000001, 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020158368999999999, 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2650 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.436 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964186+0000", 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.964189+0000", 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.818e-06 2024-04-23T19:02:54.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966693+0000", 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025037919999999999 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966729+0000", 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6117e-05 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966745+0000", 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5897e-05 2024-04-23T19:02:54.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.966850+0000", 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105567 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.967064+0000", 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021383700000000001 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.967240+0000", 2024-04-23T19:02:54.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017609200000000001 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.975026+0000", 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077862920000000002 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984268+0000", 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092416170000000006 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984311+0000", 2024-04-23T19:02:54.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3214000000000003e-05 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.984344+0000", 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3126000000000001e-05 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2655 3.1b 3:d98e5ec2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.351867808000002, 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020591821999999999, 2024-04-23T19:02:54.441 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2655 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030697+0000", 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.323e-06 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032435+0000", 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017377060000000001 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032478+0000", 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3220000000000003e-05 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032493+0000", 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4453999999999999e-05 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032567+0000", 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4571000000000001e-05 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032681+0000", 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113533 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032795+0000", 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011422 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.037255+0000", 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044602840000000001 2024-04-23T19:02:54.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051196+0000", 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013940365 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051237+0000", 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1273000000000003e-05 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051287+0000", 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9873000000000002e-05 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2658 3.1 3:8084a442:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.310539532999996, 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020774183000000002, 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.447 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2658 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072027+0000", 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000001e-06 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073852+0000", 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001824677 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073881+0000", 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8858000000000001e-05 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073895+0000", 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4297999999999999e-05 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073972+0000", 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7188999999999996e-05 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074120+0000", 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014745099999999999 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074221+0000", 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101402 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.078775+0000", 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045542129999999997 2024-04-23T19:02:54.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092594+0000", 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013818983999999999 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092716+0000", 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121742 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092798+0000", 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1398999999999998e-05 2024-04-23T19:02:54.452 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2660 3.17 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.287242769999999, 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027624744999999999, 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.453 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2660 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095323+0000", 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.326e-06 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096763+0000", 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439409 2024-04-23T19:02:54.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096798+0000", 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5089999999999998e-05 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096816+0000", 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8016000000000002e-05 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096934+0000", 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117774 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097184+0000", 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025011199999999998 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097415+0000", 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000230702 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.457 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.103253+0000", 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058384910000000003 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122813+0000", 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019560371 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122889+0000", 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5838000000000001e-05 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122945+0000", 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5615999999999997e-05 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2678 3.1 3:833103ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.086121151999997, 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020666644000000001, 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.459 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2678 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296445+0000", 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.779e-06 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298083+0000", 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016387019999999999 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298112+0000", 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8796e-05 2024-04-23T19:02:54.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298122+0000", 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0263e-05 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298189+0000", 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7077999999999997e-05 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298296+0000", 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106996 2024-04-23T19:02:54.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298409+0000", 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112594 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.304486+0000", 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060767750000000004 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.316951+0000", 2024-04-23T19:02:54.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012465100999999999 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317043+0000", 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2150000000000004e-05 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317108+0000", 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5409999999999999e-05 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.464 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2737 3.12 3:4b5e657b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.315714604, 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024833089999999999, 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2737 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066852+0000", 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1130000000000003e-06 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070879+0000", 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004026656 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070928+0000", 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8442000000000001e-05 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070951+0000", 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3529000000000001e-05 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071119+0000", 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016777200000000001 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071487+0000", 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036776499999999999 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071877+0000", 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039011999999999999 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.090667+0000", 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018790774999999999 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091411+0000", 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00074399600000000002 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091595+0000", 2024-04-23T19:02:54.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183504 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091681+0000", 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6417999999999998e-05 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2766 3.3 e75/20 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head v 75'4, mlcod=57'2)", 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.899806372999997, 2024-04-23T19:02:54.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019403538000000001, 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482757+0000", 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.482758+0000", 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8309999999999999e-06 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488183+0000", 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054248029999999997 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488215+0000", 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1962000000000003e-05 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488229+0000", 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4039999999999999e-05 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488316+0000", 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6718000000000006e-05 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488343+0000", 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7523999999999999e-05 2024-04-23T19:02:54.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.502066+0000", 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013722892 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.502160+0000", 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3768000000000001e-05 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.474 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2775 3.12 3:4a72dfe0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 40.794122260999998, 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020412445000000001, 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2775 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.475 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588441+0000", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.588444+0000", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.399e-06 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590332+0000", 2024-04-23T19:02:54.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018882300000000001 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590360+0000", 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7474000000000002e-05 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590373+0000", 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2771e-05 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590462+0000", 2024-04-23T19:02:54.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9511000000000004e-05 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590646+0000", 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018425900000000001 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.590833+0000", 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018679699999999999 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.597142+0000", 2024-04-23T19:02:54.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0063092759999999999 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608728+0000", 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011585300999999999 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608800+0000", 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.2476000000000002e-05 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.608853+0000", 2024-04-23T19:02:54.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2951000000000002e-05 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3192 3.3d 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.316768668000002, 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028337180999999999, 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.480 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3192 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.481 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065796+0000", 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.074e-06 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068360+0000", 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002563348 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068394+0000", 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4654999999999999e-05 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068408+0000", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3621000000000001e-05 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068536+0000", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012814799999999999 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068718+0000", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000181576 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:54.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068871+0000", 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015303699999999999 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.091073+0000", 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022202537000000001 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094026+0000", 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029526470000000001 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094083+0000", 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7371999999999999e-05 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094131+0000", 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8165999999999999e-05 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3266 3.1 3:813560fc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.365207338000001, 2024-04-23T19:02:54.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025108429000000002, 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3266 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017360+0000", 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3529999999999997e-06 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020806+0000", 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034463530000000001 2024-04-23T19:02:54.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020857+0000", 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0618999999999998e-05 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020884+0000", 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7555999999999998e-05 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021046+0000", 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112 2024-04-23T19:02:54.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021305+0000", 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025975500000000002 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021548+0000", 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024253600000000001 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.035795+0000", 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014247345999999999 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042324+0000", 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065290180000000001 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042395+0000", 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1018000000000003e-05 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042464+0000", 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8755000000000002e-05 2024-04-23T19:02:54.490 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3289 3.2b 3:d7f50467:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.036881425000001, 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024819753, 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.491 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3289 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345686+0000", 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2570000000000001e-06 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348576+0000", 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028902260000000001 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348611+0000", 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5342999999999997e-05 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348625+0000", 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3995999999999999e-05 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348720+0000", 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4877999999999995e-05 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348893+0000", 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017255100000000001 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.349051+0000", 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015808700000000001 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.357084+0000", 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080328499999999994 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370386+0000", 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013302619999999999 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370444+0000", 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8010000000000002e-05 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370501+0000", 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6935000000000003e-05 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3291 3.12 3:48c04dc1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_306:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:54.496 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.004010721, 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020911669000000001, 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3291 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378556+0000", 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380698+0000", 2024-04-23T19:02:54.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021416180000000001 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380733+0000", 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5759000000000001e-05 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380750+0000", 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6633000000000002e-05 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380851+0000", 2024-04-23T19:02:54.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010135499999999999 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381030+0000", 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178942 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381189+0000", 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159111 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.389668+0000", 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084788350000000005 2024-04-23T19:02:54.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399384+0000", 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097162150000000003 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399428+0000", 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3748000000000002e-05 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399464+0000", 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5753000000000001e-05 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.501 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.502 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.502 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.502 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.502 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:54.503 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:54.504 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:54.501+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:54.604 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:54.604+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:54.662 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:54.662 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:54.662 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:54.675 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:54.722 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:54.721+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:54.799 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:54.800 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:54.806 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:54.805+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:54.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:54.907 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:54.908+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:54.982 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.728879015000004, 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.983 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:54.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:02:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.989 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.414266350000005, 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.990 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:54.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.993 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:54.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.122653665000001, 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:54.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:02:54.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:02:55.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:02:55.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.001 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:02:55.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:02:55.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:02:55.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:02:55.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:02:55.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:02:55.003 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.003 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.003 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.004 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:55.004 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:55.004 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.045704893000007, 2024-04-23T19:02:55.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:02:55.004 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.005 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.005 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.005 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.005 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:02:55.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.006 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:02:55.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:02:55.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:02:55.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:55.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:02:55.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:02:55.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:02:55.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:02:55.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.012 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:02:55.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:02:55.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:02:55.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:02:55.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:02:55.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:02:55.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.015 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.015 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.016 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:55.016 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:55.016 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.120018951999995, 2024-04-23T19:02:55.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:02:55.016 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.016 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.017 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.017 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.017 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:02:55.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:55.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:55.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:02:55.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:02:55.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:02:55.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.023 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:02:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:02:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:02:55.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:02:55.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 78.882734057999997, 2024-04-23T19:02:55.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:02:55.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2586 3.31 3:8c4455ea:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.734887157000003, 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018926205000000001, 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.034 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2586 2024-04-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246390+0000", 2024-04-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7100000000000001e-06 2024-04-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248240+0000", 2024-04-23T19:02:55.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018495810000000001 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248264+0000", 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.476e-05 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248275+0000", 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0747999999999999e-05 2024-04-23T19:02:55.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248354+0000", 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8510000000000006e-05 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248522+0000", 2024-04-23T19:02:55.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000168651 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248675+0000", 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015274599999999999 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.255206+0000", 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00653077 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265176+0000", 2024-04-23T19:02:55.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099700750000000001 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265256+0000", 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0178000000000004e-05 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265313+0000", 2024-04-23T19:02:55.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6475999999999999e-05 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2600 3.31 3:8ee85512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.582590707999998, 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017851713000000002, 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.042 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2600 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398685+0000", 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.334e-06 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400252+0000", 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566642 2024-04-23T19:02:55.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400278+0000", 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6046000000000001e-05 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400288+0000", 2024-04-23T19:02:55.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400365+0000", 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6396999999999994e-05 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400530+0000", 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165055 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400633+0000", 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103291 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.407340+0000", 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067068079999999999 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416396+0000", 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090564879999999997 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416479+0000", 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3095000000000003e-05 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416534+0000", 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5104e-05 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2611 3.4 3:21f36fcf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:55.049 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.466686453999998, 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017422110000000001, 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2611 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:55.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514590+0000", 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.016e-06 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.051 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516644+0000", 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002053699 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516668+0000", 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4193e-05 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516678+0000", 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0318e-05 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516753+0000", 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5090000000000001e-05 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516890+0000", 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136446 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:55.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516984+0000", 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4457999999999996e-05 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.528495+0000", 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011510471 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531862+0000", 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033677730000000001 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531929+0000", 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6870000000000002e-05 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.532009+0000", 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9776000000000003e-05 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.055 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2626 3.19 3:9b312c7b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.315842781999997, 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017263579000000001, 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.056 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2626 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.057 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665434+0000", 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2040000000000002e-06 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667901+0000", 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002467169 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667933+0000", 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667949+0000", 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6001000000000001e-05 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668036+0000", 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6717000000000003e-05 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668203+0000", 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016684299999999999 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668363+0000", 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016080900000000001 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681546+0000", 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013182395 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682575+0000", 2024-04-23T19:02:55.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001029259 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682640+0000", 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4766999999999998e-05 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682694+0000", 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4528999999999999e-05 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2659 3.31 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.897800091000001, 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023940570000000001, 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2659 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:55.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083476+0000", 2024-04-23T19:02:55.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.83e-06 2024-04-23T19:02:55.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085230+0000", 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017538969999999999 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085264+0000", 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4066000000000002e-05 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085280+0000", 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5637999999999998e-05 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085389+0000", 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010945199999999999 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085662+0000", 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027317500000000001 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085863+0000", 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000200733 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.093539+0000", 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076757409999999998 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107287+0000", 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013747962000000001 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107358+0000", 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1068000000000005e-05 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107414+0000", 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6008000000000003e-05 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2662 3.0 3:0108030e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.863932112999997, 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019529844000000001, 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2662 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117345+0000", 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1640000000000001e-06 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119138+0000", 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017937369999999999 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119172+0000", 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3822000000000002e-05 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.074 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119188+0000", 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6330000000000001e-05 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119270+0000", 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1479999999999999e-05 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119413+0000", 2024-04-23T19:02:55.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014276800000000001 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119551+0000", 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013783900000000001 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.130669+0000", 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118795000000001 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136739+0000", 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060699910000000003 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136814+0000", 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5137999999999998e-05 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136871+0000", 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6780000000000002e-05 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2684 3.31 3:8e22aa27:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.626679989000003, 2024-04-23T19:02:55.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020907834, 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2684 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354596+0000", 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9359999999999999e-06 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.080 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356193+0000", 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001596374 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356226+0000", 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2832e-05 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356242+0000", 2024-04-23T19:02:55.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.615e-05 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356318+0000", 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6515999999999997e-05 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356488+0000", 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016932399999999999 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356596+0000", 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010820299999999999 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.362305+0000", 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057088470000000004 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375375+0000", 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013069852999999999 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375444+0000", 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9456999999999996e-05 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375501+0000", 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7342000000000001e-05 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.084 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2703 3.4 3:235c0b5d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.433743442000001, 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021312615, 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.085 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2703 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547534+0000", 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7730000000000001e-06 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549032+0000", 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001498161 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549069+0000", 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549082+0000", 2024-04-23T19:02:55.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2938999999999999e-05 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549153+0000", 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0568000000000006e-05 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549287+0000", 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013435199999999999 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:55.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549415+0000", 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012801500000000001 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568210+0000", 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018794621000000001 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568706+0000", 2024-04-23T19:02:55.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049601300000000001 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568782+0000", 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6829000000000006e-05 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568843+0000", 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0253000000000001e-05 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.091 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2738 3.19 3:9abdf106:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.892315519999997, 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016779401999999999, 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.092 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.093 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2738 2024-04-23T19:02:55.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.093 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088962+0000", 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.386e-06 2024-04-23T19:02:55.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092904+0000", 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039414419999999999 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092934+0000", 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0666000000000001e-05 2024-04-23T19:02:55.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092949+0000", 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4197e-05 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093056+0000", 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107723 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093256+0000", 2024-04-23T19:02:55.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000199402 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093445+0000", 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018897400000000001 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.104564+0000", 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118911 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105662+0000", 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010983639999999999 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105702+0000", 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0040999999999998e-05 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105737+0000", 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5296000000000002e-05 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2742 3.31 3:8fd366ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.839561355000001, 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019009742, 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.099 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2742 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141716+0000", 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2919999999999997e-06 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143446+0000", 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017294890000000001 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143479+0000", 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.328e-05 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143495+0000", 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5866999999999999e-05 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143592+0000", 2024-04-23T19:02:55.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6906999999999999e-05 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143794+0000", 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020222400000000001 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143989+0000", 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019437799999999999 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.151434+0000", 2024-04-23T19:02:55.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074457100000000003 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160595+0000", 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091610270000000004 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160665+0000", 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9774e-05 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160722+0000", 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6793999999999999e-05 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2754 3.31 3:8f206ba5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:55.105 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 41.688054024000003, 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018831686, 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2754 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293223+0000", 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296670+0000", 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003447571 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296714+0000", 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4197999999999999e-05 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296738+0000", 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3578999999999999e-05 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296882+0000", 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144435 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.109 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297176+0000", 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029393699999999997 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297475+0000", 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029916900000000001 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304021+0000", 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065450780000000002 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311877+0000", 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078560780000000007 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311972+0000", 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5487000000000002e-05 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.312051+0000", 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9050999999999999e-05 2024-04-23T19:02:55.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3208 3.8 e88/20 3:10281bce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_223:head v 88'14, mlcod=87'12)", 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.728243532, 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016901868, 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253032+0000", 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7430000000000001e-06 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254616+0000", 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015843649999999999 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254636+0000", 2024-04-23T19:02:55.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0122000000000001e-05 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254646+0000", 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5599999999999999e-06 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254719+0000", 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3751000000000006e-05 2024-04-23T19:02:55.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254748+0000", 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8513999999999998e-05 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.269553+0000", 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014805451000000001 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.269932+0000", 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037836199999999998 2024-04-23T19:02:55.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3221 3.19 3:9815806e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.568276459, 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018791437000000001, 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.117 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3221 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.413000+0000", 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1930000000000002e-06 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414602+0000", 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016017430000000001 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414643+0000", 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0782999999999999e-05 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414663+0000", 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0721999999999999e-05 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414777+0000", 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011350500000000001 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415034+0000", 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025707900000000001 2024-04-23T19:02:55.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415345+0000", 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031061199999999999 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431169+0000", 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015824222999999998 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.123 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431625+0000", 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045608999999999998 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431697+0000", 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1526000000000006e-05 2024-04-23T19:02:55.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431788+0000", 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1960999999999996e-05 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3286 3.19 3:9871ec9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:55.125 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.678389118999998, 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020318066999999999, 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3286 2024-04-23T19:02:55.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302888+0000", 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-06 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306883+0000", 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039948960000000004 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306908+0000", 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5239e-05 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306922+0000", 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3918e-05 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307018+0000", 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5740000000000002e-05 2024-04-23T19:02:55.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307215+0000", 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019719599999999999 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307397+0000", 2024-04-23T19:02:55.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000182055 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.319179+0000", 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011781514 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.322991+0000", 2024-04-23T19:02:55.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038125390000000002 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323138+0000", 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014664600000000001 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323202+0000", 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4579999999999995e-05 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.132 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.133 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.133 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.133 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:55.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:55.135 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:02:55.136 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:55.133+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:55.235 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:55.233+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:55.299 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:55.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:55.354 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:55.353+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:55.437 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:55.436+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:55.475 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:55.476 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:55.476 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:55.476 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:55.476 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:55.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:55.538 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:55.536+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:55.608 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2193 3.13 3:ca3f57e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 81.021521762999996, 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019092501000000001, 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.609 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2193 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585609+0000", 2024-04-23T19:02:55.610 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.585612+0000", 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7310000000000002e-06 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587871+0000", 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022591159999999998 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.611 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587923+0000", 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.1492000000000001e-05 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.587944+0000", 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1087e-05 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.612 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588036+0000", 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2731000000000004e-05 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588195+0000", 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159106 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.588318+0000", 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012284199999999999 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.613 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.596176+0000", 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078577939999999995 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604591+0000", 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084145709999999992 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604653+0000", 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2008000000000007e-05 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.614 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.604702+0000", 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9023000000000001e-05 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 80.742808186000005, 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.615 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.616 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.617 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.618 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.619 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.620 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.796531431000005, 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:02:55.622 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:02:55.623 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:02:55.624 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.641975661999993, 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.625 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.627 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.628 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.629 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:55.630 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 79.432791803000001, 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:55.631 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:02:55.632 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:02:55.633 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.634 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.635 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2590 3.21 3:86702f7a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.318186709000003, 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028377956999999999, 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.636 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2590 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:02:55.637 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288948+0000", 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4089999999999999e-06 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290740+0000", 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001792774 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.638 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290764+0000", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3901999999999999e-05 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290778+0000", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3485999999999999e-05 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290847+0000", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9556999999999998e-05 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290964+0000", 2024-04-23T19:02:55.639 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011652800000000001 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.291086+0000", 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012249400000000001 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.295914+0000", 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048272369999999998 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317211+0000", 2024-04-23T19:02:55.640 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021297608999999999 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317282+0000", 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0350000000000002e-05 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317322+0000", 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0611000000000001e-05 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2602 3.13 3:c84206b6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.423153+0000", 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.183978367999998, 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019341764000000001, 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2602 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.642 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.423153+0000", 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.423153+0000", 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.423156+0000", 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8279999999999996e-06 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.643 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425242+0000", 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020859889999999999 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425278+0000", 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5482999999999999e-05 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425297+0000", 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9208e-05 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.644 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425389+0000", 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2015000000000006e-05 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425559+0000", 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000170032 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.425702+0000", 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014321099999999999 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.645 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.432853+0000", 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071505140000000002 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.442414+0000", 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095612070000000004 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.442458+0000", 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3912000000000002e-05 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.646 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.442494+0000", 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6365000000000002e-05 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2612 3.1d 3:b8b97969:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 44.081517744000003, 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020723431, 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.647 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2612 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:02:55.648 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525616+0000", 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2119999999999999e-06 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527272+0000", 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001655658 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527292+0000", 2024-04-23T19:02:55.649 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9466999999999998e-05 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527302+0000", 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527364+0000", 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1520999999999996e-05 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527520+0000", 2024-04-23T19:02:55.650 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156804 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527634+0000", 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.535370+0000", 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077363500000000003 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546236+0000", 2024-04-23T19:02:55.651 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010866069000000001 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546281+0000", 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4594e-05 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546337+0000", 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6032000000000002e-05 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.652 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2635 3.2e 3:74863d32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.835871361000002, 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022820072, 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2635 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.653 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771265+0000", 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7989999999999999e-06 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.654 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773229+0000", 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019637729999999998 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773254+0000", 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4494e-05 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773268+0000", 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4117999999999999e-05 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773369+0000", 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101499 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773539+0000", 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017010199999999999 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773696+0000", 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697000000000001 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.783147+0000", 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094510140000000006 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.793991+0000", 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010843428 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794032+0000", 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1223999999999997e-05 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794080+0000", 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7651000000000002e-05 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2654 3.1d 3:bbe5d29a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.015661+0000", 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.591469676999999, 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019430334, 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.658 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2654 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.015661+0000", 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.015661+0000", 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.015666+0000", 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3839999999999999e-06 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019355+0000", 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0036894369999999998 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019390+0000", 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5336999999999997e-05 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019406+0000", 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5775999999999999e-05 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019480+0000", 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3961999999999994e-05 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019594+0000", 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113647 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.019689+0000", 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4907999999999993e-05 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.025136+0000", 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054473459999999996 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.034958+0000", 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0098223979999999995 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.035032+0000", 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3336000000000004e-05 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.035092+0000", 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9803000000000003e-05 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2661 3.13 3:caea25e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.663 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.501726425999998, 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020454087999999999, 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2661 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:02:55.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105408+0000", 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8e-06 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107045+0000", 2024-04-23T19:02:55.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016363980000000001 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107079+0000", 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3899999999999997e-05 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107102+0000", 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159e-05 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107187+0000", 2024-04-23T19:02:55.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4775000000000001e-05 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107359+0000", 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017244600000000001 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107473+0000", 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113565 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.113697+0000", 2024-04-23T19:02:55.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062245319999999996 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125770+0000", 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012073122 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125810+0000", 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9662000000000001e-05 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125859+0000", 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8729000000000001e-05 2024-04-23T19:02:55.668 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2664 3.13 3:c816585d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.468740732999997, 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025442844999999999, 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.669 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2664 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138393+0000", 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0960000000000001e-06 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140225+0000", 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018314309999999999 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140257+0000", 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2319e-05 2024-04-23T19:02:55.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140272+0000", 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4800000000000001e-05 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140345+0000", 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3120999999999993e-05 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140507+0000", 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016169700000000001 2024-04-23T19:02:55.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140629+0000", 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121945 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.147178+0000", 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065491350000000002 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163685+0000", 2024-04-23T19:02:55.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016507705000000001 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163770+0000", 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4227999999999994e-05 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163833+0000", 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3367999999999994e-05 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2703 3.4 e74/20 3:235c0b5d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_138:head v 74'6, mlcod=74'4)", 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.549521+0000", 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 43.057610083999997, 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018955988999999999, 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549521+0000", 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549521+0000", 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549524+0000", 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.751e-06 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551357+0000", 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018333799999999999 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551384+0000", 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6580999999999998e-05 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551397+0000", 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3594000000000001e-05 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551483+0000", 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5601999999999998e-05 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.551505+0000", 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1940999999999999e-05 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568399+0000", 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016894704 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568477+0000", 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7435999999999995e-05 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.678 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2755 3.1d 3:b99e894a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.304226+0000", 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 42.302905226, 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019321808999999999, 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2755 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304226+0000", 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304226+0000", 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304229+0000", 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5669999999999999e-06 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308218+0000", 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039889189999999996 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308247+0000", 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9166000000000002e-05 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308262+0000", 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4766000000000001e-05 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308350+0000", 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7683999999999996e-05 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308556+0000", 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000206257 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.308702+0000", 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000146334 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.318357+0000", 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0096545940000000007 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.323260+0000", 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0049031450000000002 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.323425+0000", 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000164735 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.323548+0000", 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012264200000000001 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3192 3.3d e88/20 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head v 88'10, mlcod=87'8)", 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 20.538162742000001, 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024835230999999999, 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.684 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068970+0000", 2024-04-23T19:02:55.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.694e-06 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070770+0000", 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001800545 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070800+0000", 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9091e-05 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070814+0000", 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070908+0000", 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4918000000000002e-05 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070940+0000", 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1233999999999999e-05 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.093734+0000", 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022794182999999999 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.093803+0000", 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9596000000000002e-05 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3272 3.1d 3:bbf6a720:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_287:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.688 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.094050+0000", 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 19.513080565999999, 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020376459999999999, 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3272 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.094050+0000", 2024-04-23T19:02:55.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.094050+0000", 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.094053+0000", 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7039999999999999e-06 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096539+0000", 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024861900000000001 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096588+0000", 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9067999999999998e-05 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096613+0000", 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5024999999999998e-05 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096733+0000", 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119487 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096927+0000", 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019404599999999999 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.097097+0000", 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016993299999999999 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.105179+0000", 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080825710000000002 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.114352+0000", 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091730570000000001 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.114394+0000", 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1196000000000003e-05 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.114427+0000", 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3182999999999997e-05 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3314 3.2f 3:f4246e92:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.642472+0000", 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.964659090000001, 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019342798000000001, 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.694 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3314 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.642472+0000", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.642472+0000", 2024-04-23T19:02:55.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.642475+0000", 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1839999999999999e-06 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.644640+0000", 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002165298 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.644672+0000", 2024-04-23T19:02:55.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1970000000000001e-05 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.644687+0000", 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4394e-05 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.644772+0000", 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5124999999999996e-05 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.644947+0000", 2024-04-23T19:02:55.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017489400000000001 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.645111+0000", 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016460800000000001 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.652189+0000", 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070779969999999999 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.661690+0000", 2024-04-23T19:02:55.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095003910000000004 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.661764+0000", 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4244000000000003e-05 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.661815+0000", 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0692999999999997e-05 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3341 3.1d 3:bb977fed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.633914021999999, 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023804451000000001, 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3341 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973220+0000", 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2329999999999998e-06 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977722+0000", 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045018870000000004 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977762+0000", 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0092000000000002e-05 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977781+0000", 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8680000000000001e-05 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977908+0000", 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126816 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.978131+0000", 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000223482 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.978302+0000", 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017096 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990346+0000", 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012043633 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.996828+0000", 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064818360000000004 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.996937+0000", 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010987 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.997021+0000", 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3961999999999993e-05 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3342 3.1d 3:bafb0d1d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_357:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.620975795, 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023941924999999999, 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.705 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3342 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986158+0000", 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990855+0000", 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046966430000000003 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990884+0000", 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9119e-05 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990903+0000", 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9392999999999999e-05 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990985+0000", 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.991184+0000", 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019866 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.991360+0000", 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017603900000000001 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.997918+0000", 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065583619999999999 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.009968+0000", 2024-04-23T19:02:55.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012050108 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.010041+0000", 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3232000000000006e-05 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.010097+0000", 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5603999999999998e-05 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3352 3.2f 3:f4d71f5f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 18.461090728999999, 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023081698000000001, 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3352 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:55.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146044+0000", 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.36e-06 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149033+0000", 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029898350000000001 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149066+0000", 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2163999999999999e-05 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149081+0000", 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5401999999999999e-05 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149183+0000", 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101652 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149378+0000", 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019550200000000001 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149560+0000", 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018205200000000001 2024-04-23T19:02:55.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.158745+0000", 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009184958 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.168878+0000", 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010132354999999999 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.169023+0000", 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000145382 2024-04-23T19:02:55.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.169122+0000", 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9036000000000005e-05 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:55.716 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:55.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:02:55.718 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:02:55.719 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:55.717+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:55.818 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:55.817+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:55.876 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:55.876 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:55.877 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:55.889 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:02:55.902 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:55.903 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:55.921 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:55.921 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:55.921 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:55.917+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:55.937 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:55.937 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:55.954 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:55.955 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:55.975 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:55.975 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:55.994 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:55.995 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:56.013 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.013 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.014 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:56.015 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:56.022 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:56.020+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:56.027 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:02:56.035 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:56.035 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:56.121 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:56.120+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:56.149 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.149 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.162 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:02:56.222 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:56.224+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:56.294 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.294 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.309 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:02:56.323 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:56.321+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:56.424 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:56.421+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:56.474 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.474 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.489 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:02:56.535 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:56.536+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:56.610 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.611 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.625 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:02:56.667 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:56.668+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:56.727 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:56.728+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:56.792 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.792 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.807 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:02:56.828 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:56.825+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:56.931 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:56.932+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:56.972 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:56.972 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:56.987 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:02:57.031 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:57.029+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:57.133 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:57.129+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:57.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T19:02:57.155 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:57.155 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:57.170 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:02:57.234 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:57.233+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:57.242 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T19:02:57.242 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T19:02:57.243 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-04-23T19:02:57.243 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-23T19:02:57.243 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-23T19:02:57.243 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-04-23T19:02:57.293 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:57.293 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:57.310 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:02:57.334 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:02:57.333+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:02:57.368 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:02:57.368 INFO:teuthology.orchestra.run.smithi193.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-23T19:02:57.369 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:02:57.432 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:57.433 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:57.435 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:57.433+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:57.446 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:02:57.536 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:57.533+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:57.569 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:57.569 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:57.583 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:02:57.637 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:02:57.636+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:02:57.701 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:57.701 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:57.715 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:02:57.759 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:57.760+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:57.839 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:57.840+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:57.877 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:57.877 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:57.891 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:02:57.979 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:57.980+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:58.041 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:58.040+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:58.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:02:58.059 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:02:58.059 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:02:58.073 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:02:58.107 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is set 2024-04-23T19:02:58.142 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:58.144+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:58.221 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:02:58.221 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:02:58.243 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:02:58.244 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:02:58.244 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:58.244+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:58.245 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:58.245 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:58.245 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:58.263 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:02:58.270 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:02:58.270 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:02:58.289 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:02:58.289 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:02:58.314 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:02:58.314 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:02:58.343 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:02:58.343 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:02:58.344 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:58.344+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:58.367 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:02:58.367 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:02:58.393 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:02:58.393 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:02:58.442 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:58.442 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:58.442 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:58.442 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:58.443 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:58.445 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:58.444+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:58.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:02:58.548 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:58.548+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:58.647 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:58.645+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2111 3.12 3:4aacd394:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.827949329000006, 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020770323, 2024-04-23T19:02:58.654 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2111 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.655 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825851+0000", 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.825853+0000", 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2029999999999999e-06 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827266+0000", 2024-04-23T19:02:58.656 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001413589 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827300+0000", 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3654e-05 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827315+0000", 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5457000000000001e-05 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.657 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827399+0000", 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3894999999999996e-05 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827524+0000", 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000125036 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.827643+0000", 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011854999999999999 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.658 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.835037+0000", 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073945310000000002 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846480+0000", 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011442394 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846561+0000", 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1551999999999994e-05 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.659 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:33.846621+0000", 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9462000000000001e-05 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2211 3.30 e56/20 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head v 56'1, mlcod=0'0)", 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.739048144999998, 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02100227, 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.660 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914752+0000", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.914755+0000", 2024-04-23T19:02:58.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2669999999999998e-06 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920059+0000", 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053043439999999999 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920100+0000", 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1093000000000001e-05 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920119+0000", 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8672999999999999e-05 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920265+0000", 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014587700000000001 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.920322+0000", 2024-04-23T19:02:58.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7231999999999997e-05 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935624+0000", 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0153019 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935754+0000", 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012988400000000001 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.608885315999999, 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:02:58.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:02:58.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2244 3.b e57/20 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head v 57'3, mlcod=56'1)", 2024-04-23T19:02:58.671 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.271376760999999, 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022068382000000001, 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382423+0000", 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382424+0000", 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.068e-06 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384675+0000", 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022511710000000002 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384714+0000", 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8163e-05 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384732+0000", 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8145e-05 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384870+0000", 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013862799999999999 2024-04-23T19:02:58.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.384912+0000", 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1257000000000002e-05 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404364+0000", 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019452864 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404491+0000", 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000127086 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.676 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 82.584253791999998, 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.677 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2596 3.1 3:823f69c9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:58.682 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.294126143, 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022656223, 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2596 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359677+0000", 2024-04-23T19:02:58.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2619999999999999e-06 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361558+0000", 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018805149999999999 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361596+0000", 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8875000000000003e-05 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361611+0000", 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4299e-05 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361689+0000", 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8535000000000006e-05 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361805+0000", 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115553 2024-04-23T19:02:58.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361944+0000", 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013969699999999999 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.368991+0000", 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070468509999999998 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382225+0000", 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013233945 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382278+0000", 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2445999999999999e-05 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382330+0000", 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244999999999999e-05 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2599 3.1b 3:d87bc61c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.688 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.265370910999998, 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020622194999999999, 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2599 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388429+0000", 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.388431+0000", 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0480000000000001e-06 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390022+0000", 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001591433 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390046+0000", 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3689e-05 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390057+0000", 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0393e-05 2024-04-23T19:02:58.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390120+0000", 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3456999999999999e-05 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390252+0000", 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013155600000000001 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.390348+0000", 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6415000000000004e-05 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.396827+0000", 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006478864 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408927+0000", 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012099903 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.408998+0000", 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1734000000000001e-05 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.409051+0000", 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2703e-05 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2625 3.20 e74/58 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head v 74'4, mlcod=57'2)", 2024-04-23T19:02:58.694 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.993524608999998, 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020962752000000001, 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660275+0000", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.660277+0000", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7129999999999999e-06 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666091+0000", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058138119999999998 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666121+0000", 2024-04-23T19:02:58.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0335999999999999e-05 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666132+0000", 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1268e-05 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666209+0000", 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6118000000000005e-05 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.666232+0000", 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3163000000000002e-05 2024-04-23T19:02:58.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681139+0000", 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014907689999999999 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681238+0000", 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8652000000000003e-05 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2655 3.1b 3:d98e5ec2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.623104773999998, 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020591821999999999, 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2655 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030695+0000", 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.030697+0000", 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.323e-06 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032435+0000", 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017377060000000001 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032478+0000", 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3220000000000003e-05 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032493+0000", 2024-04-23T19:02:58.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4453999999999999e-05 2024-04-23T19:02:58.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032567+0000", 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4571000000000001e-05 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032681+0000", 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113533 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.032795+0000", 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011422 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.037255+0000", 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044602840000000001 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051196+0000", 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013940365 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051237+0000", 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1273000000000003e-05 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.051287+0000", 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9873000000000002e-05 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2658 3.1 3:8084a442:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.581776499, 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020774183000000002, 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.705 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2658 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072023+0000", 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.072027+0000", 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9700000000000001e-06 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073852+0000", 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001824677 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073881+0000", 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8858000000000001e-05 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073895+0000", 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4297999999999999e-05 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.073972+0000", 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7188999999999996e-05 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074120+0000", 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014745099999999999 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.074221+0000", 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101402 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.078775+0000", 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045542129999999997 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092594+0000", 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013818983999999999 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092716+0000", 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121742 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.092798+0000", 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1398999999999998e-05 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.710 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2660 3.17 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.558479736000002, 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027624744999999999, 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2660 2024-04-23T19:02:58.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:02:58.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095323+0000", 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.326e-06 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096763+0000", 2024-04-23T19:02:58.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439409 2024-04-23T19:02:58.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096798+0000", 2024-04-23T19:02:58.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5089999999999998e-05 2024-04-23T19:02:58.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096816+0000", 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8016000000000002e-05 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.715 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096934+0000", 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117774 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097184+0000", 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025011199999999998 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097415+0000", 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000230702 2024-04-23T19:02:58.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.103253+0000", 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058384910000000003 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122813+0000", 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019560371 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122889+0000", 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5838000000000001e-05 2024-04-23T19:02:58.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122945+0000", 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5615999999999997e-05 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2678 3.1 3:833103ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.357358118000001, 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020666644000000001, 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.718 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2678 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296442+0000", 2024-04-23T19:02:58.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.296445+0000", 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.779e-06 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298083+0000", 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016387019999999999 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298112+0000", 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8796e-05 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298122+0000", 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0263e-05 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298189+0000", 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7077999999999997e-05 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298296+0000", 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106996 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.298409+0000", 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000112594 2024-04-23T19:02:58.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.304486+0000", 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060767750000000004 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.316951+0000", 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012465100999999999 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317043+0000", 2024-04-23T19:02:58.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2150000000000004e-05 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.317108+0000", 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5409999999999999e-05 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2737 3.12 3:4b5e657b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 45.586951569999997, 2024-04-23T19:02:58.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024833089999999999, 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2737 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066852+0000", 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1130000000000003e-06 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070879+0000", 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004026656 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070928+0000", 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8442000000000001e-05 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070951+0000", 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3529000000000001e-05 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071119+0000", 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016777200000000001 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071487+0000", 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036776499999999999 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071877+0000", 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039011999999999999 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.090667+0000", 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018790774999999999 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091411+0000", 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00074399600000000002 2024-04-23T19:02:58.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091595+0000", 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183504 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091681+0000", 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6417999999999998e-05 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3192 3.3d 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.588005634000002, 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028337180999999999, 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3192 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065796+0000", 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.074e-06 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068360+0000", 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002563348 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068394+0000", 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4654999999999999e-05 2024-04-23T19:02:58.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068408+0000", 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3621000000000001e-05 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068536+0000", 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012814799999999999 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068718+0000", 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000181576 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068871+0000", 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015303699999999999 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.091073+0000", 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022202537000000001 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094026+0000", 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029526470000000001 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094083+0000", 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7371999999999999e-05 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094131+0000", 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8165999999999999e-05 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3266 3.1 3:813560fc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.636444304000001, 2024-04-23T19:02:58.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025108429000000002, 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3266 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017360+0000", 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3529999999999997e-06 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020806+0000", 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034463530000000001 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020857+0000", 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0618999999999998e-05 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020884+0000", 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7555999999999998e-05 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021046+0000", 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021305+0000", 2024-04-23T19:02:58.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025975500000000002 2024-04-23T19:02:58.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:58.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021548+0000", 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024253600000000001 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.035795+0000", 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014247345999999999 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042324+0000", 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065290180000000001 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042395+0000", 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1018000000000003e-05 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042464+0000", 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8755000000000002e-05 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.743 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3289 3.2b 3:d7f50467:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.308118391000001, 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024819753, 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3289 2024-04-23T19:02:58.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345686+0000", 2024-04-23T19:02:58.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2570000000000001e-06 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348576+0000", 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028902260000000001 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348611+0000", 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5342999999999997e-05 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.746 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348625+0000", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3995999999999999e-05 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348720+0000", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4877999999999995e-05 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348893+0000", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017255100000000001 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.349051+0000", 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015808700000000001 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.357084+0000", 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080328499999999994 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370386+0000", 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013302619999999999 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370444+0000", 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8010000000000002e-05 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370501+0000", 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6935000000000003e-05 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3291 3.12 3:48c04dc1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_306:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:58.749 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.275247687, 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020911669000000001, 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3291 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378552+0000", 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.378556+0000", 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7000000000000002e-06 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380698+0000", 2024-04-23T19:02:58.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021416180000000001 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380733+0000", 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5759000000000001e-05 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380750+0000", 2024-04-23T19:02:58.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6633000000000002e-05 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.380851+0000", 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010135499999999999 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381030+0000", 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178942 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.381189+0000", 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000159111 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.389668+0000", 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084788350000000005 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399384+0000", 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097162150000000003 2024-04-23T19:02:58.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399428+0000", 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3748000000000002e-05 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.399464+0000", 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5753000000000001e-05 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3661 3.10 e96/20 3:0ab460e7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_15:head v 96'15, mlcod=89'13)", 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.325614+0000", 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.32818599500000001, 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020856197999999999, 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.325614+0000", 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.325614+0000", 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.325614+0000", 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9999999999999998e-07 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.331012+0000", 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.005397921 2024-04-23T19:02:58.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.331031+0000", 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.855e-05 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.331042+0000", 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1525000000000001e-05 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.331123+0000", 2024-04-23T19:02:58.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1156999999999996e-05 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.331153+0000", 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9992999999999999e-05 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.346384+0000", 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015230552 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.346470+0000", 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6100000000000006e-05 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3672 3.12 3:49945637:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.445098+0000", 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.20870142999999999, 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025051692, 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.760 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3672 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.445098+0000", 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.445098+0000", 2024-04-23T19:02:58.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.445101+0000", 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2110000000000001e-06 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447273+0000", 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021725770000000002 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447302+0000", 2024-04-23T19:02:58.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8932e-05 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447316+0000", 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3679000000000001e-05 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447410+0000", 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3880000000000002e-05 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447560+0000", 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014996000000000001 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447691+0000", 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013137700000000001 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.457814+0000", 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122443 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.764 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.470035+0000", 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012221569999999999 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.470100+0000", 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4541000000000004e-05 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.470150+0000", 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0522000000000002e-05 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.765 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3682 3.12 3:4b0bbe6f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.544965+0000", 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.108834498, 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022743145999999999, 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:58.766 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3682 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.544965+0000", 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.544965+0000", 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:58.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.544969+0000", 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2780000000000002e-06 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546596+0000", 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016269640000000001 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546624+0000", 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8637999999999999e-05 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546635+0000", 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0998999999999999e-05 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546723+0000", 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7657000000000005e-05 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546896+0000", 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017346199999999999 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.547070+0000", 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000173912 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.553827+0000", 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067565510000000004 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.567598+0000", 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013771576000000001 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.770 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.567659+0000", 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0622000000000003e-05 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.567709+0000", 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9487000000000002e-05 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:58.771 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:58.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:02:58.773 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:58.772+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:58.873 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:58.869+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:58.953 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:58.953 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:58.953 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:58.954 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:58.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:02:58.975 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:58.972+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:59.075 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:02:59.076+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:02:59.176 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:02:59.173+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:02:59.187 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:59.188 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:59.188 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:59.188 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:59.188 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:59.208 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:02:59.294 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:59.293+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:02:59.378 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:02:59.376+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2153 3.4 3:22f02f8b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.146919824999998, 2024-04-23T19:02:59.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017139871000000001, 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2153 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252394+0000", 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.252398+0000", 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2339999999999999e-06 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.253989+0000", 2024-04-23T19:02:59.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015908820000000001 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254018+0000", 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8969e-05 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254028+0000", 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0604999999999999e-05 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254109+0000", 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0500999999999994e-05 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254278+0000", 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000169178 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.254434+0000", 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156584 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269079+0000", 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01464502 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269415+0000", 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00033595100000000002 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269480+0000", 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4808999999999996e-05 2024-04-23T19:02:59.404 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.269534+0000", 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4138000000000002e-05 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2191 3.31 3:8d6f07f5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:59.405 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.832307159999999, 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017261998000000001, 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2191 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.406 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567007+0000", 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.407 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.567011+0000", 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7979999999999999e-06 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569391+0000", 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0023796440000000002 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.408 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569424+0000", 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3456e-05 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569439+0000", 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5218000000000001e-05 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569529+0000", 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9574000000000007e-05 2024-04-23T19:02:59.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569717+0000", 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000187861 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.569875+0000", 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000158696 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.410 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.577367+0000", 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074918770000000001 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584195+0000", 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0068278289999999997 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584237+0000", 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2076000000000002e-05 2024-04-23T19:02:59.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.584269+0000", 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1968999999999998e-05 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.540694474999995, 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.412 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.413 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.414 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.415 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.463745703000001, 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.417 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:02:59.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.419 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:02:59.420 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:02:59.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:02:59.422 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.538059762000003, 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:02:59.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:02:59.424 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:02:59.425 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:02:59.426 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.427 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2298 3.3e 3:7cab2204:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:02:59.428 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.300774868000005, 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017813487999999999, 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2298 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.429 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098539+0000", 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.098543+0000", 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5580000000000001e-06 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.430 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100401+0000", 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018577509999999999 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100419+0000", 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.806e-05 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100428+0000", 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0000000000000002e-06 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.431 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100501+0000", 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3036999999999999e-05 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100633+0000", 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013177999999999999 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.100734+0000", 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010162000000000001 2024-04-23T19:02:59.432 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.107685+0000", 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069502770000000004 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116249+0000", 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0085647359999999999 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116305+0000", 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5463000000000001e-05 2024-04-23T19:02:59.433 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.116353+0000", 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8205999999999999e-05 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2586 3.31 3:8c4455ea:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.152927966999997, 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018926205000000001, 2024-04-23T19:02:59.434 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2586 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.435 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246390+0000", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7100000000000001e-06 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248240+0000", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018495810000000001 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.436 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248264+0000", 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.476e-05 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248275+0000", 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0747999999999999e-05 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248354+0000", 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8510000000000006e-05 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.437 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248522+0000", 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000168651 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248675+0000", 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015274599999999999 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.255206+0000", 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00653077 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.438 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265176+0000", 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099700750000000001 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265256+0000", 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0178000000000004e-05 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265313+0000", 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6475999999999999e-05 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.439 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2600 3.31 3:8ee85512:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.000631517999999, 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017851713000000002, 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2600 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.440 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398683+0000", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.398685+0000", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.334e-06 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.441 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400252+0000", 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001566642 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400278+0000", 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6046000000000001e-05 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400288+0000", 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0453e-05 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.442 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400365+0000", 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6396999999999994e-05 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400530+0000", 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000165055 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.400633+0000", 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103291 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.443 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.407340+0000", 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067068079999999999 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416396+0000", 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090564879999999997 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.444 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416479+0000", 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3095000000000003e-05 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.416534+0000", 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5104e-05 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2611 3.4 3:21f36fcf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.884727263999999, 2024-04-23T19:02:59.445 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017422110000000001, 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2611 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.446 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514587+0000", 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.514590+0000", 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.016e-06 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516644+0000", 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002053699 2024-04-23T19:02:59.447 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516668+0000", 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4193e-05 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516678+0000", 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0318e-05 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516753+0000", 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5090000000000001e-05 2024-04-23T19:02:59.448 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516890+0000", 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136446 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.516984+0000", 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4457999999999996e-05 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.449 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.528495+0000", 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011510471 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531862+0000", 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0033677730000000001 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.531929+0000", 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6870000000000002e-05 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.450 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.532009+0000", 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9776000000000003e-05 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2626 3.19 3:9b312c7b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.733883591999998, 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017263579000000001, 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.451 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2626 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665431+0000", 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.452 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.665434+0000", 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2040000000000002e-06 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667901+0000", 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002467169 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667933+0000", 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1885999999999999e-05 2024-04-23T19:02:59.453 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.667949+0000", 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6001000000000001e-05 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668036+0000", 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6717000000000003e-05 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.454 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668203+0000", 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016684299999999999 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.668363+0000", 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016080900000000001 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.681546+0000", 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013182395 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.455 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682575+0000", 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001029259 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682640+0000", 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4766999999999998e-05 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.682694+0000", 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4528999999999999e-05 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.456 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2659 3.31 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.315840901000001, 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023940570000000001, 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2659 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083476+0000", 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.83e-06 2024-04-23T19:02:59.458 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085230+0000", 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017538969999999999 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085264+0000", 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4066000000000002e-05 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085280+0000", 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5637999999999998e-05 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.459 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085389+0000", 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010945199999999999 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085662+0000", 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027317500000000001 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085863+0000", 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000200733 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.460 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.093539+0000", 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076757409999999998 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107287+0000", 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013747962000000001 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107358+0000", 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1068000000000005e-05 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.461 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107414+0000", 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6008000000000003e-05 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2662 3.0 3:0108030e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.281972922999998, 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019529844000000001, 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.462 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2662 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.463 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.464 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117345+0000", 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1640000000000001e-06 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119138+0000", 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017937369999999999 2024-04-23T19:02:59.465 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119172+0000", 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3822000000000002e-05 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119188+0000", 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6330000000000001e-05 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.466 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119270+0000", 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1479999999999999e-05 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119413+0000", 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014276800000000001 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119551+0000", 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013783900000000001 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.467 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.130669+0000", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118795000000001 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136739+0000", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060699910000000003 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136814+0000", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5137999999999998e-05 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.468 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136871+0000", 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6780000000000002e-05 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2684 3.31 3:8e22aa27:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.044720798999997, 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020907834, 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.469 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2684 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:02:59.470 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354596+0000", 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9359999999999999e-06 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356193+0000", 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001596374 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356226+0000", 2024-04-23T19:02:59.471 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2832e-05 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356242+0000", 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.615e-05 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356318+0000", 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6515999999999997e-05 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356488+0000", 2024-04-23T19:02:59.472 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016932399999999999 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356596+0000", 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010820299999999999 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.362305+0000", 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057088470000000004 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375375+0000", 2024-04-23T19:02:59.473 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013069852999999999 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375444+0000", 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9456999999999996e-05 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375501+0000", 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7342000000000001e-05 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2703 3.4 3:235c0b5d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.851784252000002, 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021312615, 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2703 2024-04-23T19:02:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.476 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547534+0000", 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7730000000000001e-06 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549032+0000", 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001498161 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549069+0000", 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.477 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549082+0000", 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2938999999999999e-05 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549153+0000", 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0568000000000006e-05 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549287+0000", 2024-04-23T19:02:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013435199999999999 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549415+0000", 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012801500000000001 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568210+0000", 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018794621000000001 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.479 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568706+0000", 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049601300000000001 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568782+0000", 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6829000000000006e-05 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568843+0000", 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0253000000000001e-05 2024-04-23T19:02:59.480 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2738 3.19 3:9abdf106:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.310356329999998, 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016779401999999999, 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.481 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2738 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088958+0000", 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.482 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.088962+0000", 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.386e-06 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092904+0000", 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039414419999999999 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092934+0000", 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0666000000000001e-05 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.483 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.092949+0000", 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4197e-05 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093056+0000", 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107723 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.484 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093256+0000", 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000199402 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.093445+0000", 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018897400000000001 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.104564+0000", 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118911 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.485 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105662+0000", 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0010983639999999999 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105702+0000", 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0040999999999998e-05 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.105737+0000", 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5296000000000002e-05 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.486 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2742 3.31 3:8fd366ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.257602165000002, 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019009742, 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.487 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2742 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141716+0000", 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2919999999999997e-06 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143446+0000", 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017294890000000001 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143479+0000", 2024-04-23T19:02:59.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.328e-05 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143495+0000", 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5866999999999999e-05 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143592+0000", 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6906999999999999e-05 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143794+0000", 2024-04-23T19:02:59.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020222400000000001 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143989+0000", 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019437799999999999 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.151434+0000", 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074457100000000003 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160595+0000", 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091610270000000004 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160665+0000", 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9774e-05 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160722+0000", 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6793999999999999e-05 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.492 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2754 3.31 3:8f206ba5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 46.106094833999997, 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018831686, 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.493 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2754 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293223+0000", 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296670+0000", 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003447571 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296714+0000", 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4197999999999999e-05 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296738+0000", 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3578999999999999e-05 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296882+0000", 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144435 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297176+0000", 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029393699999999997 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297475+0000", 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029916900000000001 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304021+0000", 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065450780000000002 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311877+0000", 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078560780000000007 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311972+0000", 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5487000000000002e-05 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.312051+0000", 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9050999999999999e-05 2024-04-23T19:02:59.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3208 3.8 e88/20 3:10281bce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_223:head v 88'14, mlcod=87'12)", 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.146284342000001, 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016901868, 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253030+0000", 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.253032+0000", 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7430000000000001e-06 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254616+0000", 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015843649999999999 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254636+0000", 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0122000000000001e-05 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254646+0000", 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5599999999999999e-06 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254719+0000", 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3751000000000006e-05 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.254748+0000", 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8513999999999998e-05 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.269553+0000", 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014805451000000001 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.269932+0000", 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00037836199999999998 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3221 3.19 3:9815806e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.986317269000001, 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018791437000000001, 2024-04-23T19:02:59.503 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3221 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.413000+0000", 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1930000000000002e-06 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414602+0000", 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016017430000000001 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414643+0000", 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0782999999999999e-05 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414663+0000", 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0721999999999999e-05 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414777+0000", 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011350500000000001 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415034+0000", 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025707900000000001 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415345+0000", 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031061199999999999 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431169+0000", 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015824222999999998 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431625+0000", 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045608999999999998 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431697+0000", 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1526000000000006e-05 2024-04-23T19:02:59.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431788+0000", 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1960999999999996e-05 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3286 3.19 3:9871ec9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.096429928999999, 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020318066999999999, 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:02:59.509 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3286 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302888+0000", 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-06 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306883+0000", 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039948960000000004 2024-04-23T19:02:59.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306908+0000", 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5239e-05 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306922+0000", 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3918e-05 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307018+0000", 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5740000000000002e-05 2024-04-23T19:02:59.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307215+0000", 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019719599999999999 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307397+0000", 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000182055 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:02:59.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.319179+0000", 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011781514 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.322991+0000", 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038125390000000002 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323138+0000", 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014664600000000001 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:02:59.514 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323202+0000", 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4579999999999995e-05 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:02:59.515 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:59.517 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:02:59.517 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:02:59.513+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:02:59.618 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:59.616+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:59.702 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:59.702 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:02:59.704 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:59.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:02:59.718 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:59.720+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:59.820 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:02:59.820+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:02:59.859 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:02:59.860 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:02:59.860 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:02:59.860 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:02:59.860 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:02:59.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:02:59.930 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:02:59.929+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:00.021 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:00.020+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2209 3.2e 3:756d4828:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 85.163113273999997, 2024-04-23T19:03:00.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019854402, 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2209 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864323+0000", 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864327+0000", 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4100000000000001e-06 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.029 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868146+0000", 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003818545 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868205+0000", 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9039000000000002e-05 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868232+0000", 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6962999999999999e-05 2024-04-23T19:03:00.030 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868361+0000", 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129684 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868608+0000", 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024673300000000001 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:00.031 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.868823+0000", 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021515400000000001 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882820+0000", 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013996655 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884103+0000", 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0012826980000000001 2024-04-23T19:03:00.032 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884141+0000", 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8674000000000003e-05 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.884177+0000", 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5846999999999997e-05 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.033 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.034 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.216836518999997, 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.035 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.036 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.037 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.038 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 84.062280749999999, 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:03:00.039 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.040 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.041 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:03:00.042 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:03:00.043 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:03:00.044 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2305 3.2e 3:7600ead4:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 83.853096891000007, 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020000750000000001, 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.045 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2305 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.046 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174339+0000", 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.174342+0000", 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1879999999999998e-06 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175878+0000", 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015360490000000001 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.047 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175902+0000", 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3283999999999999e-05 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.175915+0000", 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3509999999999999e-05 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176006+0000", 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0502999999999997e-05 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.048 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176178+0000", 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172502 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.176338+0000", 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016008299999999999 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.183675+0000", 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073369760000000003 2024-04-23T19:03:00.049 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194172+0000", 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010496884 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194264+0000", 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.2072999999999998e-05 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.050 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.194340+0000", 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5698000000000006e-05 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2590 3.21 3:86702f7a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.738491797000002, 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028377956999999999, 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.051 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2590 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.052 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288948+0000", 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4089999999999999e-06 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290740+0000", 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001792774 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.053 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290764+0000", 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3901999999999999e-05 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290778+0000", 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3485999999999999e-05 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290847+0000", 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9556999999999998e-05 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.054 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290964+0000", 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011652800000000001 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.291086+0000", 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012249400000000001 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.295914+0000", 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048272369999999998 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.055 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317211+0000", 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021297608999999999 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317282+0000", 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0350000000000002e-05 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317322+0000", 2024-04-23T19:03:00.056 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0611000000000001e-05 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2612 3.1d 3:b8b97969:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.501822832000002, 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020723431, 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.057 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2612 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.058 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525616+0000", 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2119999999999999e-06 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527272+0000", 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001655658 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527292+0000", 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9466999999999998e-05 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.059 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527302+0000", 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527364+0000", 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1520999999999996e-05 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527520+0000", 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156804 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.060 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527634+0000", 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.535370+0000", 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077363500000000003 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546236+0000", 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010866069000000001 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.061 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546281+0000", 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4594e-05 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546337+0000", 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6032000000000002e-05 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2635 3.2e 3:74863d32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:00.062 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 48.256176449000002, 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022820072, 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2635 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.063 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771265+0000", 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7989999999999999e-06 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773229+0000", 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019637729999999998 2024-04-23T19:03:00.064 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773254+0000", 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4494e-05 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773268+0000", 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4117999999999999e-05 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773369+0000", 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101499 2024-04-23T19:03:00.065 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773539+0000", 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017010199999999999 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773696+0000", 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697000000000001 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.783147+0000", 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094510140000000006 2024-04-23T19:03:00.066 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.793991+0000", 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010843428 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794032+0000", 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1223999999999997e-05 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794080+0000", 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7651000000000002e-05 2024-04-23T19:03:00.067 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2661 3.13 3:caea25e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.922031513999997, 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020454087999999999, 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.068 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2661 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.069 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105408+0000", 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8e-06 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107045+0000", 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016363980000000001 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107079+0000", 2024-04-23T19:03:00.070 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3899999999999997e-05 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107102+0000", 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159e-05 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107187+0000", 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4775000000000001e-05 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107359+0000", 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017244600000000001 2024-04-23T19:03:00.071 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107473+0000", 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113565 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.113697+0000", 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062245319999999996 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125770+0000", 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012073122 2024-04-23T19:03:00.072 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125810+0000", 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9662000000000001e-05 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125859+0000", 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8729000000000001e-05 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.073 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2664 3.13 3:c816585d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 47.889045821000003, 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025442844999999999, 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2664 2024-04-23T19:03:00.074 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.075 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138393+0000", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0960000000000001e-06 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140225+0000", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018314309999999999 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140257+0000", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2319e-05 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140272+0000", 2024-04-23T19:03:00.076 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4800000000000001e-05 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140345+0000", 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3120999999999993e-05 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140507+0000", 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016169700000000001 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.077 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140629+0000", 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121945 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.147178+0000", 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065491350000000002 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163685+0000", 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016507705000000001 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.078 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163770+0000", 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4227999999999994e-05 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163833+0000", 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3367999999999994e-05 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.079 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3192 3.3d e88/20 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head v 88'10, mlcod=87'8)", 2024-04-23T19:03:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:03:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 24.95846783, 2024-04-23T19:03:00.081 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024835230999999999, 2024-04-23T19:03:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.082 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:03:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.083 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:03:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068970+0000", 2024-04-23T19:03:00.084 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.694e-06 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070770+0000", 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001800545 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070800+0000", 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9091e-05 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.085 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070814+0000", 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070908+0000", 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4918000000000002e-05 2024-04-23T19:03:00.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070940+0000", 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1233999999999999e-05 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.093734+0000", 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022794182999999999 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.087 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.093803+0000", 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9596000000000002e-05 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3272 3.1d 3:bbf6a720:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_287:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.094050+0000", 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.933385653999999, 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020376459999999999, 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.088 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3272 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.094050+0000", 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.089 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.094050+0000", 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.094053+0000", 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7039999999999999e-06 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096539+0000", 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0024861900000000001 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.090 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096588+0000", 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9067999999999998e-05 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096613+0000", 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5024999999999998e-05 2024-04-23T19:03:00.091 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096733+0000", 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119487 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.096927+0000", 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019404599999999999 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.092 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.097097+0000", 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016993299999999999 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.105179+0000", 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080825710000000002 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.114352+0000", 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091730570000000001 2024-04-23T19:03:00.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.114394+0000", 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1196000000000003e-05 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.114427+0000", 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3182999999999997e-05 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.094 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3341 3.1d 3:bb977fed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.054219109999998, 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023804451000000001, 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.095 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3341 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.096 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973220+0000", 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2329999999999998e-06 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977722+0000", 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045018870000000004 2024-04-23T19:03:00.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977762+0000", 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0092000000000002e-05 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977781+0000", 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8680000000000001e-05 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.098 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977908+0000", 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126816 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.978131+0000", 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000223482 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.978302+0000", 2024-04-23T19:03:00.099 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017096 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990346+0000", 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012043633 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.996828+0000", 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064818360000000004 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.100 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.996937+0000", 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010987 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.997021+0000", 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3961999999999993e-05 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3342 3.1d 3:bafb0d1d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_357:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:03:00.101 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 23.041280882999999, 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023941924999999999, 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3342 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.102 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986158+0000", 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990855+0000", 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046966430000000003 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990884+0000", 2024-04-23T19:03:00.104 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9119e-05 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990903+0000", 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9392999999999999e-05 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990985+0000", 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.991184+0000", 2024-04-23T19:03:00.105 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019866 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.991360+0000", 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017603900000000001 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.997918+0000", 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065583619999999999 2024-04-23T19:03:00.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.009968+0000", 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012050108 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.107 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.010041+0000", 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3232000000000006e-05 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.010097+0000", 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5603999999999998e-05 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3352 3.2f 3:f4d71f5f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 22.881395817000001, 2024-04-23T19:03:00.108 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023081698000000001, 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3352 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.109 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.110 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146044+0000", 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.36e-06 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149033+0000", 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029898350000000001 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149066+0000", 2024-04-23T19:03:00.111 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2163999999999999e-05 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149081+0000", 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5401999999999999e-05 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149183+0000", 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101652 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.112 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149378+0000", 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019550200000000001 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149560+0000", 2024-04-23T19:03:00.113 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018205200000000001 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.158745+0000", 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009184958 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.114 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.168878+0000", 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010132354999999999 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.169023+0000", 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000145382 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.169122+0000", 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9036000000000005e-05 2024-04-23T19:03:00.115 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3667 3.21 3:876cde55:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.391794+0000", 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.6356424789999999, 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021674222, 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.116 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3667 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.391794+0000", 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.391794+0000", 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.391796+0000", 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749999999999998e-06 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393600+0000", 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001803614 2024-04-23T19:03:00.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393628+0000", 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.796e-05 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.119 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393642+0000", 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4212e-05 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393726+0000", 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3707000000000003e-05 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393836+0000", 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011033500000000001 2024-04-23T19:03:00.120 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393940+0000", 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103844 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.399011+0000", 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050709029999999999 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.121 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.413348+0000", 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014337211000000001 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.413414+0000", 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6204999999999994e-05 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.413468+0000", 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3556e-05 2024-04-23T19:03:00.122 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3668 3.13 3:c87da284:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.400709+0000", 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.6267269739999999, 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019514236000000001, 2024-04-23T19:03:00.123 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3668 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.400709+0000", 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.400709+0000", 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.400712+0000", 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2260000000000001e-06 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.402580+0000", 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018676579999999999 2024-04-23T19:03:00.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.402605+0000", 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5361e-05 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.402616+0000", 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1089e-05 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.126 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.402706+0000", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9202000000000004e-05 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.402897+0000", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000191168 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.403080+0000", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018319199999999999 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.414677+0000", 2024-04-23T19:03:00.127 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011597216 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.420090+0000", 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054123970000000002 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.420165+0000", 2024-04-23T19:03:00.128 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5123000000000006e-05 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.420223+0000", 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8604000000000003e-05 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3688 3.21 3:852768a7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:00.129 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.609881+0000", 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.4175546159999999, 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020060959, 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3688 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.130 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.609881+0000", 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.609881+0000", 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.609884+0000", 2024-04-23T19:03:00.131 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.066e-06 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.611491+0000", 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016066730000000001 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.611518+0000", 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7042e-05 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.132 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.611531+0000", 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3079e-05 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.611606+0000", 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4278999999999998e-05 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.611717+0000", 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000111339 2024-04-23T19:03:00.133 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.611857+0000", 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014039200000000001 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.621098+0000", 2024-04-23T19:03:00.134 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0092411969999999996 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.629807+0000", 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0087082119999999999 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.629880+0000", 2024-04-23T19:03:00.135 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3635999999999998e-05 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.629942+0000", 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2044000000000004e-05 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3703 3.2d e96/20 3:b50e67cb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_57:head v 96'17, mlcod=89'15)", 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.765397+0000", 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.262038912, 2024-04-23T19:03:00.136 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022593396000000002, 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.765397+0000", 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.765397+0000", 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.137 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.765399+0000", 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.751e-06 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.771880+0000", 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006480904 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.138 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.771913+0000", 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2836999999999997e-05 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.771927+0000", 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4248e-05 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.139 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.772033+0000", 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106507 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.772076+0000", 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2505e-05 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.140 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.787935+0000", 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015859607000000001 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.787991+0000", 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5037000000000002e-05 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3757 3.0 3:03831f50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.322676+0000", 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.70476017400000002, 2024-04-23T19:03:00.141 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023467211000000002, 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3757 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.322676+0000", 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.322676+0000", 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.322680+0000", 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7189999999999999e-06 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324428+0000", 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001748697 2024-04-23T19:03:00.143 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324455+0000", 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7146999999999999e-05 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324478+0000", 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2654e-05 2024-04-23T19:03:00.144 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324557+0000", 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9412999999999993e-05 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.145 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324728+0000", 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017013799999999999 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324878+0000", 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015056999999999999 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.340988+0000", 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016110098999999999 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.146 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.346005+0000", 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050171019999999998 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.346080+0000", 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4825000000000003e-05 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.346143+0000", 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2847000000000003e-05 2024-04-23T19:03:00.147 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3774 3.2e 3:75b10c86:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.491819+0000", 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.53561736699999996, 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019542095999999998, 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:00.148 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3774 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.491819+0000", 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.491819+0000", 2024-04-23T19:03:00.149 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.491822+0000", 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1549999999999999e-06 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.493683+0000", 2024-04-23T19:03:00.150 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001861092 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.493715+0000", 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1779999999999997e-05 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.493730+0000", 2024-04-23T19:03:00.151 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5693e-05 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.493837+0000", 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107046 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.494010+0000", 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000172929 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:00.152 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.494180+0000", 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016979899999999999 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.504737+0000", 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010556576 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.511164+0000", 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064267919999999997 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.153 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.511271+0000", 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010731299999999999 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.511361+0000", 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9920999999999995e-05 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:00.154 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:00.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T19:03:00.156 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:00.156+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:00.157 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:03:00.257 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:03:00.256+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:03:00.349 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:00.349 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:00.350 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:03:00.350 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:00.357 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:03:00.353+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:03:00.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:03:00.427 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T19:03:00.459 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:03:00.460+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:03:00.560 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:00.557+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:00.578 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:00.578 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:00.578 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:03:00.578 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:03:00.578 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:00.603 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:03:00.657 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:03:00.657 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:03:00.661 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:00.657+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:00.679 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:03:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:03:00.700 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:03:00.701 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:03:00.735 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:03:00.736 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:03:00.761 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:00.760+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:00.774 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:03:00.775 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:03:00.813 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:03:00.813 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:03:00.816 INFO:teuthology.orchestra.run.smithi169.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:00.816 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:00.847 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:03:00.848 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:03:00.849 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:03:00.862 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:00.861+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:00.888 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:03:00.888 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:03:00.962 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:00.961+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:00.994 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:00.994 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:01.014 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:03:01.063 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:03:01.061+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:03:01.114 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is set 2024-04-23T19:03:01.164 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:01.164+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:01.168 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:01.168 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:01.189 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:03:01.266 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:01.261+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:01.366 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:03:01.364+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:03:01.384 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:01.384 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:01.404 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:03:01.466 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:03:01.465+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:03:01.567 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:03:01.568+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:03:01.575 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:01.575 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:01.594 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:03:01.679 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:03:01.680+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:03:01.768 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:01.768+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:01.773 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:01.773 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:01.792 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:03:01.879 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:03:01.880+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:03:01.970 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:01.970 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:01.971 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:01.968+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:01.985 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:03:02.071 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:03:02.072+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:03:02.159 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:02.160 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:02.172 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:02.172+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:02.175 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:03:02.273 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:02.269+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:02.346 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:02.346 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:02.360 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:03:02.411 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:02.412+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:02.475 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:03:02.473+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:03:02.491 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:02.491 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:02.511 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:03:02.576 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:02.572+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:02.677 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:02.672+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:02.685 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:02.685 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:02.704 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:03:02.778 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:02.776+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:02.828 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:02.828 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:02.843 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:03:02.879 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:02.876+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:02.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T19:03:02.966 INFO:teuthology.orchestra.run.smithi193.stdout:ERROR: (22) Invalid argument 2024-04-23T19:03:02.966 INFO:teuthology.orchestra.run.smithi193.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T19:03:02.979 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:03:02.976+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:03:02.982 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T19:03:03.080 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:03.076+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:03.105 INFO:teuthology.orchestra.run.smithi169.stdout:osd.0: {} 2024-04-23T19:03:03.105 INFO:teuthology.orchestra.run.smithi169.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T19:03:03.127 INFO:teuthology.orchestra.run.smithi169.stdout:osd.1: {} 2024-04-23T19:03:03.127 INFO:teuthology.orchestra.run.smithi169.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T19:03:03.148 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:03.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:03.149 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:03:03.149 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:03.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:03:03.160 INFO:teuthology.orchestra.run.smithi169.stdout:osd.2: {} 2024-04-23T19:03:03.160 INFO:teuthology.orchestra.run.smithi169.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T19:03:03.176 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T19:03:03.192 INFO:teuthology.orchestra.run.smithi169.stdout:osd.3: {} 2024-04-23T19:03:03.192 INFO:teuthology.orchestra.run.smithi169.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T19:03:03.193 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:03.188+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:03.223 INFO:teuthology.orchestra.run.smithi169.stdout:osd.4: {} 2024-04-23T19:03:03.223 INFO:teuthology.orchestra.run.smithi169.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T19:03:03.265 INFO:teuthology.orchestra.run.smithi169.stdout:osd.5: {} 2024-04-23T19:03:03.265 INFO:teuthology.orchestra.run.smithi169.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T19:03:03.282 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:03.280+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:03.306 INFO:teuthology.orchestra.run.smithi169.stdout:osd.6: {} 2024-04-23T19:03:03.306 INFO:teuthology.orchestra.run.smithi169.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T19:03:03.350 INFO:teuthology.orchestra.run.smithi169.stdout:osd.7: {} 2024-04-23T19:03:03.350 INFO:teuthology.orchestra.run.smithi169.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T19:03:03.383 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:03.384+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:03.425 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:03:03.425 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:03:03.425 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:03.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T19:03:03.502 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-23T19:03:03.500+0000 7f25e5770640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-04-23T19:03:03.585 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:03.584+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:03.659 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:03.659 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:03:03.659 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:03:03.659 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:03:03.659 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2217 3.3d 3:bdd74c3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.613205011000005, 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028628924, 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2217 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.660 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044915+0000", 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.044917+0000", 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.627e-06 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.661 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048213+0000", 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003295699 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048250+0000", 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7033999999999998e-05 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048267+0000", 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7110999999999999e-05 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.662 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048369+0000", 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010157000000000001 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op must wait for map", 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.048375+0000", 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.686e-06 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059166+0000", 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010790365999999999 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.663 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059338+0000", 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017266100000000001 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.059494+0000", 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015549199999999999 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.067582+0000", 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080878510000000001 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073453+0000", 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058715010000000003 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073503+0000", 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9611000000000003e-05 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.073543+0000", 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0714999999999999e-05 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.665 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2295 3.12 3:4a98bb9e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 87.588573487000005, 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026333796999999999, 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2295 2024-04-23T19:03:03.666 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069546+0000", 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.069549+0000", 2024-04-23T19:03:03.667 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4130000000000002e-06 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071841+0000", 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022918589999999998 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071868+0000", 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6427999999999998e-05 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.668 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071878+0000", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0349e-05 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.071963+0000", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5198000000000007e-05 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072136+0000", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017285799999999999 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.072315+0000", 2024-04-23T19:03:03.669 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000178956 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079453+0000", 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071375520000000001 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095755+0000", 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016301881000000001 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.670 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095825+0000", 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0099999999999996e-05 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.095880+0000", 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5203e-05 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2596 3.1 3:823f69c9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.298445837999999, 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022656223, 2024-04-23T19:03:03.671 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2596 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.672 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359674+0000", 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.359677+0000", 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2619999999999999e-06 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361558+0000", 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018805149999999999 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.673 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361596+0000", 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8875000000000003e-05 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361611+0000", 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4299e-05 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361689+0000", 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8535000000000006e-05 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.674 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361805+0000", 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000115553 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.361944+0000", 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013969699999999999 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.368991+0000", 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070468509999999998 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.675 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382225+0000", 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013233945 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382278+0000", 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2445999999999999e-05 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.382330+0000", 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2244999999999999e-05 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.676 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2660 3.17 3:ebe8bc84:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.562799431000002, 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027624744999999999, 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2660 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.677 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095320+0000", 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.095323+0000", 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.326e-06 2024-04-23T19:03:03.678 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096763+0000", 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001439409 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096798+0000", 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5089999999999998e-05 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096816+0000", 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8016000000000002e-05 2024-04-23T19:03:03.679 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.096934+0000", 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117774 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097184+0000", 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025011199999999998 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.097415+0000", 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000230702 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.680 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.103253+0000", 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0058384910000000003 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122813+0000", 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019560371 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122889+0000", 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5838000000000001e-05 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.681 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.122945+0000", 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5615999999999997e-05 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2737 3.12 3:4b5e657b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.591271265000003, 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024833089999999999, 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.682 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2737 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066848+0000", 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.683 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.066852+0000", 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1130000000000003e-06 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070879+0000", 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.004026656 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070928+0000", 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8442000000000001e-05 2024-04-23T19:03:03.684 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.070951+0000", 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3529000000000001e-05 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071119+0000", 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016777200000000001 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071487+0000", 2024-04-23T19:03:03.685 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00036776499999999999 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.071877+0000", 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00039011999999999999 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.090667+0000", 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018790774999999999 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091411+0000", 2024-04-23T19:03:03.686 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00074399600000000002 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091595+0000", 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000183504 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.091681+0000", 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6417999999999998e-05 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.687 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3192 3.3d 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.592325329000001, 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028337180999999999, 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3192 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.688 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065794+0000", 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.065796+0000", 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.074e-06 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.689 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068360+0000", 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002563348 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068394+0000", 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4654999999999999e-05 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068408+0000", 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3621000000000001e-05 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.690 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068536+0000", 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012814799999999999 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068718+0000", 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000181576 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068871+0000", 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015303699999999999 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.691 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.091073+0000", 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022202537000000001 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094026+0000", 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029526470000000001 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094083+0000", 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7371999999999999e-05 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.692 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.094131+0000", 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8165999999999999e-05 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3266 3.1 3:813560fc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.640763999000001, 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025108429000000002, 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.693 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3266 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017356+0000", 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.694 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.017360+0000", 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3529999999999997e-06 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020806+0000", 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0034463530000000001 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020857+0000", 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0618999999999998e-05 2024-04-23T19:03:03.695 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.020884+0000", 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7555999999999998e-05 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021046+0000", 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016112 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021305+0000", 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025975500000000002 2024-04-23T19:03:03.696 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.021548+0000", 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024253600000000001 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.035795+0000", 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014247345999999999 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042324+0000", 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065290180000000001 2024-04-23T19:03:03.697 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042395+0000", 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1018000000000003e-05 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.042464+0000", 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8755000000000002e-05 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.698 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3289 3.2b 3:d7f50467:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.312438086, 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024819753, 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3289 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.699 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345681+0000", 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.345686+0000", 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2570000000000001e-06 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.700 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348576+0000", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028902260000000001 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348611+0000", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5342999999999997e-05 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348625+0000", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3995999999999999e-05 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348720+0000", 2024-04-23T19:03:03.701 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4877999999999995e-05 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.348893+0000", 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017255100000000001 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.349051+0000", 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015808700000000001 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.357084+0000", 2024-04-23T19:03:03.702 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0080328499999999994 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370386+0000", 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013302619999999999 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370444+0000", 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8010000000000002e-05 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.370501+0000", 2024-04-23T19:03:03.703 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6935000000000003e-05 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3672 3.12 3:49945637:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.445098+0000", 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.213021125, 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025051692, 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.704 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3672 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.445098+0000", 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.445098+0000", 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.705 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.445101+0000", 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2110000000000001e-06 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447273+0000", 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021725770000000002 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447302+0000", 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8932e-05 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.706 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447316+0000", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3679000000000001e-05 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447410+0000", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3880000000000002e-05 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447560+0000", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014996000000000001 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:03.707 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.447691+0000", 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013137700000000001 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.457814+0000", 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010122443 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.470035+0000", 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012221569999999999 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.708 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.470100+0000", 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4541000000000004e-05 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.470150+0000", 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.0522000000000002e-05 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3682 3.12 3:4b0bbe6f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.544965+0000", 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.1131541929999997, 2024-04-23T19:03:03.709 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022743145999999999, 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3682 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.544965+0000", 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.710 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.544965+0000", 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.544969+0000", 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2780000000000002e-06 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546596+0000", 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016269640000000001 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.711 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546624+0000", 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8637999999999999e-05 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546635+0000", 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0998999999999999e-05 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546723+0000", 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7657000000000005e-05 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.712 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.546896+0000", 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017346199999999999 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.547070+0000", 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000173912 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.553827+0000", 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067565510000000004 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.713 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.567598+0000", 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013771576000000001 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.567659+0000", 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0622000000000003e-05 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.567709+0000", 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9487000000000002e-05 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.714 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3723 3.17 3:e9b42400:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.972934+0000", 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.6851857680000002, 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025971247999999999, 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3723 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.715 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.972934+0000", 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.972934+0000", 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.972937+0000", 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9000000000000002e-06 2024-04-23T19:03:03.716 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.974967+0000", 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020305480000000001 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.974988+0000", 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0658000000000001e-05 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.975002+0000", 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3815000000000001e-05 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.717 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.975069+0000", 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6795e-05 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.975218+0000", 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014922500000000001 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.975392+0000", 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017433800000000001 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.718 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.983382+0000", 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0079899589999999996 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.998778+0000", 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015395598 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.998848+0000", 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0426000000000006e-05 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.719 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.998905+0000", 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6986e-05 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3735 3.1 3:81387eca:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.095747+0000", 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.5623730389999997, 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025517334999999999, 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.720 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3735 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.095747+0000", 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.721 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.095747+0000", 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.095750+0000", 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1829999999999998e-06 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.097399+0000", 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016492259999999999 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.722 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.097426+0000", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7169999999999999e-05 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.097438+0000", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1603999999999999e-05 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.097518+0000", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9986000000000003e-05 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.723 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.097702+0000", 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018439699999999999 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.097872+0000", 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016992400000000001 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.108189+0000", 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010316779 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.724 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.121141+0000", 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012952609 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.121212+0000", 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0339000000000005e-05 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.121264+0000", 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2117999999999998e-05 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.725 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3746 3.1 3:83396c15:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.211632+0000", 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4464873760000003, 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025207101999999999, 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3746 2024-04-23T19:03:03.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.211632+0000", 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.211632+0000", 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.211635+0000", 2024-04-23T19:03:03.727 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7520000000000001e-06 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.214151+0000", 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0025157259999999998 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.214178+0000", 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7610000000000002e-05 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.214190+0000", 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2215000000000001e-05 2024-04-23T19:03:03.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.214258+0000", 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.7094000000000005e-05 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.214395+0000", 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000136981 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.214511+0000", 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011660899999999999 2024-04-23T19:03:03.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.220309+0000", 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057982320000000004 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.236757+0000", 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016448076999999998 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.236799+0000", 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1625999999999998e-05 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.730 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.236839+0000", 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0179999999999998e-05 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3758 3.12 3:48a99ab7:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.334167+0000", 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.3239521109999997, 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026290437999999999, 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.731 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3758 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.334167+0000", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.334167+0000", 2024-04-23T19:03:03.732 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.334170+0000", 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9459999999999998e-06 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.335787+0000", 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001616274 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.335817+0000", 2024-04-23T19:03:03.733 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0060999999999999e-05 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.335832+0000", 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5546e-05 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.335922+0000", 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9313000000000004e-05 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.336101+0000", 2024-04-23T19:03:03.734 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017982799999999999 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.336226+0000", 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012495900000000001 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.343594+0000", 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0073678459999999999 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.360336+0000", 2024-04-23T19:03:03.735 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016741822 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.360401+0000", 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4762000000000001e-05 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.360458+0000", 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7080999999999998e-05 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.736 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3875 3.6 3:6388b5f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.460965+0000", 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.197154432, 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022717141, 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3875 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.737 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.460965+0000", 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.460965+0000", 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.460968+0000", 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.542e-06 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.738 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463101+0000", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0021334710000000001 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463128+0000", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7013e-05 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463139+0000", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0468999999999999e-05 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.739 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463209+0000", 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0004000000000003e-05 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463354+0000", 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014541000000000001 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463447+0000", 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3115999999999994e-05 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.740 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.479834+0000", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016387183999999999 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.483576+0000", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003741505 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.483634+0000", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8548000000000003e-05 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.483682+0000", 2024-04-23T19:03:03.741 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7879e-05 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:4070 3.3 e97/20 3:c14bec4b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_414:head v 97'18, mlcod=96'16)", 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.203398+0000", 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.45472163999999998, 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.037304348000000001, 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.742 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.203398+0000", 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.203398+0000", 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.203405+0000", 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.311e-06 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.743 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.207430+0000", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040249869999999998 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.207460+0000", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0094e-05 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.207475+0000", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4782e-05 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.744 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.207564+0000", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8518999999999997e-05 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.207593+0000", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9288000000000001e-05 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.240628+0000", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.033035103000000003 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.240702+0000", 2024-04-23T19:03:03.745 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4264000000000006e-05 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4071 3.32 3:4cd3fb25:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.209998+0000", 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.448121777, 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.033062471000000003, 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.746 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4071 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.209998+0000", 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.209998+0000", 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.747 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.210001+0000", 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1080000000000001e-06 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.211387+0000", 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0013862010000000001 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.211410+0000", 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2472000000000001e-05 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.748 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.211424+0000", 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4063000000000001e-05 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.211529+0000", 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105339 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.211747+0000", 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021797 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.749 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.211943+0000", 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019570000000000001 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.233845+0000", 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021902288999999998 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242884+0000", 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090386970000000001 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.750 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.243016+0000", 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000131877 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.243060+0000", 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4755000000000001e-05 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4073 3.17 3:e999be4e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_417:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.239410+0000", 2024-04-23T19:03:03.751 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.41870988199999998, 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022788373000000001, 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4073 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.239410+0000", 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.239410+0000", 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.239413+0000", 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.898e-06 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242506+0000", 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030930829999999999 2024-04-23T19:03:03.753 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242527+0000", 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1263e-05 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242537+0000", 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0112000000000001e-05 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242621+0000", 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3774000000000001e-05 2024-04-23T19:03:03.754 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242793+0000", 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017216399999999999 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.242904+0000", 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110849 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.250414+0000", 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0075103569999999996 2024-04-23T19:03:03.755 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.262053+0000", 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011639284999999999 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.262136+0000", 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2432e-05 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.262198+0000", 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2156000000000006e-05 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.756 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4080 3.3d 3:bf4ba42f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_424:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.325125+0000", 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.33299472600000002, 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022375477000000001, 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4080 2024-04-23T19:03:03.757 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.325125+0000", 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.325125+0000", 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.325128+0000", 2024-04-23T19:03:03.758 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8789999999999999e-06 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.327964+0000", 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028364839999999998 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.327992+0000", 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8223999999999999e-05 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.328006+0000", 2024-04-23T19:03:03.759 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3733e-05 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.328087+0000", 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1188999999999998e-05 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.328270+0000", 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018280400000000001 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.328393+0000", 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122633 2024-04-23T19:03:03.760 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.335305+0000", 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0069122890000000003 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.347403+0000", 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012098126000000001 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.347458+0000", 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4824999999999998e-05 2024-04-23T19:03:03.761 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.347500+0000", 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2290999999999999e-05 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:4096 3.10 e97/20 3:0a45613e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_440:head v 97'24, mlcod=97'22)", 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.525878+0000", 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 0.13224128399999999, 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025164826000000001, 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:03.762 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.525878+0000", 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:03.763 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.525878+0000", 2024-04-23T19:03:03.766 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:03.766 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.525880+0000", 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.131e-06 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.531396+0000", 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0055153349999999997 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.531436+0000", 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0676000000000002e-05 2024-04-23T19:03:03.767 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.531452+0000", 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6001000000000001e-05 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.531585+0000", 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013227700000000001 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.531616+0000", 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1584000000000001e-05 2024-04-23T19:03:03.768 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.550968+0000", 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019351915000000001 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.551043+0000", 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4907000000000006e-05 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:03.769 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:03.771 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T19:03:03.771 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:03:03.768+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:03:03.872 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:03.872+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:03.946 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:03.946 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:03:03.946 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:03.965 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T19:03:03.973 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-04-23T19:03:03.972+0000 7fce9d172640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25284) UID: 0 2024-04-23T19:03:04.073 INFO:tasks.ceph.osd.0.smithi169.stderr:2024-04-23T19:03:04.072+0000 7ff51c318640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-04-23T19:03:04.106 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:04.106 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:04.107 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:03:04.107 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:03:04.107 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:04.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T19:03:04.141 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:03:04.178 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:04.176+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:04.194 INFO:tasks.workunit.client.0.smithi169.stdout:quota disabled for the bucket: buck_2024_03_23_19_02_53 2024-04-23T19:03:04.194 INFO:tasks.workunit.client.0.smithi169.stdout:adding file to bucket: 2Gb. 2024-04-23T19:03:04.194 INFO:tasks.workunit.client.0.smithi169.stdout:upload file successful 2024-04-23T19:03:04.194 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:03:04.194 INFO:tasks.workunit.client.0.smithi169.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-04-23T19:03:04.195 INFO:tasks.workunit.client.0.smithi169.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-23T19:03:04.263 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:04.263 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:03:04.263 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:03:04.263 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:03:04.263 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.263 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2208 3.1a e56/20 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head v 56'4, mlcod=56'2)", 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.403762177000004, 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023648293000000001, 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.264 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858620+0000", 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.265 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.858623+0000", 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8499999999999998e-06 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864838+0000", 2024-04-23T19:03:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062155220000000002 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864897+0000", 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8974999999999997e-05 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.864924+0000", 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6806999999999999e-05 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865143+0000", 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021951199999999999 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.865208+0000", 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4712e-05 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882219+0000", 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017011043 2024-04-23T19:03:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.882268+0000", 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8872000000000002e-05 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2212 3.25 3:a607e1ce:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.326813404999996, 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022180848, 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2212 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935569+0000", 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.935573+0000", 2024-04-23T19:03:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6160000000000004e-06 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940313+0000", 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0047401170000000003 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940360+0000", 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.6569000000000001e-05 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940381+0000", 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0616e-05 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940533+0000", 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015219699999999999 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.940792+0000", 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025963800000000002 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.941045+0000", 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000252551 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.950997+0000", 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00995243 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957638+0000", 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066401810000000002 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957704+0000", 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6247000000000005e-05 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.957749+0000", 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5686000000000003e-05 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2279 3.31 3:8e9997ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:03:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.401127463999998, 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022973292999999999, 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2279 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861255+0000", 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.861258+0000", 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5590000000000001e-06 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865362+0000", 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0041038840000000004 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865397+0000", 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5085e-05 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865418+0000", 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0699999999999998e-05 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865558+0000", 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014007700000000001 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865767+0000", 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020929299999999999 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.865972+0000", 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020438800000000001 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.876864+0000", 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01089266 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884018+0000", 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071541219999999997 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884141+0000", 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122199 2024-04-23T19:03:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.884228+0000", 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7325999999999997e-05 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2586 3.31 3:8c4455ea:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.015995668999999, 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018926205000000001, 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2586 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:03:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246386+0000", 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.246390+0000", 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7100000000000001e-06 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248240+0000", 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018495810000000001 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248264+0000", 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.476e-05 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248275+0000", 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0747999999999999e-05 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248354+0000", 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8510000000000006e-05 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248522+0000", 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000168651 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.248675+0000", 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015274599999999999 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.255206+0000", 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00653077 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265176+0000", 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099700750000000001 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265256+0000", 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0178000000000004e-05 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.265313+0000", 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6475999999999999e-05 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2659 3.31 3:8fa4a138:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.178908602999996, 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023940570000000001, 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2659 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083473+0000", 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.083476+0000", 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.83e-06 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085230+0000", 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017538969999999999 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085264+0000", 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4066000000000002e-05 2024-04-23T19:03:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085280+0000", 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5637999999999998e-05 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085389+0000", 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010945199999999999 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085662+0000", 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027317500000000001 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.085863+0000", 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000200733 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.093539+0000", 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0076757409999999998 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107287+0000", 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013747962000000001 2024-04-23T19:03:04.293 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107358+0000", 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1068000000000005e-05 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107414+0000", 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6008000000000003e-05 2024-04-23T19:03:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2662 3.0 3:0108030e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.145040625, 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019529844000000001, 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2662 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117341+0000", 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.117345+0000", 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1640000000000001e-06 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119138+0000", 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017937369999999999 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.297 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119172+0000", 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3822000000000002e-05 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119188+0000", 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6330000000000001e-05 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119270+0000", 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1479999999999999e-05 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.298 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119413+0000", 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014276800000000001 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.119551+0000", 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013783900000000001 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.130669+0000", 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011118795000000001 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.299 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136739+0000", 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060699910000000003 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136814+0000", 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5137999999999998e-05 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.136871+0000", 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6780000000000002e-05 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.300 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2684 3.31 3:8e22aa27:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.907788500999999, 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020907834, 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2684 2024-04-23T19:03:04.301 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.302 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354593+0000", 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.354596+0000", 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9359999999999999e-06 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356193+0000", 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001596374 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.303 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356226+0000", 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2832e-05 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356242+0000", 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.615e-05 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356318+0000", 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6515999999999997e-05 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.304 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356488+0000", 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016932399999999999 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.356596+0000", 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010820299999999999 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.305 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.362305+0000", 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0057088470000000004 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375375+0000", 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013069852999999999 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375444+0000", 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9456999999999996e-05 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.306 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.375501+0000", 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7342000000000001e-05 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2703 3.4 3:235c0b5d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.714851953999997, 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021312615, 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.307 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2703 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547530+0000", 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.308 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.547534+0000", 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7730000000000001e-06 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549032+0000", 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001498161 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549069+0000", 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7091000000000001e-05 2024-04-23T19:03:04.309 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549082+0000", 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2938999999999999e-05 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549153+0000", 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0568000000000006e-05 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549287+0000", 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013435199999999999 2024-04-23T19:03:04.310 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.549415+0000", 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012801500000000001 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568210+0000", 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018794621000000001 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568706+0000", 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00049601300000000001 2024-04-23T19:03:04.311 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568782+0000", 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6829000000000006e-05 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.568843+0000", 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0253000000000001e-05 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2742 3.31 3:8fd366ba:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:03:04.312 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.120669866999997, 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019009742, 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2742 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:03:04.313 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141712+0000", 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.141716+0000", 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2919999999999997e-06 2024-04-23T19:03:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143446+0000", 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017294890000000001 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143479+0000", 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.328e-05 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143495+0000", 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5866999999999999e-05 2024-04-23T19:03:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143592+0000", 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.6906999999999999e-05 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143794+0000", 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020222400000000001 2024-04-23T19:03:04.316 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.143989+0000", 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019437799999999999 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.151434+0000", 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0074457100000000003 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.317 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160595+0000", 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091610270000000004 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160665+0000", 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9774e-05 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.160722+0000", 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6793999999999999e-05 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.318 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2754 3.31 3:8f206ba5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 50.969162535999999, 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018831686, 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2754 2024-04-23T19:03:04.319 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293219+0000", 2024-04-23T19:03:04.320 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.293223+0000", 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1030000000000002e-06 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.321 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.322 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296670+0000", 2024-04-23T19:03:04.322 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.003447571 2024-04-23T19:03:04.322 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.322 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.322 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296714+0000", 2024-04-23T19:03:04.323 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4197999999999999e-05 2024-04-23T19:03:04.323 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.323 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.323 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.323 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296738+0000", 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3578999999999999e-05 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.296882+0000", 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000144435 2024-04-23T19:03:04.324 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.325 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.325 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297176+0000", 2024-04-23T19:03:04.325 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029393699999999997 2024-04-23T19:03:04.325 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.325 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.326 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.297475+0000", 2024-04-23T19:03:04.326 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029916900000000001 2024-04-23T19:03:04.326 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.326 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.326 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.304021+0000", 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065450780000000002 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311877+0000", 2024-04-23T19:03:04.327 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0078560780000000007 2024-04-23T19:03:04.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.328 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.328 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.328 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.311972+0000", 2024-04-23T19:03:04.328 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5487000000000002e-05 2024-04-23T19:03:04.328 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.329 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.329 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.329 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.312051+0000", 2024-04-23T19:03:04.329 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9050999999999999e-05 2024-04-23T19:03:04.329 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.329 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3221 3.19 3:9815806e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.849384970999999, 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018791437000000001, 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.330 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3221 2024-04-23T19:03:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.332 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.412997+0000", 2024-04-23T19:03:04.333 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.333 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.333 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.333 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.413000+0000", 2024-04-23T19:03:04.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1930000000000002e-06 2024-04-23T19:03:04.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.334 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.334 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.334 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414602+0000", 2024-04-23T19:03:04.334 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016017430000000001 2024-04-23T19:03:04.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.335 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.335 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.335 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414643+0000", 2024-04-23T19:03:04.335 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0782999999999999e-05 2024-04-23T19:03:04.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414663+0000", 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0721999999999999e-05 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.336 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.337 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.414777+0000", 2024-04-23T19:03:04.337 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011350500000000001 2024-04-23T19:03:04.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.337 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.337 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415034+0000", 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00025707900000000001 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.415345+0000", 2024-04-23T19:03:04.338 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00031061199999999999 2024-04-23T19:03:04.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.339 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.339 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.339 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431169+0000", 2024-04-23T19:03:04.339 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015824222999999998 2024-04-23T19:03:04.339 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.340 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.340 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431625+0000", 2024-04-23T19:03:04.340 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00045608999999999998 2024-04-23T19:03:04.340 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.340 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431697+0000", 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1526000000000006e-05 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.341 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.431788+0000", 2024-04-23T19:03:04.342 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1960999999999996e-05 2024-04-23T19:03:04.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.342 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.342 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.342 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3286 3.19 3:9871ec9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.959497631000001, 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020318066999999999, 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.343 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3286 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.344 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302884+0000", 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.345 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.302888+0000", 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7440000000000001e-06 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306883+0000", 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0039948960000000004 2024-04-23T19:03:04.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.347 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.347 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306908+0000", 2024-04-23T19:03:04.347 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5239e-05 2024-04-23T19:03:04.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.347 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.306922+0000", 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3918e-05 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307018+0000", 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5740000000000002e-05 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307215+0000", 2024-04-23T19:03:04.348 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019719599999999999 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.307397+0000", 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000182055 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.349 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.319179+0000", 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011781514 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.322991+0000", 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0038125390000000002 2024-04-23T19:03:04.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323138+0000", 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014664600000000001 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.323202+0000", 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4579999999999995e-05 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.351 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3757 3.0 e96/85 3:03831f50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_111:head v 96'13, mlcod=89'11)", 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.324995+0000", 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.9373866910000004, 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020811623000000001, 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324995+0000", 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.352 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324995+0000", 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324998+0000", 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3300000000000001e-06 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.327335+0000", 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002337193 2024-04-23T19:03:04.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.327357+0000", 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2594000000000001e-05 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.327371+0000", 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3078000000000001e-05 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.327448+0000", 2024-04-23T19:03:04.354 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7911000000000007e-05 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.327479+0000", 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0845e-05 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.345736+0000", 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018256364000000001 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.345807+0000", 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1308000000000002e-05 2024-04-23T19:03:04.355 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3789 3.19 3:99f3f32d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.560248+0000", 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.7021336009999999, 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019028551000000001, 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.356 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3789 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.560248+0000", 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.560248+0000", 2024-04-23T19:03:04.357 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.560251+0000", 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2869999999999999e-06 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.563288+0000", 2024-04-23T19:03:04.358 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0030373819999999999 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.563318+0000", 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0371000000000001e-05 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.563331+0000", 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3047000000000001e-05 2024-04-23T19:03:04.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.563421+0000", 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9425000000000005e-05 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.563603+0000", 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018185 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.360 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.563769+0000", 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016607500000000001 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.575034+0000", 2024-04-23T19:03:04.361 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011265389000000001 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.575923+0000", 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00088889600000000002 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.575992+0000", 2024-04-23T19:03:04.362 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9221999999999996e-05 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.579277+0000", 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0032846070000000002 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3848 3.31 e96/85 3:8c80c6d1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_192:head v 96'23, mlcod=96'21)", 2024-04-23T19:03:04.363 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.184783+0000", 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.0775985290000003, 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024963905000000002, 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.184783+0000", 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.364 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.184783+0000", 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.184785+0000", 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.375e-06 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.189329+0000", 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045445349999999997 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.189373+0000", 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3967000000000001e-05 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.366 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.189390+0000", 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6988000000000001e-05 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.189494+0000", 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103878 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.189526+0000", 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1578000000000002e-05 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.367 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.209616+0000", 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020089777 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.209747+0000", 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013180700000000001 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.368 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3864 3.19 3:98082888:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.348576+0000", 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.913805891, 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019814489000000001, 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3864 2024-04-23T19:03:04.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.348576+0000", 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.348576+0000", 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.370 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.348579+0000", 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.452e-06 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.350298+0000", 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001719382 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.350330+0000", 2024-04-23T19:03:04.371 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2329999999999997e-05 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.350344+0000", 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3234000000000001e-05 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.350425+0000", 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1737999999999996e-05 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.372 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.350574+0000", 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014857100000000001 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.350721+0000", 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000147474 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.373 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.361161+0000", 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010439779999999999 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.368260+0000", 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.007098488 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.368331+0000", 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1347000000000007e-05 2024-04-23T19:03:04.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.368391+0000", 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.9692999999999999e-05 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3875 3.6 e96/20 3:6388b5f2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_219:head v 96'19, mlcod=96'16)", 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.463535+0000", 2024-04-23T19:03:04.375 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7988466239999998, 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019355880999999998, 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463535+0000", 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.376 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463535+0000", 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.463536+0000", 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0219999999999999e-06 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.465504+0000", 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019678510000000001 2024-04-23T19:03:04.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.465532+0000", 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7611e-05 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.465547+0000", 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4749000000000001e-05 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.378 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.465625+0000", 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.8391000000000002e-05 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.465653+0000", 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8435000000000001e-05 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.379 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.482830+0000", 2024-04-23T19:03:04.380 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017177026000000001 2024-04-23T19:03:04.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.383 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.383 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.482891+0000", 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0795999999999999e-05 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3884 3.19 3:9a0664dd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.557111+0000", 2024-04-23T19:03:04.384 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.7052712109999999, 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023205865999999999, 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.385 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3884 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.557111+0000", 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.386 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.557111+0000", 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.557113+0000", 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6450000000000001e-06 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.387 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.558959+0000", 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018457980000000001 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.558995+0000", 2024-04-23T19:03:04.388 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6165999999999999e-05 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.559009+0000", 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3390999999999999e-05 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.389 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.559103+0000", 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4310999999999999e-05 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.559233+0000", 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000129572 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.390 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.559324+0000", 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1671999999999999e-05 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.575544+0000", 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016219271 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.391 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.580188+0000", 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046439920000000004 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.580258+0000", 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0296999999999995e-05 2024-04-23T19:03:04.392 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.580317+0000", 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8751e-05 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.393 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3889 3.31 e96/85 3:8c74b849:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_233:head v 96'24, mlcod=96'22)", 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.617305+0000", 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 3.6450772530000002, 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020927446999999998, 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.394 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.617305+0000", 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.617305+0000", 2024-04-23T19:03:04.395 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.617307+0000", 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3599999999999999e-06 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.625686+0000", 2024-04-23T19:03:04.396 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.008378801 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.625714+0000", 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8235e-05 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.625728+0000", 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3626e-05 2024-04-23T19:03:04.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.625837+0000", 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000108756 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.625867+0000", 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0864000000000001e-05 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.638161+0000", 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012293579000000001 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.638232+0000", 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1225999999999999e-05 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:4071 3.32 e97/20 3:4cd3fb25:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_415:head v 97'16, mlcod=96'14)", 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.212079+0000", 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.0503031869999999, 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021555732000000001, 2024-04-23T19:03:04.399 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.212079+0000", 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.212079+0000", 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.400 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.212081+0000", 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9199999999999998e-06 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.214294+0000", 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022136310000000002 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.214321+0000", 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6452999999999999e-05 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.401 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.214334+0000", 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2731000000000001e-05 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.214425+0000", 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.1559999999999998e-05 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.214455+0000", 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0284999999999999e-05 2024-04-23T19:03:04.402 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.233558+0000", 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019102240999999999 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.233635+0000", 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.6910999999999996e-05 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.403 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.404 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:04.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T19:03:04.406 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:04.400+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:04.470 INFO:tasks.workunit.client.0.smithi169.stdout:user qa_user deleted 2024-04-23T19:03:04.470 INFO:tasks.workunit.client.0.smithi169.stdout:bucket delete succeeded 2024-04-23T19:03:04.474 INFO:tasks.workunit.client.0.smithi169.stdout:OK 2024-04-23T19:03:04.475 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T19:03:04.475 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T19:03:04.506 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-04-23T19:03:04.504+0000 7f38cba1b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25281) UID: 0 2024-04-23T19:03:04.529 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-04-23T19:03:04.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T19:03:04.559 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:04.559 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:04.559 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:03:04.560 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:04.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T19:03:04.607 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:04.608+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:04.708 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-23T19:03:04.704+0000 7fc7a2260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25211) UID: 0 2024-04-23T19:03:04.725 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:04.725 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:04.725 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:03:04.725 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:03:04.725 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:04.738 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T19:03:04.834 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-23T19:03:04.832+0000 7f496323d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-04-23T19:03:04.877 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:04.878 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T19:03:04.909 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-04-23T19:03:04.908+0000 7fdd843ad640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25286) UID: 0 2024-04-23T19:03:04.915 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:04.915 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:03:04.915 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2276 3.9 e57/20 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head v 57'4, mlcod=56'2)", 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.104054253000001, 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020745952000000002, 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:03:04.916 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810600+0000", 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.810602+0000", 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.165e-06 2024-04-23T19:03:04.917 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.814988+0000", 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0043859779999999996 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815019+0000", 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1186999999999998e-05 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.918 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815034+0000", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4893e-05 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815188+0000", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015382699999999999 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.815252+0000", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4622000000000006e-05 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831288+0000", 2024-04-23T19:03:04.919 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016035600000000001 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.831345+0000", 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7679999999999997e-05 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2286 3.1d 3:b9159f3b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 88.949498484000003, 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024938628000000001, 2024-04-23T19:03:04.920 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2286 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.921 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965155+0000", 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.965160+0000", 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3019999999999996e-06 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967043+0000", 2024-04-23T19:03:04.922 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018833770000000001 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967085+0000", 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1946999999999997e-05 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967107+0000", 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2141999999999999e-05 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967196+0000", 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9223999999999998e-05 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967374+0000", 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000177548 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.967540+0000", 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016652099999999999 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.924 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.972393+0000", 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048529070000000001 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989863+0000", 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.017470215000000001 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.989996+0000", 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013222 2024-04-23T19:03:04.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.990094+0000", 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.8225000000000002e-05 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2590 3.21 3:86702f7a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:03:04.926 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.625709530999998, 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028377956999999999, 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2590 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:03:04.927 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288944+0000", 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.288948+0000", 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4089999999999999e-06 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.928 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290740+0000", 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001792774 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290764+0000", 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3901999999999999e-05 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290778+0000", 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3485999999999999e-05 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.929 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290847+0000", 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9556999999999998e-05 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.290964+0000", 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011652800000000001 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.291086+0000", 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012249400000000001 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.930 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.295914+0000", 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0048272369999999998 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317211+0000", 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021297608999999999 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317282+0000", 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0350000000000002e-05 2024-04-23T19:03:04.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.317322+0000", 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0611000000000001e-05 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2612 3.1d 3:b8b97969:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.389040565999998, 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020723431, 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.932 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2612 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.934 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525613+0000", 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.525616+0000", 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2119999999999999e-06 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527272+0000", 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001655658 2024-04-23T19:03:04.935 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527292+0000", 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9466999999999998e-05 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527302+0000", 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.0438000000000001e-05 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.936 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.937 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527364+0000", 2024-04-23T19:03:04.937 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.1520999999999996e-05 2024-04-23T19:03:04.937 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.937 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.937 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527520+0000", 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000156804 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.527634+0000", 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113286 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.535370+0000", 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0077363500000000003 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.938 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546236+0000", 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010866069000000001 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546281+0000", 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.4594e-05 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.546337+0000", 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6032000000000002e-05 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.939 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2635 3.2e 3:74863d32:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 53.143394182999998, 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022820072, 2024-04-23T19:03:04.940 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2635 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.941 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771260+0000", 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.771265+0000", 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7989999999999999e-06 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773229+0000", 2024-04-23T19:03:04.942 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019637729999999998 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773254+0000", 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.4494e-05 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773268+0000", 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4117999999999999e-05 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773369+0000", 2024-04-23T19:03:04.943 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101499 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773539+0000", 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017010199999999999 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.773696+0000", 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015697000000000001 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.783147+0000", 2024-04-23T19:03:04.944 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094510140000000006 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.793991+0000", 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010843428 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794032+0000", 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1223999999999997e-05 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.794080+0000", 2024-04-23T19:03:04.945 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.7651000000000002e-05 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2661 3.13 3:caea25e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.809249248, 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020454087999999999, 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.946 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2661 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105405+0000", 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.947 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.105408+0000", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.8e-06 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107045+0000", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0016363980000000001 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107079+0000", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3899999999999997e-05 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.948 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107102+0000", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3159e-05 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107187+0000", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4775000000000001e-05 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107359+0000", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017244600000000001 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.107473+0000", 2024-04-23T19:03:04.949 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000113565 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.113697+0000", 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0062245319999999996 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125770+0000", 2024-04-23T19:03:04.950 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012073122 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125810+0000", 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9662000000000001e-05 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.125859+0000", 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8729000000000001e-05 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.951 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2664 3.13 3:c816585d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 52.776263555, 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025442844999999999, 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2664 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.952 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138390+0000", 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.953 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.138393+0000", 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0960000000000001e-06 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140225+0000", 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018314309999999999 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.954 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140257+0000", 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2319e-05 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140272+0000", 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4800000000000001e-05 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140345+0000", 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3120999999999993e-05 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.955 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140507+0000", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016169700000000001 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.140629+0000", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000121945 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.147178+0000", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065491350000000002 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163685+0000", 2024-04-23T19:03:04.956 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016507705000000001 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163770+0000", 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4227999999999994e-05 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:12.163833+0000", 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3367999999999994e-05 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.957 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3192 3.3d e88/20 3:bdbbbf57:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_207:head v 88'10, mlcod=87'8)", 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.845685564, 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024835230999999999, 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.958 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068968+0000", 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068970+0000", 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.694e-06 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070770+0000", 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001800545 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.959 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070800+0000", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9091e-05 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070814+0000", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.397e-05 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070908+0000", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.4918000000000002e-05 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.960 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.070940+0000", 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1233999999999999e-05 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.093734+0000", 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022794182999999999 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.093803+0000", 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9596000000000002e-05 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.961 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3341 3.1d 3:bb977fed:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.941436844000002, 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023804451000000001, 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.962 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3341 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973217+0000", 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.963 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.973220+0000", 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2329999999999998e-06 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977722+0000", 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0045018870000000004 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977762+0000", 2024-04-23T19:03:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0092000000000002e-05 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977781+0000", 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8680000000000001e-05 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.977908+0000", 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000126816 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.978131+0000", 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000223482 2024-04-23T19:03:04.965 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.978302+0000", 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017096 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990346+0000", 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012043633 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.996828+0000", 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064818360000000004 2024-04-23T19:03:04.966 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.996937+0000", 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010987 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.997021+0000", 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3961999999999993e-05 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.967 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3342 3.1d 3:bafb0d1d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_357:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.928498616999999, 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023941924999999999, 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3342 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.968 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986155+0000", 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.986158+0000", 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0970000000000002e-06 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.969 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990855+0000", 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0046966430000000003 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990884+0000", 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9119e-05 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990903+0000", 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9392999999999999e-05 2024-04-23T19:03:04.970 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.990985+0000", 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.991184+0000", 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019866 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.991360+0000", 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017603900000000001 2024-04-23T19:03:04.971 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.997918+0000", 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0065583619999999999 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.009968+0000", 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.012050108 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.010041+0000", 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3232000000000006e-05 2024-04-23T19:03:04.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.010097+0000", 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5603999999999998e-05 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3352 3.2f 3:f4d71f5f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 27.768613551000001, 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023081698000000001, 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.973 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3352 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.974 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146040+0000", 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.146044+0000", 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.36e-06 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149033+0000", 2024-04-23T19:03:04.975 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0029898350000000001 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149066+0000", 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2163999999999999e-05 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149081+0000", 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5401999999999999e-05 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149183+0000", 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000101652 2024-04-23T19:03:04.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149378+0000", 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019550200000000001 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.149560+0000", 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018205200000000001 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.158745+0000", 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.009184958 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.977 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.168878+0000", 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010132354999999999 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.169023+0000", 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000145382 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.169122+0000", 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9036000000000005e-05 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.978 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3667 3.21 3:876cde55:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.391794+0000", 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.5228602129999995, 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021674222, 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3667 2024-04-23T19:03:04.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.391794+0000", 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.391794+0000", 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.391796+0000", 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6749999999999998e-06 2024-04-23T19:03:04.980 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393600+0000", 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001803614 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393628+0000", 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.796e-05 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393642+0000", 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4212e-05 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.981 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393726+0000", 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3707000000000003e-05 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393836+0000", 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011033500000000001 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.393940+0000", 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000103844 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.982 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.399011+0000", 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050709029999999999 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.413348+0000", 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014337211000000001 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.413414+0000", 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6204999999999994e-05 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.413468+0000", 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.3556e-05 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3703 3.2d e96/20 3:b50e67cb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_57:head v 96'17, mlcod=89'15)", 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.765397+0000", 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.1492566459999995, 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022593396000000002, 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.984 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.765397+0000", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.765397+0000", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.765399+0000", 2024-04-23T19:03:04.985 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.751e-06 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.771880+0000", 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.006480904 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.771913+0000", 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2836999999999997e-05 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.771927+0000", 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4248e-05 2024-04-23T19:03:04.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.772033+0000", 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000106507 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.772076+0000", 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2505e-05 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.787935+0000", 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015859607000000001 2024-04-23T19:03:04.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.787991+0000", 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5037000000000002e-05 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3757 3.0 3:03831f50:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.322676+0000", 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.5919779080000005, 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023467211000000002, 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.988 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3757 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.322676+0000", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.322676+0000", 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.322680+0000", 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7189999999999999e-06 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324428+0000", 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001748697 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.990 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324455+0000", 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7146999999999999e-05 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324478+0000", 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2654e-05 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324557+0000", 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9412999999999993e-05 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.991 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324728+0000", 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017013799999999999 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324878+0000", 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015056999999999999 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.992 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.340988+0000", 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016110098999999999 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.346005+0000", 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0050171019999999998 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.346080+0000", 2024-04-23T19:03:04.994 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.4825000000000003e-05 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.346143+0000", 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.2847000000000003e-05 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3856 3.2f 3:f7bc7efd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.264036+0000", 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.6506177009999998, 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.020923588, 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:04.995 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3856 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.264036+0000", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.264036+0000", 2024-04-23T19:03:04.996 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.264040+0000", 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7160000000000001e-06 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.266064+0000", 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0020244339999999999 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.266099+0000", 2024-04-23T19:03:04.997 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4968999999999997e-05 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.266115+0000", 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5526e-05 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.266192+0000", 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7583999999999994e-05 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.266321+0000", 2024-04-23T19:03:04.998 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012849500000000001 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.266417+0000", 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5944000000000002e-05 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.275037+0000", 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086197800000000005 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.284831+0000", 2024-04-23T19:03:04.999 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0097944260000000002 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.284907+0000", 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.5951000000000005e-05 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.284960+0000", 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.2763000000000003e-05 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.000 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3878 3.21 3:84d60221:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.491780+0000", 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 4.4228735050000001, 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022606098000000002, 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3878 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.001 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.491780+0000", 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.491780+0000", 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.491784+0000", 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.1620000000000001e-06 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.002 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.493597+0000", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0018130209999999999 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.493633+0000", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.5079000000000001e-05 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.493648+0000", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5739e-05 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.003 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.493735+0000", 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6297000000000004e-05 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.493889+0000", 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015426200000000001 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.494016+0000", 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012720400000000001 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.004 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.500449+0000", 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064330100000000003 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.514289+0000", 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013840187 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.514332+0000", 2024-04-23T19:03:05.005 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3053999999999998e-05 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.514386+0000", 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4082999999999997e-05 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4069 3.21 3:872e3b63:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_413:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.187768+0000", 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.726886041, 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024415004000000001, 2024-04-23T19:03:05.006 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4069 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.187768+0000", 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.187768+0000", 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.187771+0000", 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6669999999999998e-06 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.189834+0000", 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002062234 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.008 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.189864+0000", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.0783e-05 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.189880+0000", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5794000000000002e-05 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.189965+0000", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4975000000000005e-05 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.190106+0000", 2024-04-23T19:03:05.009 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014080900000000001 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.190225+0000", 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000119246 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.195697+0000", 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0054718980000000002 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.212057+0000", 2024-04-23T19:03:05.010 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.016359522000000001 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.212122+0000", 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.5680999999999997e-05 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.212183+0000", 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0395e-05 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.011 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4075 3.2e 3:75b4fbec:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.262873+0000", 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.6517805459999999, 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023039758, 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4075 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.012 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.262873+0000", 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.262873+0000", 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.262877+0000", 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4259999999999999e-06 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.013 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.265117+0000", 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002240283 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.265146+0000", 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.9288000000000001e-05 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.265160+0000", 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4022000000000001e-05 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.014 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.265241+0000", 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0584e-05 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.265398+0000", 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015699400000000001 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.265544+0000", 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014631 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.015 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.274679+0000", 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0091353589999999991 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.285770+0000", 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011090045999999999 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.285843+0000", 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.3318999999999994e-05 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.016 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.285913+0000", 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0127000000000001e-05 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4095 3.2f 3:f4fd03de:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.509325+0000", 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.405329195, 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022965264999999999, 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.017 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4095 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.509325+0000", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.509325+0000", 2024-04-23T19:03:05.018 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.509328+0000", 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.495e-06 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.511352+0000", 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002024316 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.511383+0000", 2024-04-23T19:03:05.019 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.1047000000000003e-05 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.511400+0000", 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6778000000000001e-05 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.511491+0000", 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0354999999999998e-05 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.020 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.511695+0000", 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00020486300000000001 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.511892+0000", 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000196462 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.520965+0000", 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0090733140000000007 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.021 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.532145+0000", 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011180136 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.532225+0000", 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9989999999999998e-05 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.532290+0000", 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4509000000000002e-05 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.022 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4127 3.1d 3:b8c33a9f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_471:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.846823+0000", 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 1.067830496, 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021178170999999999, 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4127 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.023 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.846823+0000", 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.846823+0000", 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.846827+0000", 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6770000000000001e-06 2024-04-23T19:03:05.024 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.848765+0000", 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001937977 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.848790+0000", 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5454999999999999e-05 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.848804+0000", 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3484e-05 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.025 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.848913+0000", 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109153 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.849090+0000", 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000176532 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.849225+0000", 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000135909 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.026 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.855985+0000", 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0067595260000000001 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.867928+0000", 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011943311 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.867968+0000", 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9357000000000003e-05 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.027 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.868001+0000", 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.379e-05 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.028 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:05.030 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T19:03:05.030 DEBUG:teuthology.orchestra.run.smithi169:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-23T19:03:05.031 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T19:03:05.032 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-04-23T19:03:05.028+0000 7fd55aff2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25280) UID: 0 2024-04-23T19:03:05.090 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T19:03:05.090 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-23T19:03:05.099 INFO:tasks.thrashosds:joining thrashosds 2024-04-23T19:03:05.208 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:05.208 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:05.208 INFO:teuthology.orchestra.run.smithi169.stdout: "num_ops": 0 2024-04-23T19:03:05.208 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:05.222 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T19:03:05.344 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:05.344 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [], 2024-04-23T19:03:05.344 INFO:teuthology.orchestra.run.smithi169.stdout: "complaint_time": 30, 2024-04-23T19:03:05.344 INFO:teuthology.orchestra.run.smithi169.stdout: "num_blocked_ops": 0 2024-04-23T19:03:05.344 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:05.358 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "size": 20, 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 600, 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "ops": [ 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2213 3.24 3:2400ee31:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:03:05.485 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.524251054000004, 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027493724000000001, 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2213 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.486 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958965+0000", 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.958968+0000", 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2090000000000001e-06 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.487 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961924+0000", 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002955736 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961968+0000", 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.3936000000000001e-05 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.961989+0000", 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.1242000000000001e-05 2024-04-23T19:03:05.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962109+0000", 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011922299999999999 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962354+0000", 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00024533200000000002 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.962565+0000", 2024-04-23T19:03:05.489 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021116099999999999 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.972600+0000", 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010034835000000001 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986293+0000", 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013692951 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.490 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986389+0000", 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5779999999999994e-05 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:34.986459+0000", 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.0319000000000002e-05 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2244 3.b 3:d176b8d8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 90.104603890999996, 2024-04-23T19:03:05.491 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028010340000000002, 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2244 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.492 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378612+0000", 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.378615+0000", 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.435e-06 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.493 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381481+0000", 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0028663959999999998 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381507+0000", 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6237e-05 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.494 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381523+0000", 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5512e-05 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381633+0000", 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000109664 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.381927+0000", 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029476900000000001 2024-04-23T19:03:05.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.382222+0000", 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00029416400000000002 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.404843+0000", 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022621064 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406439+0000", 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0015968110000000001 2024-04-23T19:03:05.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406527+0000", 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.7709999999999999e-05 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.406623+0000", 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.5577999999999999e-05 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.497 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2261 3.38 3:1da21a54:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.863777565999996, 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027069495999999998, 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2261 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.498 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619439+0000", 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.619443+0000", 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.827e-06 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.499 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621653+0000", 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022104490000000002 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621692+0000", 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.9088999999999998e-05 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621717+0000", 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5116000000000001e-05 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.500 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.621825+0000", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000107669 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622006+0000", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018060099999999999 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.622173+0000", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016732800000000001 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.630660+0000", 2024-04-23T19:03:05.501 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0084869439999999997 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646362+0000", 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015702240999999999 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646445+0000", 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2504999999999997e-05 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.502 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.646508+0000", 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.3726999999999995e-05 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:2263 3.28 e57/20 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head v 57'10, mlcod=56'8)", 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.835379771000007, 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029487051, 2024-04-23T19:03:05.503 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.504 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647837+0000", 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.647838+0000", 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5850000000000001e-06 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652307+0000", 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044690650000000004 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.505 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652336+0000", 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8376000000000001e-05 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652350+0000", 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4436e-05 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652478+0000", 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012785699999999999 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.506 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.652520+0000", 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.2519999999999999e-05 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677166+0000", 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024645917999999999 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:35.677324+0000", 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015729399999999999 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.507 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2294 3.23 3:c4f9eba6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 89.427117628999994, 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023201884999999998, 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.508 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2294 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056099+0000", 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.509 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.056101+0000", 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6350000000000002e-06 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057886+0000", 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0017847029999999999 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057908+0000", 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2384000000000001e-05 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.510 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.057923+0000", 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4409999999999999e-05 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058011+0000", 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.8252999999999997e-05 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058168+0000", 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015717500000000001 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.511 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.058316+0000", 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014779699999999999 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.065440+0000", 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0071243649999999997 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079176+0000", 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013735232999999999 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.512 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079242+0000", 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.6334999999999994e-05 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:01:36.079301+0000", 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.8594999999999997e-05 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.513 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2589 3.7 3:e099d359:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 54.205115004, 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022967630999999999, 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.514 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2589 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.515 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278101+0000", 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.278103+0000", 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.53e-06 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279752+0000", 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001649537 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.516 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279779+0000", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.6225e-05 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279790+0000", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1282e-05 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.279872+0000", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.1750999999999997e-05 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280046+0000", 2024-04-23T19:03:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00017436599999999999 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.280209+0000", 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000163015 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.289737+0000", 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095279800000000001 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.300928+0000", 2024-04-23T19:03:05.518 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011190930999999999 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301008+0000", 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.0530000000000003e-05 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:11.301069+0000", 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.0483999999999999e-05 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.519 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:2767 3.38 3:1efc7625:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 51.994287456000002, 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026034438999999999, 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 2767 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.520 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488929+0000", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.488932+0000", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3569999999999998e-06 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.521 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491230+0000", 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002297959 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491265+0000", 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4915e-05 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491281+0000", 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5885000000000001e-05 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.522 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491389+0000", 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00010790600000000001 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491596+0000", 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000206622 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.523 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.491829+0000", 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000233143 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.503280+0000", 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011451823 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514817+0000", 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.011536332999999999 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.524 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514899+0000", 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2245999999999998e-05 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:13.514963+0000", 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4250000000000003e-05 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3191 3.c e88/20 3:3340fe65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_206:head v 88'8, mlcod=87'6)", 2024-04-23T19:03:05.525 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:35.064551+0000", 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 30.418665118, 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026220805999999999, 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.064551+0000", 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.526 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.064551+0000", 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.064553+0000", 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.372e-06 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068613+0000", 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040601539999999998 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.527 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068630+0000", 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.7144999999999999e-05 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068638+0000", 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.5949999999999999e-06 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068696+0000", 2024-04-23T19:03:05.528 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.7911000000000002e-05 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.068723+0000", 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7061000000000001e-05 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.090704+0000", 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.021980528999999999 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.529 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:35.090772+0000", 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8039000000000004e-05 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3278 3.18 3:19739240:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:36.176417+0000", 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 29.306799243, 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.027996734999999998, 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.530 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3278 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.176417+0000", 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.176417+0000", 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.531 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.176421+0000", 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0740000000000003e-06 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.179278+0000", 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.002857297 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.179315+0000", 2024-04-23T19:03:05.532 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7030999999999998e-05 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.179334+0000", 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.8606000000000001e-05 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.179433+0000", 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.9365999999999997e-05 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.533 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.179620+0000", 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018682 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.179793+0000", 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000173091 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.189739+0000", 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0099454490000000003 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.534 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.204069+0000", 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014330455000000001 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.204261+0000", 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019125300000000001 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:36.204414+0000", 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015329300000000001 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.535 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3354 3.25 3:a7f73113:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_369:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:37.168040+0000", 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 28.315176051000002, 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026205962999999999, 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3354 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.536 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.168040+0000", 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.168040+0000", 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.168044+0000", 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0929999999999996e-06 2024-04-23T19:03:05.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.174473+0000", 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0064286500000000002 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.174506+0000", 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3107e-05 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.174521+0000", 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4960000000000001e-05 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.538 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.174644+0000", 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00012265900000000001 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.174915+0000", 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00027157700000000001 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.175196+0000", 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000280797 2024-04-23T19:03:05.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.190057+0000", 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014861057 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.194092+0000", 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0040345659999999998 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.194181+0000", 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9525999999999996e-05 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.540 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:37.194246+0000", 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4970999999999998e-05 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3677 3.2 3:40f795bd:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.493902+0000", 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.9893142749999999, 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026054794999999999, 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.541 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3677 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.493902+0000", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.493902+0000", 2024-04-23T19:03:05.542 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.493904+0000", 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2840000000000001e-06 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.495441+0000", 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.001536864 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.495466+0000", 2024-04-23T19:03:05.543 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5228999999999998e-05 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.495478+0000", 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.1345000000000001e-05 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.495557+0000", 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9160999999999996e-05 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.495694+0000", 2024-04-23T19:03:05.544 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00013682200000000001 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.495810+0000", 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011660899999999999 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.505301+0000", 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0094905819999999991 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.519843+0000", 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.014541612000000001 2024-04-23T19:03:05.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.519907+0000", 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4722999999999997e-05 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.519957+0000", 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9564000000000002e-05 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.546 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3684 3.7 3:e00655a2:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:58.564649+0000", 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.9185676430000003, 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024675409999999998, 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3684 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.547 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.564649+0000", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.564649+0000", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.564651+0000", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7499999999999999e-06 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.548 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.566099+0000", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0014480039999999999 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.566133+0000", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3772999999999997e-05 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.566149+0000", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5977999999999998e-05 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.566226+0000", 2024-04-23T19:03:05.549 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.7293999999999996e-05 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.566384+0000", 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000157255 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.566494+0000", 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000110599 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.550 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.573561+0000", 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0070664569999999999 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.589203+0000", 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015642389999999999 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.589268+0000", 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.4848e-05 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.551 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:58.589324+0000", 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.6062e-05 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3756 3.5 e96/20 3:a3060a23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_110:head v 96'15, mlcod=88'13)", 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.318796+0000", 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 6.1644201819999997, 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024342417000000002, 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.552 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.318796+0000", 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.318796+0000", 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.553 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.318798+0000", 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.601e-06 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324136+0000", 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053380270000000004 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324164+0000", 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8507999999999999e-05 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.554 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324179+0000", 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.5073e-05 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324269+0000", 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.0118999999999996e-05 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.324290+0000", 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.0964000000000001e-05 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.555 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.343093+0000", 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.018802334 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.343139+0000", 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.5791000000000003e-05 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_repop(client.4461.0:3823 3.15 e96/20 3:a83eb27f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_167:head v 96'30, mlcod=89'28)", 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:02:59.935482+0000", 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.5477342649999999, 2024-04-23T19:03:05.556 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.026877267999999999, 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.935482+0000", 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.935482+0000", 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.557 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.935484+0000", 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3750000000000001e-06 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.939906+0000", 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0044220659999999997 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.939947+0000", 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.0268999999999997e-05 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.558 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.939964+0000", 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6943999999999999e-05 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.940083+0000", 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00011923500000000001 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.940115+0000", 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.2378000000000001e-05 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.559 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.962290+0000", 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.022174370999999998 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:02:59.962359+0000", 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.9629999999999996e-05 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3841 3.2 3:40b5d18c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.111678+0000", 2024-04-23T19:03:05.560 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.3715387420000003, 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.024210736, 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3841 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.111678+0000", 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.561 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.111678+0000", 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.111680+0000", 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3949999999999999e-06 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.117035+0000", 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0053554170000000003 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.117055+0000", 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.9477e-05 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.117065+0000", 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.7410000000000004e-06 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.117151+0000", 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.6551000000000005e-05 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.563 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.117364+0000", 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00021293399999999999 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.117550+0000", 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000186047 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.127580+0000", 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010029556 2024-04-23T19:03:05.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.135761+0000", 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0081810619999999994 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.135833+0000", 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1755999999999995e-05 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.135888+0000", 2024-04-23T19:03:05.565 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5800000000000001e-05 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3852 3.27 3:e5a60c06:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.220196+0000", 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.2630202779999999, 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.025741511000000002, 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.566 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3852 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.220196+0000", 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.220196+0000", 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.567 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.220199+0000", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.7140000000000002e-06 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.222117+0000", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0019183220000000001 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.222142+0000", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5213999999999999e-05 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.568 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.222157+0000", 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4885000000000001e-05 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.222237+0000", 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.9552e-05 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.222399+0000", 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00016275299999999999 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.569 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.222553+0000", 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00015323999999999999 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.232071+0000", 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0095186620000000007 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.245819+0000", 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.013747462 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.245888+0000", 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8989e-05 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.245938+0000", 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.9718000000000001e-05 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:3868 3.33 3:ce264179:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:00.389246+0000", 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 5.0939708059999997, 2024-04-23T19:03:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.028797863, 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 3868 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.389246+0000", 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.389246+0000", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.389248+0000", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.96e-06 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.390933+0000", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00168483 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.390962+0000", 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.8456999999999999e-05 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.390975+0000", 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.3023000000000001e-05 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.391057+0000", 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.2645999999999994e-05 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.574 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.391201+0000", 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000143573 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.391318+0000", 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000117081 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.397962+0000", 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0066439999999999997 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.575 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.417961+0000", 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.019998799000000001 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.418009+0000", 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 4.8099000000000001e-05 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:00.418043+0000", 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.4394999999999998e-05 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.576 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4076 3.29 3:960a2390:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_420:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.276482+0000", 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.2067342650000001, 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.029582830000000001, 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.577 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4076 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.276482+0000", 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.276482+0000", 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.578 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.276485+0000", 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.5160000000000001e-06 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.279038+0000", 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00255347 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.279075+0000", 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.7441999999999998e-05 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.579 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.279092+0000", 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.6511000000000002e-05 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.279182+0000", 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.9559000000000001e-05 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.279372+0000", 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019048099999999999 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.580 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.279786+0000", 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00041365299999999999 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.289943+0000", 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.010156859000000001 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.305939+0000", 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.015996119999999999 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.581 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.306010+0000", 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 7.1068999999999993e-05 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.306065+0000", 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.5149999999999999e-05 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4091 3.29 3:94809cb6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_435:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.582 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.467833+0000", 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.0153831850000001, 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.02280128, 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4091 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.583 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.467833+0000", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.467833+0000", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.467836+0000", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.3050000000000001e-06 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.470088+0000", 2024-04-23T19:03:05.584 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022518730000000002 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.470111+0000", 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.2608000000000001e-05 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.470124+0000", 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.2756e-05 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.470218+0000", 2024-04-23T19:03:05.585 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 9.3967000000000003e-05 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.470364+0000", 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00014624000000000001 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.470486+0000", 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000122366 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.484476+0000", 2024-04-23T19:03:05.586 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.01399014 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.490494+0000", 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0060181100000000001 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.490579+0000", 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.4942000000000001e-05 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.490634+0000", 2024-04-23T19:03:05.587 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 5.4972999999999997e-05 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "description": "osd_op(client.4461.0:4092 3.24 3:25686a8f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_436:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "initiated_at": "2024-04-23T19:03:03.477130+0000", 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "age": 2.006085991, 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.023673552, 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "continuous": false, 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "type_data": { 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client_info": { 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client": "client.4461", 2024-04-23T19:03:05.588 INFO:teuthology.orchestra.run.smithi169.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "tid": 4092 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "events": [ 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "initiated", 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.477130+0000", 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "header_read", 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.477130+0000", 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.589 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "throttled", 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.477134+0000", 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 3.6710000000000001e-06 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "all_read", 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.479413+0000", 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0022786569999999999 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "dispatched", 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.479437+0000", 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 2.3994000000000001e-05 2024-04-23T19:03:05.590 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.479451+0000", 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 1.4596999999999999e-05 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "reached_pg", 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.479556+0000", 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.000105031 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "started", 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.479749+0000", 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00019224300000000001 2024-04-23T19:03:05.591 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.479930+0000", 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.00018159 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "op_commit", 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.488546+0000", 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0086160019999999993 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.500653+0000", 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 0.0121067 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.592 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "commit_sent", 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.500736+0000", 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 8.3040000000000005e-05 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: { 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: "event": "done", 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: "time": "2024-04-23T19:03:03.500804+0000", 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: "duration": 6.8027000000000004e-05 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-04-23T19:03:05.593 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:05.595 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T19:03:05.724 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:05.724 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:05.724 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:03:05.724 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:05.738 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T19:03:05.857 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:05.857 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:05.857 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:03:05.857 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:03:05.858 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:05.871 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T19:03:05.993 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2208 3.1a 3:58d1a835:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.140034646000004, 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030597897999999998, 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:05.994 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2208 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851767+0000", 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.995 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.851771+0000", 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4029999999999999e-06 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856942+0000", 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051717050000000004 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.856983+0000", 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0543000000000001e-05 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.996 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857001+0000", 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7980000000000001e-05 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857202+0000", 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020080099999999999 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857461+0000", 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000259237 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.997 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.857681+0000", 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022058399999999999 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.865281+0000", 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075994790000000001 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882101+0000", 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016820518999999999 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.998 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882238+0000", 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013626299999999999 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.882365+0000", 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000127384 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2276 3.9 3:92605e37:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:03:05.999 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 90.188346177, 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028126937000000001, 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2276 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.000 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803456+0000", 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.803459+0000", 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6569999999999999e-06 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.001 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808651+0000", 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051918789999999999 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808687+0000", 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.578e-05 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808711+0000", 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4119000000000001e-05 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.002 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.808865+0000", 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015383500000000001 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809227+0000", 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00036236200000000002 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.809648+0000", 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042050200000000001 2024-04-23T19:03:06.003 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.819871+0000", 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010223100000000001 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831178+0000", 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011307041 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831422+0000", 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024433400000000002 2024-04-23T19:03:06.004 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.831583+0000", 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000160328 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2285 3.14 3:2835ac9d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 90.045685265000003, 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129333000000001, 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.005 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2285 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.006 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946116+0000", 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.946120+0000", 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2799999999999999e-06 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953509+0000", 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0073896129999999997 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.007 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953543+0000", 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3503000000000001e-05 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953560+0000", 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7333000000000002e-05 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953686+0000", 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012567200000000001 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.008 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.953941+0000", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025492700000000001 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.954222+0000", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028077700000000001 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.971677+0000", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017455867999999999 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972052+0000", 2024-04-23T19:03:06.009 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000374049 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972151+0000", 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9296000000000006e-05 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.972246+0000", 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5014999999999997e-05 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.010 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2296 3.1b 3:da93e0c0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 89.914321670000007, 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024780970999999999, 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2296 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.011 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077480+0000", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.077484+0000", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5999999999999998e-06 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.012 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082024+0000", 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045400650000000002 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082061+0000", 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.697e-05 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082077+0000", 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6578999999999998e-05 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.013 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082232+0000", 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154976 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082616+0000", 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038331200000000002 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.082992+0000", 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00037627599999999999 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.014 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101299+0000", 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018307423999999999 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.101968+0000", 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00066872899999999996 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102134+0000", 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000166405 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.015 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.102261+0000", 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000126635 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2598 3.34 3:2ceb659c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.612445381000001, 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029508171999999999, 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.016 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2598 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379356+0000", 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.017 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.379360+0000", 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4000000000000001e-06 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387816+0000", 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084566090000000003 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387850+0000", 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3602000000000001e-05 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.018 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.387868+0000", 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7986999999999999e-05 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388011+0000", 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014285400000000001 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388287+0000", 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027580500000000001 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.019 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:06.020 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.388532+0000", 2024-04-23T19:03:06.020 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024521100000000001 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.395386+0000", 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068537700000000003 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408678+0000", 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013291967 2024-04-23T19:03:06.022 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408773+0000", 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5495000000000006e-05 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.408865+0000", 2024-04-23T19:03:06.023 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1471999999999994e-05 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2667 3.a e74/20 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head v 74'8, mlcod=74'6)", 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.815561191, 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030353475000000001, 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.024 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176241+0000", 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.176244+0000", 2024-04-23T19:03:06.025 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2160000000000002e-06 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179168+0000", 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0029242550000000002 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179212+0000", 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4359e-05 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.026 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179232+0000", 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9882999999999999e-05 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179365+0000", 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000132261 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.027 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.179412+0000", 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7036000000000002e-05 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206452+0000", 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027040568000000001 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.028 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.206594+0000", 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014189699999999999 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2674 3.14 3:2b0f98eb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 53.739943828000001, 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026220205999999999, 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.029 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2674 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.030 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251858+0000", 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.251863+0000", 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6800000000000001e-06 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257951+0000", 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0060882419999999998 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.257988+0000", 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6925999999999998e-05 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258004+0000", 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6022999999999999e-05 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258195+0000", 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019149299999999999 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258451+0000", 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025600299999999998 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.258685+0000", 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023416499999999999 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.268973+0000", 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010288004999999999 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277887+0000", 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.008913519 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.277993+0000", 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000105751 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.278078+0000", 2024-04-23T19:03:06.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.5399e-05 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2766 3.3 3:c328f297:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 52.514437604999998, 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025413699000000001, 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.036 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2766 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477364+0000", 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.477367+0000", 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481458+0000", 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040904340000000004 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481504+0000", 2024-04-23T19:03:06.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5769999999999997e-05 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481524+0000", 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0228999999999999e-05 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.481766+0000", 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024267900000000001 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482014+0000", 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024761899999999997 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.482287+0000", 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000273226 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.492280+0000", 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099926119999999997 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502460+0000", 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010180553 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502643+0000", 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000182907 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:13.502778+0000", 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013448999999999999 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3281 3.14 3:2a562768:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_296:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.223866+0000", 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.767936049999999, 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024525669, 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3281 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.042 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.223866+0000", 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.223866+0000", 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.223869+0000", 2024-04-23T19:03:06.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4999999999999999e-06 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.231871+0000", 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080015090000000004 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.231903+0000", 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2264999999999997e-05 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.231920+0000", 2024-04-23T19:03:06.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6697e-05 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232083+0000", 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016292100000000001 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232441+0000", 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035839200000000002 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.232675+0000", 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234114 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.244276+0000", 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011600586 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.248264+0000", 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039887610000000004 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.248334+0000", 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9078999999999994e-05 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.248391+0000", 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7844999999999999e-05 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3351 3.f e88/20 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head v 88'17, mlcod=88'15)", 2024-04-23T19:03:06.047 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.142186+0000", 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 28.849615405000002, 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026165384, 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.142186+0000", 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.142186+0000", 2024-04-23T19:03:06.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.142190+0000", 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.18e-06 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148420+0000", 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0062304539999999999 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148472+0000", 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1706000000000003e-05 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148498+0000", 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6013e-05 2024-04-23T19:03:06.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148699+0000", 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020166100000000001 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.148769+0000", 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9706e-05 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168211+0000", 2024-04-23T19:03:06.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019441614999999999 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168352+0000", 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141049 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3689 3.9 3:93ad4ddc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.619386+0000", 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.3724158260000001, 2024-04-23T19:03:06.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024458705000000001, 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3689 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.619386+0000", 2024-04-23T19:03:06.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.619386+0000", 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.619390+0000", 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5829999999999998e-06 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.054 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.625784+0000", 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006394266 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.625827+0000", 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2864999999999997e-05 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.625853+0000", 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6393e-05 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.626054+0000", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000200585 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.626309+0000", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025503400000000001 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.626542+0000", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233277 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.643159+0000", 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016616771999999998 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.643552+0000", 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000392817 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.643721+0000", 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000169383 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.643845+0000", 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012373000000000001 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3697 3.e e96/20 3:722502ec:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_51:head v 96'20, mlcod=88'18)", 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.707160+0000", 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.2846420089999997, 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027917623999999999, 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.058 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.707160+0000", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.707160+0000", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.707163+0000", 2024-04-23T19:03:06.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.01e-06 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.710581+0000", 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003417949 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.710619+0000", 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8532000000000003e-05 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.060 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.710642+0000", 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2923000000000001e-05 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.710850+0000", 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020817500000000001 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.710919+0000", 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8734999999999998e-05 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.734930+0000", 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024011419999999999 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735077+0000", 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014688 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3763 3.14 3:2b4f1c7c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.062 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.383666+0000", 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.6081354809999997, 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02693655, 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3763 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.383666+0000", 2024-04-23T19:03:06.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.383666+0000", 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.383670+0000", 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8060000000000001e-06 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.390266+0000", 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065960970000000004 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.390314+0000", 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7389000000000003e-05 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.390341+0000", 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7336000000000001e-05 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.390505+0000", 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016424300000000001 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.390830+0000", 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00032499200000000002 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.391130+0000", 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00029936900000000001 2024-04-23T19:03:06.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.404521+0000", 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013391455 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.410299+0000", 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057776149999999998 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.410472+0000", 2024-04-23T19:03:06.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017389799999999999 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.410603+0000", 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013035 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3821 3.34 3:2ff5f6e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.911126+0000", 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.0806756259999997, 2024-04-23T19:03:06.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033343788999999999, 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3821 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.911126+0000", 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.911126+0000", 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.911129+0000", 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0529999999999998e-06 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.915050+0000", 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0039204000000000001 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.915091+0000", 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1001999999999998e-05 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.915108+0000", 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7646999999999999e-05 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.915278+0000", 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016945600000000001 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.915690+0000", 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000412163 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.916122+0000", 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043168299999999998 2024-04-23T19:03:06.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.929964+0000", 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013842817 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.944233+0000", 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014268977 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.944341+0000", 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010741100000000001 2024-04-23T19:03:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.944470+0000", 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012918000000000001 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3848 3.31 3:8c80c6d1:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.179259+0000", 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.8125423879999998, 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030722649000000001, 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.074 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3848 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.179259+0000", 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.179259+0000", 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.179370+0000", 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011059499999999999 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.183649+0000", 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004278815 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.183679+0000", 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0539e-05 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.183700+0000", 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0886e-05 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.183834+0000", 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000134065 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.184104+0000", 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026925899999999999 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.184319+0000", 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021531499999999999 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.195870+0000", 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011551005 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.209819+0000", 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013948881999999999 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.209908+0000", 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.9121000000000003e-05 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.209982+0000", 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4166999999999996e-05 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.079 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3872 3.e e96/20 3:735eed22:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_216:head v 96'26, mlcod=96'24)", 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.439219+0000", 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.5525825610000004, 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024516290999999999, 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.439219+0000", 2024-04-23T19:03:06.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.439219+0000", 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.439221+0000", 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.013e-06 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.443742+0000", 2024-04-23T19:03:06.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004520573 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.443780+0000", 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7999e-05 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.443798+0000", 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8655999999999999e-05 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.443960+0000", 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016114300000000001 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.444028+0000", 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8654999999999999e-05 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.463598+0000", 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019569953000000001 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.463735+0000", 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013729899999999999 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3889 3.31 3:8c74b849:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.611931+0000", 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.3798703750000003, 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026790002, 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.084 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3889 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.611931+0000", 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.611931+0000", 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.611935+0000", 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9840000000000003e-06 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.616100+0000", 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041647139999999999 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.616146+0000", 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6045999999999999e-05 2024-04-23T19:03:06.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.616171+0000", 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5262e-05 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.616307+0000", 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013600400000000001 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.616568+0000", 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026061999999999998 2024-04-23T19:03:06.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 1", 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.616804+0000", 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000235811 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.629802+0000", 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012998309 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.638464+0000", 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086616049999999993 2024-04-23T19:03:06.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.638584+0000", 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119757 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.638721+0000", 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013789 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.089 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:4076 3.29 e97/20 3:960a2390:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_420:head v 97'27, mlcod=97'25)", 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.279744+0000", 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.7120580949999997, 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025665232999999999, 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.279744+0000", 2024-04-23T19:03:06.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.279744+0000", 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.279745+0000", 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6029999999999999e-06 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.286719+0000", 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069739909999999997 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.286751+0000", 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1955999999999997e-05 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.286768+0000", 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7122999999999999e-05 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.286917+0000", 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014878 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.286982+0000", 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4919000000000006e-05 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.305279+0000", 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018297337 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.305409+0000", 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000129524 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4084 3.14 3:2aa9ea06:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.378546+0000", 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.6132559070000001, 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025088249999999999, 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.094 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4084 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.378546+0000", 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.378546+0000", 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.378575+0000", 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8846000000000001e-05 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.383425+0000", 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0048502830000000004 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.383466+0000", 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1158999999999997e-05 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.383486+0000", 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9890000000000001e-05 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.383621+0000", 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013508699999999999 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.383881+0000", 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025947399999999999 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.384123+0000", 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024221799999999999 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.395841+0000", 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011717966999999999 2024-04-23T19:03:06.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.403453+0000", 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0076126939999999997 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.403551+0000", 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7248000000000001e-05 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.403634+0000", 2024-04-23T19:03:06.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.3384e-05 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4123 3.9 3:90bd1e58:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_467:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.803739+0000", 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 2.188062773, 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024435704999999999, 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4123 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.803739+0000", 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.803739+0000", 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.803742+0000", 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2899999999999998e-06 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.808362+0000", 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046200149999999999 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.808402+0000", 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0185000000000002e-05 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.808429+0000", 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6279999999999999e-05 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.808575+0000", 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014606299999999999 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.808816+0000", 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024092800000000001 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.809038+0000", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000222709 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.818512+0000", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094735310000000003 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.827988+0000", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094759779999999995 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.828092+0000", 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104481 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.828175+0000", 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.2244999999999996e-05 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.105 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:06.107 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T19:03:06.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T19:03:06.234 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:06.235 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:06.235 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:03:06.235 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:06.249 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T19:03:06.371 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:06.372 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:06.372 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:03:06.372 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:03:06.372 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:06.386 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2150 3.5 3:a15b9154:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 92.285053849999997, 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026026667999999999, 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.510 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2150 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.511 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222630+0000", 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.222668+0000", 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7917000000000003e-05 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226719+0000", 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040511669999999996 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.512 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226752+0000", 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3133000000000003e-05 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226768+0000", 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6140000000000001e-05 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.513 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.226865+0000", 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6973999999999997e-05 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227016+0000", 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000150545 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.227139+0000", 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123817 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.514 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.233647+0000", 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0065073860000000004 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248461+0000", 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014814646000000001 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248577+0000", 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011540900000000001 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.515 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.248656+0000", 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9534000000000001e-05 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2211 3.30 3:0f3ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.598542922000007, 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026630204000000001, 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.516 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2211 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909141+0000", 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.517 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.909143+0000", 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913148+0000", 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040052869999999997 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913183+0000", 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4483000000000002e-05 2024-04-23T19:03:06.518 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913200+0000", 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6875999999999999e-05 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913342+0000", 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014225199999999999 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.519 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913579+0000", 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000237381 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.913801+0000", 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022138099999999999 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.922489+0000", 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086879230000000002 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.520 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935596+0000", 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013107255999999999 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935694+0000", 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8443000000000006e-05 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:34.935771+0000", 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6328999999999994e-05 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.521 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2218 3.3c 3:3d1452e8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.450618806999998, 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029439460000000001, 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.522 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2218 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057065+0000", 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.523 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.057068+0000", 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.932e-06 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064793+0000", 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0077257180000000003 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064832+0000", 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8291000000000003e-05 2024-04-23T19:03:06.524 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064846+0000", 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4015e-05 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.064938+0000", 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2429000000000006e-05 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.525 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065081+0000", 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014301400000000001 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.065220+0000", 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000139305 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.073862+0000", 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086415109999999993 2024-04-23T19:03:06.526 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086370+0000", 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012507636000000001 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086442+0000", 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2925999999999999e-05 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.527 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.086504+0000", 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1682999999999999e-05 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:2221 3.36 e57/20 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head v 57'1, mlcod=0'0)", 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.399677737000005, 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033650337000000002, 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.528 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.529 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.108006+0000", 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0999999999999998e-07 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112426+0000", 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044193990000000001 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112468+0000", 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1813000000000001e-05 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.530 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112489+0000", 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1433e-05 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112643+0000", 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015366800000000001 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.112686+0000", 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3093000000000002e-05 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141603+0000", 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028917559999999998 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141656+0000", 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2760999999999998e-05 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2222 3.2a 3:5431dc3e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:06.532 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.395814537999996, 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031154877000000001, 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2222 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:03:06.533 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111869+0000", 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.111874+0000", 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.0320000000000003e-06 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.534 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116045+0000", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041711480000000004 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116097+0000", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1771000000000003e-05 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116127+0000", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9671000000000001e-05 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116248+0000", 2024-04-23T19:03:06.535 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000121332 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116422+0000", 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017437099999999999 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.536 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.116563+0000", 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014087 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.133570+0000", 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017006429 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142931+0000", 2024-04-23T19:03:06.537 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0093616519999999998 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142978+0000", 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6304999999999998e-05 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.538 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.143024+0000", 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6295999999999999e-05 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2263 3.28 3:15ccdc2e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:03:06.539 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 90.866267457000006, 2024-04-23T19:03:06.540 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.035710724999999999, 2024-04-23T19:03:06.540 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.540 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.540 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.540 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2263 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641416+0000", 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.541 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.641420+0000", 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2540000000000003e-06 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646109+0000", 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004688991 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646142+0000", 2024-04-23T19:03:06.542 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3099999999999998e-05 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646159+0000", 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6920000000000001e-05 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646258+0000", 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8592999999999996e-05 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646482+0000", 2024-04-23T19:03:06.543 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022459699999999999 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.646761+0000", 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027820999999999998 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.654574+0000", 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0078129570000000006 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677002+0000", 2024-04-23T19:03:06.544 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.022428060999999999 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677062+0000", 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0624000000000001e-05 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.677127+0000", 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4418000000000006e-05 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.545 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2610 3.28 3:149f9a71:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.002748425999997, 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026773075, 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2610 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.546 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504935+0000", 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.504939+0000", 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0169999999999998e-06 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.547 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510317+0000", 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053776190000000001 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510357+0000", 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.053e-05 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510387+0000", 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.9839e-05 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.548 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510519+0000", 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131514 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510766+0000", 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000247245 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.510998+0000", 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023225599999999999 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.549 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.521918+0000", 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010920242 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531388+0000", 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.009469959 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531571+0000", 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018284 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.550 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.531708+0000", 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000137014 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3191 3.c 3:3340fe65:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 31.449738286999999, 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034282769999999997, 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.551 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3191 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057945+0000", 2024-04-23T19:03:06.552 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.057950+0000", 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5569999999999997e-06 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063293+0000", 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053432419999999998 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063340+0000", 2024-04-23T19:03:06.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7191999999999998e-05 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063367+0000", 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6347e-05 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063565+0000", 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019835999999999999 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.063919+0000", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035387599999999998 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.064156+0000", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023711700000000001 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.073363+0000", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0092073729999999996 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092068+0000", 2024-04-23T19:03:06.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018704971000000001 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092156+0000", 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.7303000000000001e-05 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.092228+0000", 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2432e-05 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.556 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3362 3.2a 3:5595a52f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.253297+0000", 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.254386612000001, 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030245859, 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3362 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.253297+0000", 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.253297+0000", 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.253321+0000", 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.4012999999999999e-05 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258767+0000", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054464559999999997 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258805+0000", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7289000000000002e-05 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258821+0000", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6350000000000001e-05 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.258989+0000", 2024-04-23T19:03:06.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016816800000000001 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.259384+0000", 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00039525900000000002 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.259790+0000", 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040605200000000001 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274661+0000", 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014870229 2024-04-23T19:03:06.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.283267+0000", 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086062329999999996 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.283431+0000", 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016417100000000001 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.283543+0000", 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011163900000000001 2024-04-23T19:03:06.561 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3368 3.3c 3:3fc98c7c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_383:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.326924+0000", 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.180759346999999, 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026740689000000002, 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3368 2024-04-23T19:03:06.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.326924+0000", 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.326924+0000", 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.326928+0000", 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6339999999999999e-06 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335315+0000", 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0083870019999999993 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335361+0000", 2024-04-23T19:03:06.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5933999999999998e-05 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335387+0000", 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6571e-05 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335515+0000", 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012788099999999999 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335770+0000", 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025488699999999997 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335995+0000", 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0002252 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.351549+0000", 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015553765000000001 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353437+0000", 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001887878 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353586+0000", 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014861799999999999 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353665+0000", 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.9319000000000004e-05 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.567 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3665 3.16 3:6870589d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.370216+0000", 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.1374677089999992, 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028222173, 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3665 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.568 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.370216+0000", 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.370216+0000", 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.370222+0000", 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7070000000000003e-06 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.377762+0000", 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00753953 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.377811+0000", 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8619000000000003e-05 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.377837+0000", 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6395999999999999e-05 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.571 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.377998+0000", 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016080900000000001 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.378340+0000", 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034237500000000001 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.378579+0000", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000239044 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.393232+0000", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014652658000000001 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.398265+0000", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050335290000000001 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.398363+0000", 2024-04-23T19:03:06.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7724000000000002e-05 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.398438+0000", 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4782000000000003e-05 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3673 3.2a 3:561410bf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.455466+0000", 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0522173059999993, 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027830822000000002, 2024-04-23T19:03:06.574 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3673 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.455466+0000", 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.455466+0000", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.455470+0000", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7730000000000001e-06 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.464102+0000", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0086322729999999993 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.464136+0000", 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3426000000000002e-05 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.464151+0000", 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.5625999999999999e-05 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.464269+0000", 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000118084 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.464513+0000", 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024377399999999999 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.464756+0000", 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024328699999999999 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.475399+0000", 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010642328 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.482926+0000", 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075275569999999998 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.483103+0000", 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000176718 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.483297+0000", 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000193976 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3700 3.16 3:6bbac694:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.730355+0000", 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.7773282940000001, 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031236503999999998, 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.580 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3700 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.730355+0000", 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.730355+0000", 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.730359+0000", 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.653e-06 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.734990+0000", 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0046312330000000002 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.582 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735035+0000", 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4944999999999997e-05 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735063+0000", 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7483000000000001e-05 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735282+0000", 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021959400000000001 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735702+0000", 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042010600000000001 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.736058+0000", 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035575100000000002 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.749723+0000", 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013665175999999999 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.761261+0000", 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011537957999999999 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.761442+0000", 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018068199999999999 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.761592+0000", 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014992299999999999 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3706 3.22 3:479836d3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.790855+0000", 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.7168284959999998, 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025686484999999998, 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3706 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.790855+0000", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.790855+0000", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.790859+0000", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7230000000000002e-06 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.795810+0000", 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0049512940000000002 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.795862+0000", 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.1646e-05 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.795889+0000", 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7572e-05 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.796067+0000", 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000178006 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.796381+0000", 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000313512 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.796614+0000", 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000233064 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.806221+0000", 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096068330000000004 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.816190+0000", 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0099692340000000004 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.816394+0000", 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000204255 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.816541+0000", 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014734599999999999 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3756 3.5 3:a3060a23:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.312094+0000", 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.195589418, 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031365055000000003, 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.591 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3756 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.312094+0000", 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.312094+0000", 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.312098+0000", 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.817e-06 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.317173+0000", 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050752480000000001 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.317213+0000", 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0195999999999999e-05 2024-04-23T19:03:06.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.317233+0000", 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9273e-05 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.317405+0000", 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017285900000000001 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.317836+0000", 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043071599999999999 2024-04-23T19:03:06.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.318273+0000", 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043655199999999999 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.330417+0000", 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012144113 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.343287+0000", 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012870349 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.343386+0000", 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8783999999999995e-05 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.343459+0000", 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3147999999999998e-05 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3769 3.3c 3:3caa6e94:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.596 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.443854+0000", 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.0638291249999998, 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027321664999999998, 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3769 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.443854+0000", 2024-04-23T19:03:06.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.443854+0000", 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.443858+0000", 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.771e-06 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.450565+0000", 2024-04-23T19:03:06.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067070410000000004 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.450611+0000", 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5355999999999997e-05 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.450632+0000", 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1399e-05 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.450795+0000", 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000163339 2024-04-23T19:03:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.451044+0000", 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000248667 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.451276+0000", 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023205099999999999 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.470682+0000", 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019406497000000002 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.471002+0000", 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031926799999999999 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.471106+0000", 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104688 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.471176+0000", 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9587999999999998e-05 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.601 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3867 3.2a 3:567fb49b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.380248+0000", 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.1274350379999998, 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037151905999999998, 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.602 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3867 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.380248+0000", 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.380248+0000", 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.380252+0000", 2024-04-23T19:03:06.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0330000000000002e-06 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.388538+0000", 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0082852700000000008 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.388586+0000", 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8338999999999999e-05 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.388619+0000", 2024-04-23T19:03:06.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2815999999999999e-05 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.388820+0000", 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000200865 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.389081+0000", 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026100100000000002 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.389355+0000", 2024-04-23T19:03:06.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027415600000000001 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.408248+0000", 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018893486000000001 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.417223+0000", 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0089742610000000007 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.417326+0000", 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010340699999999999 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.417400+0000", 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.4271999999999996e-05 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3898 3.3c 3:3d96f5ea:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.711137+0000", 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 5.7965462790000002, 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029192287000000001, 2024-04-23T19:03:06.607 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3898 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.711137+0000", 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.711137+0000", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.711140+0000", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2890000000000002e-06 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.716561+0000", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0054201980000000002 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.716603+0000", 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2759000000000002e-05 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.716622+0000", 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8842999999999999e-05 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.716796+0000", 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000173306 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.610 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.717142+0000", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00034631199999999999 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.717377+0000", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000234804 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.728936+0000", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01155948 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.740003+0000", 2024-04-23T19:03:06.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011067264 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.740195+0000", 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000191702 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.740329+0000", 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013433 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.612 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4079 3.5 3:a012d327:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.308662+0000", 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.1990214809999999, 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028346041999999998, 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4079 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.308662+0000", 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.308662+0000", 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.308665+0000", 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8669999999999998e-06 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.312831+0000", 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041660619999999999 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.312869+0000", 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8089000000000001e-05 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.312888+0000", 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8586000000000001e-05 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.313027+0000", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000138913 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.313302+0000", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027520700000000002 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.313537+0000", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023570199999999999 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.321524+0000", 2024-04-23T19:03:06.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0079870679999999999 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.336805+0000", 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015280013 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.336917+0000", 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000112247 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.337008+0000", 2024-04-23T19:03:06.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.1287999999999997e-05 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4090 3.28 3:1515f543:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_434:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.457257+0000", 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.0504264170000002, 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026445205999999999, 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:06.618 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4090 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.457257+0000", 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.457257+0000", 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.457260+0000", 2024-04-23T19:03:06.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3569999999999998e-06 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.461660+0000", 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043997730000000001 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.461694+0000", 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3429000000000001e-05 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.461712+0000", 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8346e-05 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.461881+0000", 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016949599999999999 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.462112+0000", 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000230368 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.462331+0000", 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219099 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.473834+0000", 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011502586 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.483521+0000", 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0096875060000000002 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.483621+0000", 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000100331 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.483702+0000", 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0914999999999994e-05 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:06.623 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:06.625 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T19:03:06.751 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:06.751 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:06.751 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:03:06.751 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:06.765 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T19:03:06.887 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:06.888 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:06.888 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:03:06.888 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:03:06.888 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:06.902 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T19:03:07.030 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:07.030 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:03:07.030 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:03:07.030 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:03:07.030 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.030 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2221 3.36 3:6c474d24:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.931988704999995, 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.045878081000000001, 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2221 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.031 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096122+0000", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.096124+0000", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-06 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.032 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101223+0000", 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0050983030000000002 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101250+0000", 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7285e-05 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101263+0000", 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3233e-05 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.033 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101420+0000", 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015684499999999999 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.101437+0000", 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7459999999999999e-05 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107424+0000", 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0059869470000000003 2024-04-23T19:03:07.034 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107606+0000", 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018122599999999999 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.107800+0000", 2024-04-23T19:03:07.035 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019422999999999999 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.122947+0000", 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015146880999999999 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141903+0000", 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018956540000000001 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.036 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.141964+0000", 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.1186999999999995e-05 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.142000+0000", 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5175000000000001e-05 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2266 3.26 3:678475f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 91.340888515000003, 2024-04-23T19:03:07.037 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031371309, 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2266 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.038 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687222+0000", 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.687226+0000", 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6330000000000004e-06 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691416+0000", 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041898439999999999 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.039 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691456+0000", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9783999999999997e-05 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691474+0000", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8386e-05 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691611+0000", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013676500000000001 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.040 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.691892+0000", 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028041699999999998 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.692129+0000", 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023746699999999999 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.712373+0000", 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.02024405 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.041 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718210+0000", 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058370039999999998 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718419+0000", 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020909800000000001 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:35.718593+0000", 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017386100000000001 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.042 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2293 3.a 3:5170d418:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 90.980934008000006, 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027526952, 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2293 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.043 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047176+0000", 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.047181+0000", 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.34e-06 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.044 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053922+0000", 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0067411679999999996 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053959+0000", 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7299999999999999e-05 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.053977+0000", 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7696000000000001e-05 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.045 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054104+0000", 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012707199999999999 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054369+0000", 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265297 2024-04-23T19:03:07.046 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.054600+0000", 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023101799999999999 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.072590+0000", 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01799007 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073035+0000", 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044503899999999999 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.047 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.073504+0000", 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046863500000000002 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.074703+0000", 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0011993170000000001 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2317 3.10 3:0aeeea85:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.9__shadow_.RQjI9h8CKQgSEuOsCQBTNf47-Vg2CZI_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-23T19:03:07.048 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 90.729246278999995, 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027182562, 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2317 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:03:07.049 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298864+0000", 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.298867+0000", 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4340000000000001e-06 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304494+0000", 2024-04-23T19:03:07.050 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056268259999999997 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304542+0000", 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7403e-05 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304562+0000", 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0526e-05 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.304743+0000", 2024-04-23T19:03:07.051 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180922 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305173+0000", 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00043021800000000001 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.305603+0000", 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042982200000000001 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.316289+0000", 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010685679 2024-04-23T19:03:07.052 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325759+0000", 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0094696680000000005 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.325931+0000", 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017266800000000001 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:01:36.326047+0000", 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000115396 2024-04-23T19:03:07.053 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2621 3.a 3:53fd557d:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.411408846, 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028876870999999998, 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.054 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2621 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616701+0000", 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.616705+0000", 2024-04-23T19:03:07.055 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7330000000000001e-06 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620766+0000", 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040612479999999999 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.056 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620799+0000", 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2808999999999997e-05 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620817+0000", 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7520000000000002e-05 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.620943+0000", 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012589099999999999 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.057 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621217+0000", 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027440100000000002 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.621448+0000", 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023054299999999999 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.643338+0000", 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021890703000000001 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.058 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645158+0000", 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0018199360000000001 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645359+0000", 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020107400000000001 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.645578+0000", 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000219013 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.059 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2625 3.20 3:074114f6:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 55.373405749, 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026946567000000001, 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2625 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.060 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654705+0000", 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.654708+0000", 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8680000000000001e-06 2024-04-23T19:03:07.061 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658900+0000", 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041920359999999997 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658950+0000", 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9196000000000001e-05 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.658975+0000", 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5259999999999999e-05 2024-04-23T19:03:07.062 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659117+0000", 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014254900000000001 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659366+0000", 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024814500000000002 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.659795+0000", 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042929900000000001 2024-04-23T19:03:07.063 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.670047+0000", 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010252068 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681478+0000", 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011430689000000001 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681573+0000", 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5254999999999995e-05 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.064 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:11.681651+0000", 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8201999999999994e-05 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2667 3.a 3:53e028cf:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.858271731000002, 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037344931999999997, 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.065 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2667 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.066 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169839+0000", 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.169842+0000", 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6729999999999998e-06 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.067 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175191+0000", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053492119999999999 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175240+0000", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.8158999999999997e-05 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175259+0000", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9757000000000001e-05 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175426+0000", 2024-04-23T19:03:07.068 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016703000000000001 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175679+0000", 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025296599999999998 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.175912+0000", 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023224500000000001 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.192597+0000", 2024-04-23T19:03:07.069 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016685163999999999 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207016+0000", 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014418914999999999 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207110+0000", 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.3974999999999994e-05 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.070 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.207183+0000", 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3836000000000003e-05 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3232 3.35 3:acc6f285:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 31.480549688, 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028471888000000001, 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.071 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3232 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547561+0000", 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.072 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.547564+0000", 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5030000000000002e-06 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551650+0000", 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040853879999999997 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551687+0000", 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7543000000000003e-05 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.073 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551705+0000", 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8292999999999999e-05 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.551811+0000", 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010588 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552012+0000", 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020039400000000001 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.074 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.552177+0000", 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016578200000000001 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.560222+0000", 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0080445789999999996 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575904+0000", 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015681898 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.075 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.575974+0000", 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.0353999999999998e-05 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:35.576032+0000", 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.8273999999999998e-05 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3307 3.26 3:6465c41c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.460875439999999, 2024-04-23T19:03:07.076 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030265808000000002, 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3307 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.077 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567235+0000", 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.567238+0000", 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5499999999999999e-06 2024-04-23T19:03:07.078 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573052+0000", 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058136189999999999 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573083+0000", 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1223000000000002e-05 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.079 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573121+0000", 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7732999999999999e-05 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573257+0000", 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013551899999999999 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573489+0000", 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023233999999999999 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:07.080 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.573724+0000", 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023525999999999999 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597129+0000", 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023405171999999998 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597300+0000", 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000170252 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.081 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597436+0000", 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000136181 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.597501+0000", 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.4958999999999999e-05 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3360 3.20 3:05349dc8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_375:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:03:07.082 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.794568375000001, 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.039605253, 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3360 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.083 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233542+0000", 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.233545+0000", 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4970000000000001e-06 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243604+0000", 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010058675 2024-04-23T19:03:07.084 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243642+0000", 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8266000000000003e-05 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243669+0000", 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7013e-05 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243870+0000", 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020050800000000001 2024-04-23T19:03:07.085 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244290+0000", 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420405 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.244711+0000", 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000420295 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.260882+0000", 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016171040000000001 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.086 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272810+0000", 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011928789 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.272970+0000", 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015951600000000001 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273147+0000", 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017724900000000001 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.087 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3370 3.a 3:5380419a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 29.684907562999999, 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.043047185000000002, 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3370 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.088 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343203+0000", 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.343207+0000", 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4599999999999996e-06 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.089 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347261+0000", 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040542390000000003 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347305+0000", 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3569999999999998e-05 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347324+0000", 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8539e-05 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.090 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347478+0000", 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000154656 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.347490+0000", 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.2017e-05 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353197+0000", 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0057065759999999997 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.091 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353532+0000", 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033513599999999998 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.353883+0000", 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000351202 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.367051+0000", 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013167415999999999 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.092 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386045+0000", 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018994938999999999 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386146+0000", 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010012400000000001 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.386250+0000", 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000104311 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.093 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3680 3.a 3:52104d9c:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.524143+0000", 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.5039670980000004, 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027382232999999999, 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3680 2024-04-23T19:03:07.094 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.524143+0000", 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.524143+0000", 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.524146+0000", 2024-04-23T19:03:07.095 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.593e-06 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.528116+0000", 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.003970632 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.528150+0000", 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3892e-05 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.528171+0000", 2024-04-23T19:03:07.096 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0777000000000001e-05 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.528331+0000", 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015943899999999999 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.528731+0000", 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000400257 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.528979+0000", 2024-04-23T19:03:07.097 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024788700000000002 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.550550+0000", 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021571773999999998 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.551307+0000", 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000756444 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.551438+0000", 2024-04-23T19:03:07.098 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013159099999999999 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.551525+0000", 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.6947000000000006e-05 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3726 3.2c 3:3644c900:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.002614+0000", 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.0254958720000005, 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026650304, 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.099 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3726 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.002614+0000", 2024-04-23T19:03:07.100 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.002614+0000", 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.002618+0000", 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5200000000000002e-06 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.007196+0000", 2024-04-23T19:03:07.101 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0045778800000000003 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.007251+0000", 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.5235000000000002e-05 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.007279+0000", 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7690000000000001e-05 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.007447+0000", 2024-04-23T19:03:07.102 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016794600000000001 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.007849+0000", 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040235299999999999 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.008251+0000", 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040207399999999999 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.020582+0000", 2024-04-23T19:03:07.103 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012331078000000001 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.029026+0000", 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0084437839999999993 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.029186+0000", 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016014999999999999 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.029265+0000", 2024-04-23T19:03:07.104 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.8594e-05 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3742 3.10 3:08bb7609:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.169707+0000", 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.8584033150000003, 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029146596, 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.105 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3742 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.169707+0000", 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.169707+0000", 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.106 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.169716+0000", 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.0690000000000008e-06 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.175384+0000", 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0056680639999999996 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.175420+0000", 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5756000000000001e-05 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.107 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.175437+0000", 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7419e-05 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.175554+0000", 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000116904 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.175797+0000", 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000243217 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.108 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.176028+0000", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000230375 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.188071+0000", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012043325000000001 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.198563+0000", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010491930999999999 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.109 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.198723+0000", 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016022200000000001 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.198854+0000", 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000130314 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3821 3.34 e96/20 3:2ff5f6e9:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_165:head v 96'12, mlcod=88'10)", 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.916404+0000", 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.111706399, 2024-04-23T19:03:07.110 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027464057, 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.916404+0000", 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.916404+0000", 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.111 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.916406+0000", 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3999999999999999e-06 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.919039+0000", 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0026325419999999999 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.919080+0000", 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0982000000000002e-05 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.112 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.919098+0000", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8192000000000001e-05 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.919315+0000", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000216935 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.919388+0000", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2952000000000002e-05 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.113 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.943714+0000", 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024325660999999998 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.943868+0000", 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015439300000000001 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3886 3.2c 3:340edbd0:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.583533+0000", 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 6.44457696, 2024-04-23T19:03:07.114 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029846032000000002, 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3886 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.583533+0000", 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.115 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.583533+0000", 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.583536+0000", 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.0400000000000001e-06 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.591064+0000", 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075276240000000001 2024-04-23T19:03:07.116 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.591103+0000", 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9366000000000002e-05 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.591121+0000", 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.7526000000000001e-05 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.591298+0000", 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017686899999999999 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.117 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.591561+0000", 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026346099999999999 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.591794+0000", 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023258400000000001 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.601864+0000", 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010070275 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.118 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.613079+0000", 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011214913999999999 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.613264+0000", 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000184859 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.613379+0000", 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00011551400000000001 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.119 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4085 3.26 3:649dd019:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_429:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.392265+0000", 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.6358454350000002, 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028718455, 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4085 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.120 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.392265+0000", 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.392265+0000", 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.392269+0000", 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.9870000000000001e-06 2024-04-23T19:03:07.121 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.398673+0000", 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0064042750000000001 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.398715+0000", 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2265000000000003e-05 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.398735+0000", 2024-04-23T19:03:07.122 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9675999999999999e-05 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.398883+0000", 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014826999999999999 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.399150+0000", 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000267101 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 7", 2024-04-23T19:03:07.123 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.399404+0000", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025353700000000002 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.420196+0000", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.020792517999999999 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.420815+0000", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00061894999999999995 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.420910+0000", 2024-04-23T19:03:07.124 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4468000000000004e-05 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.420983+0000", 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.3407999999999999e-05 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4096 3.10 3:0a45613e:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_440:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.520400+0000", 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.5077099170000001, 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030945470999999999, 2024-04-23T19:03:07.125 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4096 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.520400+0000", 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.126 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.520400+0000", 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.520405+0000", 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.3200000000000001e-06 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.524595+0000", 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0041903019999999999 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.127 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.524641+0000", 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6162000000000003e-05 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.524660+0000", 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9185e-05 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.524817+0000", 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015647999999999999 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.128 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.525071+0000", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000254028 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.525329+0000", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025789999999999998 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.535075+0000", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0097460210000000005 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.129 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.551178+0000", 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.016103560999999999 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.551273+0000", 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.4580999999999995e-05 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.551346+0000", 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2930999999999997e-05 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.130 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4126 3.2c 3:34ceda36:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_470:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.837013+0000", 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.191097155, 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.030308468000000002, 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4126 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.131 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.837013+0000", 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.837013+0000", 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.837017+0000", 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.4659999999999999e-06 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.132 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.844558+0000", 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0075411419999999998 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.844600+0000", 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2079000000000001e-05 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.844619+0000", 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.965e-05 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.133 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.844789+0000", 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016903 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.845207+0000", 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041843000000000002 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.845608+0000", 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040109400000000001 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.134 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.856633+0000", 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011024943000000001 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.866995+0000", 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010362268000000001 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.867187+0000", 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019132200000000001 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.135 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.867322+0000", 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013504399999999999 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4129 3.35 3:af9ce268:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_473:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.868385+0000", 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.1597257750000001, 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027242011, 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.136 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4129 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.868385+0000", 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.868385+0000", 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.137 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.868389+0000", 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1699999999999999e-06 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.872674+0000", 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042850630000000004 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.872715+0000", 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0794999999999998e-05 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.138 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.872733+0000", 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8675999999999999e-05 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.872888+0000", 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015527 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.873173+0000", 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028460399999999999 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.139 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.873426+0000", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025331799999999999 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.883484+0000", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010057145 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.895315+0000", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.01183094 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.140 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.895485+0000", 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017023 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.895627+0000", 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0001418 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.141 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:07.142 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T19:03:07.153 INFO:teuthology.orchestra.run.smithi169.stderr:noscrub is unset 2024-04-23T19:03:07.180 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T19:03:07.269 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:07.269 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:07.269 INFO:teuthology.orchestra.run.smithi193.stdout: "num_ops": 0 2024-04-23T19:03:07.269 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:07.285 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T19:03:07.410 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:07.410 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [], 2024-04-23T19:03:07.410 INFO:teuthology.orchestra.run.smithi193.stdout: "complaint_time": 30, 2024-04-23T19:03:07.410 INFO:teuthology.orchestra.run.smithi193.stdout: "num_blocked_ops": 0 2024-04-23T19:03:07.410 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:07.424 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T19:03:07.552 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-23T19:03:07.552 INFO:teuthology.orchestra.run.smithi193.stdout: "size": 20, 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 600, 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "ops": [ 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 184.37932525400001, 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46555575399999999, 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:03:07.553 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 1 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171104+0000", 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.554 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171106+0000", 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6199999999999999e-06 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171120+0000", 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.4003e-05 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171143+0000", 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.2453e-05 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.555 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.556 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171162+0000", 2024-04-23T19:03:07.556 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9386e-05 2024-04-23T19:03:07.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.556 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.556 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171260+0000", 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8259999999999998e-05 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for peered", 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.171272+0000", 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.19e-05 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633314+0000", 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.46204173500000001 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.557 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.633666+0000", 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00035166700000000001 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.634076+0000", 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041040100000000002 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.635692+0000", 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.001615603 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.558 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636489+0000", 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000797264 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636590+0000", 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101456 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.636659+0000", 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9005999999999996e-05 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.559 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 183.64643348300001, 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027188522999999999, 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4195", 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.193:0/2074182197", 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 117 2024-04-23T19:03:07.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903995+0000", 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.903996+0000", 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.23e-07 2024-04-23T19:03:07.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904002+0000", 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7869999999999998e-06 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904012+0000", 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.5959999999999993e-06 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.904019+0000", 2024-04-23T19:03:07.562 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.9940000000000003e-06 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925228+0000", 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021209332000000001 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925542+0000", 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000314221 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 0", 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.925754+0000", 2024-04-23T19:03:07.563 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000212189 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.926961+0000", 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00120666 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931020+0000", 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040595789999999998 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.564 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931113+0000", 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.2065999999999996e-05 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:00:03.931184+0000", 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.1376000000000002e-05 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:2709 3.3f 3:fde6c7b5:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.10__shadow_.3hOouKdhppKnePAdB3VlELxEMb7M7i4_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:03:07.565 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 54.940636693999998, 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028386742, 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 2709 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:03:07.566 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609792+0000", 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.609794+0000", 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9970000000000001e-06 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615862+0000", 2024-04-23T19:03:07.567 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.006067579 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615893+0000", 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1402000000000002e-05 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615913+0000", 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9916999999999999e-05 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.615995+0000", 2024-04-23T19:03:07.568 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.1668000000000005e-05 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616115+0000", 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000120543 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.616224+0000", 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000108495 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.637884+0000", 2024-04-23T19:03:07.569 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021659826 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638045+0000", 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016110199999999999 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638111+0000", 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.6338000000000001e-05 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:12.638179+0000", 2024-04-23T19:03:07.570 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.7874999999999996e-05 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3287 3.37 3:ef4edada:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_302:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 31.230759343999999, 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034068071999999998, 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.571 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3287 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319670+0000", 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.572 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.319673+0000", 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.1329999999999999e-06 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324894+0000", 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052214999999999996 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324940+0000", 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5853000000000003e-05 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.573 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.324960+0000", 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0182000000000001e-05 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325156+0000", 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000195878 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325587+0000", 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000430455 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.574 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.325994+0000", 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00040785799999999998 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353421+0000", 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027426841 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353479+0000", 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.7908999999999997e-05 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.575 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353578+0000", 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.8381999999999994e-05 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.353738+0000", 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016008099999999999 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3288 3.37 3:ee2739c3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_303:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 31.214962905, 2024-04-23T19:03:07.576 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.029560090000000001, 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3288 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.577 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335466+0000", 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.335469+0000", 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.416e-06 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342301+0000", 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00683207 2024-04-23T19:03:07.578 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342341+0000", 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0009999999999998e-05 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342368+0000", 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6913000000000001e-05 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.342655+0000", 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028621000000000001 2024-04-23T19:03:07.579 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343067+0000", 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041280100000000002 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.343543+0000", 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00047600700000000003 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.355012+0000", 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011468734 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.580 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364851+0000", 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0098389810000000001 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.364953+0000", 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010220199999999999 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:36.365026+0000", 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.2745999999999998e-05 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.581 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3351 3.f 3:f25cd12a:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_366:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.414485917, 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.032978032999999997, 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3351 2024-04-23T19:03:07.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135943+0000", 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.583 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.135946+0000", 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.309e-06 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141166+0000", 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0052200889999999998 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141208+0000", 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.1329999999999999e-05 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.584 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141228+0000", 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0499000000000001e-05 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141374+0000", 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145422 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141654+0000", 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00028040999999999998 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.585 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.141901+0000", 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024735099999999998 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.161851+0000", 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.019949643 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168711+0000", 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0068600629999999996 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.586 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168810+0000", 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.9347999999999998e-05 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.168921+0000", 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000110569 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3358 3.f 3:f3cab0c8:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.337151653999999, 2024-04-23T19:03:07.587 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026129927000000001, 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3358 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.588 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213277+0000", 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.213281+0000", 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5329999999999999e-06 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217537+0000", 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004256124 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.589 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217590+0000", 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.3139000000000001e-05 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217615+0000", 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5466e-05 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.217791+0000", 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017528199999999999 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.590 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218180+0000", 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038883899999999998 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.218419+0000", 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023947000000000001 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.235595+0000", 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017176365999999998 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.591 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239185+0000", 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0035899650000000001 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239331+0000", 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000145084 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.239407+0000", 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 7.6658999999999999e-05 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.592 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3359 3.3f 3:fec9f01f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.326589425000002, 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028738053999999999, 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3359 2024-04-23T19:03:07.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223839+0000", 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.223844+0000", 2024-04-23T19:03:07.594 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.9799999999999998e-06 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229191+0000", 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0053469520000000003 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229217+0000", 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.5873000000000001e-05 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229231+0000", 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.3246e-05 2024-04-23T19:03:07.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229350+0000", 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000119975 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229684+0000", 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033336999999999999 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.229901+0000", 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021713799999999999 2024-04-23T19:03:07.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.241113+0000", 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011212111 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252378+0000", 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011264918000000001 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252475+0000", 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.6818999999999996e-05 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.597 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.252578+0000", 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000102672 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3361 3.d 3:b10ac292:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.307394438999999, 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031560294000000003, 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.598 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3361 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243034+0000", 2024-04-23T19:03:07.599 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.243038+0000", 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2200000000000001e-06 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247434+0000", 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043965050000000002 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247482+0000", 2024-04-23T19:03:07.600 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.7839000000000001e-05 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247501+0000", 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.9219999999999999e-05 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.247709+0000", 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000207431 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248155+0000", 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00044614500000000001 2024-04-23T19:03:07.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.248622+0000", 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046713800000000003 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.273993+0000", 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.025371365999999999 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274330+0000", 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00033670599999999998 2024-04-23T19:03:07.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274483+0000", 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015333100000000001 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.274595+0000", 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000111393 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.603 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3367 3.d 3:b3a04ccc:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.11__shadow_.H8osZ52kFreC51ub0ksQ6FZogBn4aBP_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 30.238597774999999, 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.037201347000000003, 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3367 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.604 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311831+0000", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.311834+0000", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.869e-06 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315933+0000", 2024-04-23T19:03:07.605 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0040989920000000001 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315975+0000", 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2299999999999998e-05 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.315994+0000", 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8567e-05 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316174+0000", 2024-04-23T19:03:07.606 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000180271 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op must wait for map", 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.316185+0000", 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.1163e-05 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323166+0000", 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0069803240000000004 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323380+0000", 2024-04-23T19:03:07.607 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000214708 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.323594+0000", 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021368099999999999 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.335136+0000", 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.011541635 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348704+0000", 2024-04-23T19:03:07.608 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013568334 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.348896+0000", 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00019216099999999999 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:37.349032+0000", 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013634199999999999 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.609 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3697 3.e 3:722502ec:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.702009+0000", 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.8484198680000006, 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033822061, 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3697 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.610 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.702009+0000", 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.702009+0000", 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.702012+0000", 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2760000000000001e-06 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.611 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.706236+0000", 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004223653 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.706270+0000", 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.3762e-05 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.706300+0000", 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.008e-05 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.612 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.706448+0000", 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014776599999999999 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.706696+0000", 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024852799999999998 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.706950+0000", 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025342000000000002 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.613 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.728014+0000", 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021064658999999999 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735507+0000", 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0074931920000000001 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735676+0000", 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016872600000000001 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.614 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.735831+0000", 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015499900000000001 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3701 3.e 3:7346750b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.739333+0000", 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.8110960469999995, 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026118810999999999, 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.615 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3701 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.739333+0000", 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.616 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.739333+0000", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.739337+0000", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.177e-06 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.743729+0000", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0043921669999999998 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.617 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.743766+0000", 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6313000000000003e-05 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.743786+0000", 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0939999999999999e-05 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.743900+0000", 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000113807 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.618 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.744151+0000", 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00025042400000000001 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.744378+0000", 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00022693999999999999 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.761771+0000", 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.017393562000000001 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.619 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.765043+0000", 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0032722480000000002 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.765289+0000", 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00024587699999999998 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.765452+0000", 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000162356 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.620 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3703 3.2d 3:b50e67cb:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:58.759472+0000", 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 8.7909568779999994, 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028826151000000001, 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3703 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.621 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.759472+0000", 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.759472+0000", 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.759476+0000", 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.0099999999999997e-06 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.622 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.763708+0000", 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0042315080000000001 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.763745+0000", 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7358999999999999e-05 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.763769+0000", 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.3802999999999999e-05 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.623 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.763929+0000", 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016061 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.764445+0000", 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00051584000000000005 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 2", 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.764873+0000", 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00042834600000000002 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.624 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.778256+0000", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.013382131 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.788034+0000", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0097782649999999995 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.788188+0000", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015445699999999999 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.625 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:58.788298+0000", 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010982200000000001 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3801 3.37 3:ec053a76:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.700191+0000", 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.8502377179999998, 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.028609823, 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.626 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3801 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.700191+0000", 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.700191+0000", 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.627 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.700195+0000", 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.5700000000000001e-06 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.704442+0000", 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.004247682 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.704480+0000", 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7079000000000002e-05 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.628 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.704498+0000", 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.8172000000000002e-05 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.704640+0000", 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000141874 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.704919+0000", 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00027979900000000001 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.629 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 5", 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.705179+0000", 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026003400000000002 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.728385+0000", 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.023205819999999999 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.728502+0000", 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000117173 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.630 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.728669+0000", 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00016669300000000001 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.728801+0000", 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000131927 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3822 3.11 3:8b2e1090:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.631 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.920212+0000", 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.6302172129999999, 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.026370151000000001, 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3822 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.920212+0000", 2024-04-23T19:03:07.632 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.920212+0000", 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.920215+0000", 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6940000000000001e-06 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.925366+0000", 2024-04-23T19:03:07.633 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0051502850000000001 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.925412+0000", 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.6075000000000002e-05 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.925439+0000", 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7416e-05 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.925618+0000", 2024-04-23T19:03:07.634 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017871900000000001 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.925931+0000", 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00031288900000000001 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.926315+0000", 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038419700000000002 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.944543+0000", 2024-04-23T19:03:07.635 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.018228102999999999 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.946416+0000", 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00187247 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.946513+0000", 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 9.7471000000000002e-05 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.946582+0000", 2024-04-23T19:03:07.636 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.8831999999999994e-05 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3823 3.15 3:a83eb27f:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:02:59.929734+0000", 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.620695145, 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.033275217000000003, 2024-04-23T19:03:07.637 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3823 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.929734+0000", 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.638 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.929734+0000", 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.929738+0000", 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.5700000000000003e-06 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.934232+0000", 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044937220000000003 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.639 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.934271+0000", 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.8968999999999999e-05 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.934293+0000", 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.1849e-05 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.934464+0000", 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000171509 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.640 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.934725+0000", 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00026066799999999998 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 3", 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.934956+0000", 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00023099399999999999 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.950090+0000", 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.015134406 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.641 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.962754+0000", 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012663873000000001 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.962903+0000", 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00014915600000000001 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:02:59.963009+0000", 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00010550100000000001 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.642 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_repop(client.4461.0:3867 3.2a e96/20 3:567fb49b:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_211:head v 96'22, mlcod=96'20)", 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.389646+0000", 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.1607832919999996, 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.027172423000000001, 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.389646+0000", 2024-04-23T19:03:07.643 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.389646+0000", 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.389648+0000", 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.6230000000000001e-06 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.395226+0000", 2024-04-23T19:03:07.644 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0055776080000000004 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.395286+0000", 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 6.0328999999999998e-05 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.395315+0000", 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8436e-05 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.395519+0000", 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00020403500000000001 2024-04-23T19:03:07.645 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.395562+0000", 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.2985999999999998e-05 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.416695+0000", 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.021133272000000002 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.416818+0000", 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000123134 2024-04-23T19:03:07.646 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:3872 3.e 3:735eed22:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:00.429551+0000", 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 7.1208774349999997, 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.034815631, 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.647 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 3872 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.429551+0000", 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.429551+0000", 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.648 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.429579+0000", 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.7106000000000001e-05 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.437858+0000", 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0082791440000000004 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.437902+0000", 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 4.4619000000000001e-05 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.649 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.437923+0000", 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.0463e-05 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.438138+0000", 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00021557799999999999 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.438527+0000", 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00038896100000000001 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.650 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.438944+0000", 2024-04-23T19:03:07.651 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041714299999999997 2024-04-23T19:03:07.651 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.651 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.651 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.651 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.449361+0000", 2024-04-23T19:03:07.653 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.010416450000000001 2024-04-23T19:03:07.653 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.464107+0000", 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014746547 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.464231+0000", 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00012374700000000001 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:00.464367+0000", 2024-04-23T19:03:07.654 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00013587300000000001 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4105 3.3f 3:ffa6f840:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.615795+0000", 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.934633549, 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.032467231999999999, 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.655 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4105 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.615795+0000", 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.615795+0000", 2024-04-23T19:03:07.656 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.615799+0000", 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.613e-06 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.620204+0000", 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0044054300000000001 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.620256+0000", 2024-04-23T19:03:07.657 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 5.2076000000000001e-05 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.620285+0000", 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 2.8459e-05 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.620464+0000", 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00017907200000000001 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.620879+0000", 2024-04-23T19:03:07.658 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00041539399999999997 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 6", 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.621343+0000", 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00046345300000000001 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.633409+0000", 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.012066119 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.648081+0000", 2024-04-23T19:03:07.659 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.014671571 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.648182+0000", 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000101883 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.648263+0000", 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 8.0161999999999996e-05 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.660 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "description": "osd_op(client.4461.0:4136 3.e 3:7106f9a3:::2fe9869b-25a1-4b09-be2c-4e9208a04c5d.4461.12__shadow_.ijClmcXyMPsXf2lkzip5BiWHZJjU2eK_480:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "initiated_at": "2024-04-23T19:03:03.940264+0000", 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "age": 3.61016504, 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.031482211000000003, 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "continuous": false, 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "type_data": { 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client_info": { 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client": "client.4461", 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "client_addr": "172.21.15.169:0/226671369", 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "tid": 4136 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "events": [ 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "initiated", 2024-04-23T19:03:07.661 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.940264+0000", 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "header_read", 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.940264+0000", 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "throttled", 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.940268+0000", 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.6689999999999999e-06 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "all_read", 2024-04-23T19:03:07.662 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.946131+0000", 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.0058637100000000003 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "dispatched", 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.946164+0000", 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.2648999999999999e-05 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "queued_for_pg", 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.946180+0000", 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 1.6209999999999999e-05 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "reached_pg", 2024-04-23T19:03:07.663 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.946334+0000", 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015384700000000001 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "started", 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.946573+0000", 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000239144 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "waiting for subops from 4", 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.946838+0000", 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.000265097 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "sub_op_commit_rec", 2024-04-23T19:03:07.664 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.971375+0000", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.024537010000000001 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "op_commit", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.971413+0000", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 3.7775999999999999e-05 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "commit_sent", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.971565+0000", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00015214300000000001 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: { 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "event": "done", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "time": "2024-04-23T19:03:03.971746+0000", 2024-04-23T19:03:07.665 INFO:teuthology.orchestra.run.smithi193.stdout: "duration": 0.00018095599999999999 2024-04-23T19:03:07.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.666 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.666 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-04-23T19:03:07.666 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-23T19:03:07.666 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-23T19:03:08.169 INFO:teuthology.orchestra.run.smithi169.stderr:nodeep-scrub is unset 2024-04-23T19:03:27.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-23T19:03:27.529 INFO:teuthology.orchestra.run.smithi169.stdout:mon.a: {} 2024-04-23T19:03:27.529 INFO:teuthology.orchestra.run.smithi169.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T19:03:27.542 INFO:teuthology.orchestra.run.smithi169.stdout:mon.b: {} 2024-04-23T19:03:27.542 INFO:teuthology.orchestra.run.smithi169.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T19:03:27.553 INFO:teuthology.orchestra.run.smithi169.stdout:mon.c: {} 2024-04-23T19:03:27.553 INFO:teuthology.orchestra.run.smithi169.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T19:03:27.568 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-23T19:03:28.210 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.0 to 1 (10000) 2024-04-23T19:03:28.235 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-23T19:03:29.224 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-23T19:03:29.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-23T19:03:30.250 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.1 to 1 (10000) 2024-04-23T19:03:30.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-23T19:03:31.253 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-23T19:03:31.284 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-23T19:03:32.265 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.2 to 1 (10000) 2024-04-23T19:03:32.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-23T19:03:33.267 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-23T19:03:33.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-23T19:03:34.279 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.3 to 1 (10000) 2024-04-23T19:03:34.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-23T19:03:35.298 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-23T19:03:35.324 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-23T19:03:36.301 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.4 to 1 (10000) 2024-04-23T19:03:36.329 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-23T19:03:37.325 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-23T19:03:37.351 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-23T19:03:38.334 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.5 to 1 (10000) 2024-04-23T19:03:38.363 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-23T19:03:39.346 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-23T19:03:39.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-23T19:03:40.346 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.6 to 1 (10000) 2024-04-23T19:03:40.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-23T19:03:41.349 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-23T19:03:41.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-23T19:03:42.363 INFO:teuthology.orchestra.run.smithi169.stderr:reweighted osd.7 to 1 (10000) 2024-04-23T19:03:42.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-23T19:03:43.381 INFO:teuthology.orchestra.run.smithi169.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-23T19:03:43.412 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-23T19:03:43.412 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-23T19:03:43.412 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-23T19:03:43.412 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-23T19:03:43.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T19:03:43.413 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T19:03:43.713 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:43.713 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":116,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T19:03:43.375141+0000","last_up_change":"2024-04-23T19:00:00.934154+0000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T19:00:01.944184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T19:00:08.051772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-23T19:00:13.945613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-23T19:00:15.582491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-23T19:00:17.526522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-23T19:00:19.440782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-23T19:00:21.330605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-23T19:00:23.465890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6809","nonce":2480149234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6811","nonce":2480149234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6815","nonce":2480149234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6813","nonce":2480149234}]},"public_addr":"172.21.15.169:6809/2480149234","cluster_addr":"172.21.15.169:6811/2480149234","heartbeat_back_addr":"172.21.15.169:6815/2480149234","heartbeat_front_addr":"172.21.15.169:6813/2480149234","state":["exists","up"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6818","nonce":2143529353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6823","nonce":2143529353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6831","nonce":2143529353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6825","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6828","nonce":2143529353}]},"public_addr":"172.21.15.169:6818/2143529353","cluster_addr":"172.21.15.169:6823/2143529353","heartbeat_back_addr":"172.21.15.169:6831/2143529353","heartbeat_front_addr":"172.21.15.169:6828/2143529353","state":["exists","up"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6819","nonce":2796580003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6822","nonce":2796580003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6827","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6829","nonce":2796580003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6826","nonce":2796580003}]},"public_addr":"172.21.15.169:6819/2796580003","cluster_addr":"172.21.15.169:6822/2796580003","heartbeat_back_addr":"172.21.15.169:6829/2796580003","heartbeat_front_addr":"172.21.15.169:6826/2796580003","state":["exists","up"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6801","nonce":3764305788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6803","nonce":3764305788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6807","nonce":3764305788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6805","nonce":3764305788}]},"public_addr":"172.21.15.169:6801/3764305788","cluster_addr":"172.21.15.169:6803/3764305788","heartbeat_back_addr":"172.21.15.169:6807/3764305788","heartbeat_front_addr":"172.21.15.169:6805/3764305788","state":["exists","up"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6801","nonce":519231085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6803","nonce":519231085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6812","nonce":519231085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6805","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6807","nonce":519231085}]},"public_addr":"172.21.15.193:6801/519231085","cluster_addr":"172.21.15.193:6803/519231085","heartbeat_back_addr":"172.21.15.193:6812/519231085","heartbeat_front_addr":"172.21.15.193:6807/519231085","state":["exists","up"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6818","nonce":3321647745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6821","nonce":3321647745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6825","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6827","nonce":3321647745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6824","nonce":3321647745}]},"public_addr":"172.21.15.193:6818/3321647745","cluster_addr":"172.21.15.193:6821/3321647745","heartbeat_back_addr":"172.21.15.193:6827/3321647745","heartbeat_front_addr":"172.21.15.193:6824/3321647745","state":["exists","up"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6806","nonce":46529429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6809","nonce":46529429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6815","nonce":46529429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6811","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6813","nonce":46529429}]},"public_addr":"172.21.15.193:6806/46529429","cluster_addr":"172.21.15.193:6809/46529429","heartbeat_back_addr":"172.21.15.193:6815/46529429","heartbeat_front_addr":"172.21.15.193:6813/46529429","state":["exists","up"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6817","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6820","nonce":1901200038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6823","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6826","nonce":1901200038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6831","nonce":1901200038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6829","nonce":1901200038}]},"public_addr":"172.21.15.193:6820/1901200038","cluster_addr":"172.21.15.193:6826/1901200038","heartbeat_back_addr":"172.21.15.193:6831/1901200038","heartbeat_front_addr":"172.21.15.193:6829/1901200038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.665743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.556828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.555318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.632689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.791617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811905+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.825013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:03:43.732 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T19:03:43.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T19:03:44.033 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:44.034 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":116,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T19:03:43.375141+0000","last_up_change":"2024-04-23T19:00:00.934154+0000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T19:00:01.944184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T19:00:08.051772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-23T19:00:13.945613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-23T19:00:15.582491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-23T19:00:17.526522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-23T19:00:19.440782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-23T19:00:21.330605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-23T19:00:23.465890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6809","nonce":2480149234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6811","nonce":2480149234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6815","nonce":2480149234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6813","nonce":2480149234}]},"public_addr":"172.21.15.169:6809/2480149234","cluster_addr":"172.21.15.169:6811/2480149234","heartbeat_back_addr":"172.21.15.169:6815/2480149234","heartbeat_front_addr":"172.21.15.169:6813/2480149234","state":["exists","up"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6818","nonce":2143529353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6823","nonce":2143529353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6831","nonce":2143529353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6825","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6828","nonce":2143529353}]},"public_addr":"172.21.15.169:6818/2143529353","cluster_addr":"172.21.15.169:6823/2143529353","heartbeat_back_addr":"172.21.15.169:6831/2143529353","heartbeat_front_addr":"172.21.15.169:6828/2143529353","state":["exists","up"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6819","nonce":2796580003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6822","nonce":2796580003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6827","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6829","nonce":2796580003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6826","nonce":2796580003}]},"public_addr":"172.21.15.169:6819/2796580003","cluster_addr":"172.21.15.169:6822/2796580003","heartbeat_back_addr":"172.21.15.169:6829/2796580003","heartbeat_front_addr":"172.21.15.169:6826/2796580003","state":["exists","up"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6801","nonce":3764305788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6803","nonce":3764305788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6807","nonce":3764305788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6805","nonce":3764305788}]},"public_addr":"172.21.15.169:6801/3764305788","cluster_addr":"172.21.15.169:6803/3764305788","heartbeat_back_addr":"172.21.15.169:6807/3764305788","heartbeat_front_addr":"172.21.15.169:6805/3764305788","state":["exists","up"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6801","nonce":519231085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6803","nonce":519231085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6812","nonce":519231085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6805","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6807","nonce":519231085}]},"public_addr":"172.21.15.193:6801/519231085","cluster_addr":"172.21.15.193:6803/519231085","heartbeat_back_addr":"172.21.15.193:6812/519231085","heartbeat_front_addr":"172.21.15.193:6807/519231085","state":["exists","up"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6818","nonce":3321647745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6821","nonce":3321647745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6825","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6827","nonce":3321647745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6824","nonce":3321647745}]},"public_addr":"172.21.15.193:6818/3321647745","cluster_addr":"172.21.15.193:6821/3321647745","heartbeat_back_addr":"172.21.15.193:6827/3321647745","heartbeat_front_addr":"172.21.15.193:6824/3321647745","state":["exists","up"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6806","nonce":46529429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6809","nonce":46529429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6815","nonce":46529429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6811","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6813","nonce":46529429}]},"public_addr":"172.21.15.193:6806/46529429","cluster_addr":"172.21.15.193:6809/46529429","heartbeat_back_addr":"172.21.15.193:6815/46529429","heartbeat_front_addr":"172.21.15.193:6813/46529429","state":["exists","up"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6817","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6820","nonce":1901200038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6823","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6826","nonce":1901200038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6831","nonce":1901200038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6829","nonce":1901200038}]},"public_addr":"172.21.15.193:6820/1901200038","cluster_addr":"172.21.15.193:6826/1901200038","heartbeat_back_addr":"172.21.15.193:6831/1901200038","heartbeat_front_addr":"172.21.15.193:6829/1901200038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.665743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.556828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.555318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.632689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.791617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811905+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.825013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:03:44.053 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T19:03:44.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T19:03:44.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T19:03:44.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T19:03:44.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T19:03:44.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T19:03:44.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T19:03:44.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T19:03:44.311 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:44.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T19:03:44.324 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:44.325 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T19:03:44.332 INFO:teuthology.orchestra.run.smithi169.stdout:55834574897 2024-04-23T19:03:44.333 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T19:03:44.342 INFO:teuthology.orchestra.run.smithi169.stdout:55834574898 2024-04-23T19:03:44.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T19:03:44.344 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:44.345 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T19:03:44.346 INFO:teuthology.orchestra.run.smithi169.stdout:55834574897 2024-04-23T19:03:44.347 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T19:03:44.349 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:44.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T19:03:44.350 INFO:teuthology.orchestra.run.smithi169.stdout:55834574898 2024-04-23T19:03:44.352 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T19:03:44.816 INFO:teuthology.orchestra.run.smithi169.stdout:55834574895 2024-04-23T19:03:44.830 INFO:teuthology.orchestra.run.smithi169.stdout:55834574895 2024-04-23T19:03:44.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574895 for osd.6 2024-04-23T19:03:44.845 INFO:teuthology.orchestra.run.smithi169.stdout:55834574895 2024-04-23T19:03:44.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574895 for osd.2 2024-04-23T19:03:44.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574895 for osd.5 2024-04-23T19:03:44.877 INFO:teuthology.orchestra.run.smithi169.stdout:55834574897 2024-04-23T19:03:44.888 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:44.891 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:44.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574897 for osd.3 2024-04-23T19:03:44.899 INFO:teuthology.orchestra.run.smithi169.stdout:55834574897 2024-04-23T19:03:44.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574897 got 55834574896 for osd.7 2024-04-23T19:03:44.915 INFO:teuthology.orchestra.run.smithi169.stdout:55834574895 2024-04-23T19:03:44.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574897 for osd.1 2024-04-23T19:03:44.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574897 got 55834574896 for osd.4 2024-04-23T19:03:44.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574895 for osd.0 2024-04-23T19:03:45.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T19:03:45.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T19:03:45.875 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T19:03:45.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T19:03:45.915 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T19:03:45.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T19:03:45.923 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T19:03:45.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T19:03:46.351 INFO:teuthology.orchestra.run.smithi169.stdout:55834574895 2024-04-23T19:03:46.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574895 for osd.6 2024-04-23T19:03:46.407 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:46.407 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:46.430 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:46.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574896 for osd.5 2024-04-23T19:03:46.436 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:46.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574896 for osd.2 2024-04-23T19:03:46.436 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:46.439 INFO:teuthology.orchestra.run.smithi169.stdout:55834574898 2024-04-23T19:03:46.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574898 for osd.1 2024-04-23T19:03:46.459 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:46.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574896 for osd.0 2024-04-23T19:03:46.460 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:46.464 INFO:teuthology.orchestra.run.smithi169.stdout:55834574897 2024-04-23T19:03:46.464 INFO:teuthology.orchestra.run.smithi169.stdout:55834574898 2024-04-23T19:03:46.478 INFO:teuthology.orchestra.run.smithi169.stdout:55834574897 2024-04-23T19:03:46.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574898 for osd.3 2024-04-23T19:03:46.486 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:46.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574897 got 55834574897 for osd.4 2024-04-23T19:03:46.490 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:46.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574897 got 55834574897 for osd.7 2024-04-23T19:03:46.498 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:47.381 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T19:03:47.674 INFO:teuthology.orchestra.run.smithi169.stdout:55834574896 2024-04-23T19:03:47.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574896 got 55834574896 for osd.6 2024-04-23T19:03:47.692 DEBUG:teuthology.parallel:result is None 2024-04-23T19:03:47.692 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-23T19:03:47.693 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:03:48.010 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:48.017 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:03:48.028 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-04-23T19:03:45.965772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823909,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3286,"num_read_kb":2969,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3890,"ondisk_log_size":3890,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12579344,"kb_used_data":12317384,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":742395376,"statfs":{"total":773094113280,"available":760212865024,"internally_reserved":0,"allocated":12613001216,"data_stored":12608065450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.613906"},"pg_stats":[{"pgid":"3.3f","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114847+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:03:44.114847+0000","last_peered":"2024-04-23T19:03:44.114847+0000","last_clean":"2024-04-23T19:03:44.114847+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:03:44.114847+0000","last_undegraded":"2024-04-23T19:03:44.114847+0000","last_fullsized":"2024-04-23T19:03:44.114847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387932+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:03:43.387932+0000","last_peered":"2024-04-23T19:03:43.387932+0000","last_clean":"2024-04-23T19:03:43.387932+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:03:43.387932+0000","last_undegraded":"2024-04-23T19:03:43.387932+0000","last_fullsized":"2024-04-23T19:03:43.387932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"97'24","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115512+0000","last_change":"2024-04-23T19:03:32.293577+0000","last_active":"2024-04-23T19:03:44.115512+0000","last_peered":"2024-04-23T19:03:44.115512+0000","last_clean":"2024-04-23T19:03:44.115512+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:03:44.115512+0000","last_undegraded":"2024-04-23T19:03:44.115512+0000","last_fullsized":"2024-04-23T19:03:44.115512+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:33.579201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113300+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:03:44.113300+0000","last_peered":"2024-04-23T19:03:44.113300+0000","last_clean":"2024-04-23T19:03:44.113300+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:03:44.113300+0000","last_undegraded":"2024-04-23T19:03:44.113300+0000","last_fullsized":"2024-04-23T19:03:44.113300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'29","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114019+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:44.114019+0000","last_peered":"2024-04-23T19:03:44.114019+0000","last_clean":"2024-04-23T19:03:44.114019+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:44.114019+0000","last_undegraded":"2024-04-23T19:03:44.114019+0000","last_fullsized":"2024-04-23T19:03:44.114019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910402+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:03:43.910402+0000","last_peered":"2024-04-23T19:03:43.910402+0000","last_clean":"2024-04-23T19:03:43.910402+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:03:43.910402+0000","last_undegraded":"2024-04-23T19:03:43.910402+0000","last_fullsized":"2024-04-23T19:03:43.910402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389189+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:03:43.389189+0000","last_peered":"2024-04-23T19:03:43.389189+0000","last_clean":"2024-04-23T19:03:43.389189+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:03:43.389189+0000","last_undegraded":"2024-04-23T19:03:43.389189+0000","last_fullsized":"2024-04-23T19:03:43.389189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113499+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113499+0000","last_peered":"2024-04-23T19:03:44.113499+0000","last_clean":"2024-04-23T19:03:44.113499+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113499+0000","last_undegraded":"2024-04-23T19:03:44.113499+0000","last_fullsized":"2024-04-23T19:03:44.113499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114187+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:44.114187+0000","last_peered":"2024-04-23T19:03:44.114187+0000","last_clean":"2024-04-23T19:03:44.114187+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:44.114187+0000","last_undegraded":"2024-04-23T19:03:44.114187+0000","last_fullsized":"2024-04-23T19:03:44.114187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708709+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:03:43.708709+0000","last_peered":"2024-04-23T19:03:43.708709+0000","last_clean":"2024-04-23T19:03:43.708709+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:03:43.708709+0000","last_undegraded":"2024-04-23T19:03:43.708709+0000","last_fullsized":"2024-04-23T19:03:43.708709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"97'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388451+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:03:43.388451+0000","last_peered":"2024-04-23T19:03:43.388451+0000","last_clean":"2024-04-23T19:03:43.388451+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:03:43.388451+0000","last_undegraded":"2024-04-23T19:03:43.388451+0000","last_fullsized":"2024-04-23T19:03:43.388451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910574+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:03:43.910574+0000","last_peered":"2024-04-23T19:03:43.910574+0000","last_clean":"2024-04-23T19:03:43.910574+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:03:43.910574+0000","last_undegraded":"2024-04-23T19:03:43.910574+0000","last_fullsized":"2024-04-23T19:03:43.910574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"97'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113605+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:44.113605+0000","last_peered":"2024-04-23T19:03:44.113605+0000","last_clean":"2024-04-23T19:03:44.113605+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:44.113605+0000","last_undegraded":"2024-04-23T19:03:44.113605+0000","last_fullsized":"2024-04-23T19:03:44.113605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389716+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:03:43.389716+0000","last_peered":"2024-04-23T19:03:43.389716+0000","last_clean":"2024-04-23T19:03:43.389716+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:03:43.389716+0000","last_undegraded":"2024-04-23T19:03:43.389716+0000","last_fullsized":"2024-04-23T19:03:43.389716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391449+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:43.391449+0000","last_peered":"2024-04-23T19:03:43.391449+0000","last_clean":"2024-04-23T19:03:43.391449+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:43.391449+0000","last_undegraded":"2024-04-23T19:03:43.391449+0000","last_fullsized":"2024-04-23T19:03:43.391449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394333+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:03:43.394333+0000","last_peered":"2024-04-23T19:03:43.394333+0000","last_clean":"2024-04-23T19:03:43.394333+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:03:43.394333+0000","last_undegraded":"2024-04-23T19:03:43.394333+0000","last_fullsized":"2024-04-23T19:03:43.394333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909061+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909061+0000","last_peered":"2024-04-23T19:03:43.909061+0000","last_clean":"2024-04-23T19:03:43.909061+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909061+0000","last_undegraded":"2024-04-23T19:03:43.909061+0000","last_fullsized":"2024-04-23T19:03:43.909061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"96'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114901+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:03:44.114901+0000","last_peered":"2024-04-23T19:03:44.114901+0000","last_clean":"2024-04-23T19:03:44.114901+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:03:44.114901+0000","last_undegraded":"2024-04-23T19:03:44.114901+0000","last_fullsized":"2024-04-23T19:03:44.114901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113766+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:03:44.113766+0000","last_peered":"2024-04-23T19:03:44.113766+0000","last_clean":"2024-04-23T19:03:44.113766+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:03:44.113766+0000","last_undegraded":"2024-04-23T19:03:44.113766+0000","last_fullsized":"2024-04-23T19:03:44.113766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709366+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:03:43.709366+0000","last_peered":"2024-04-23T19:03:43.709366+0000","last_clean":"2024-04-23T19:03:43.709366+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:03:43.709366+0000","last_undegraded":"2024-04-23T19:03:43.709366+0000","last_fullsized":"2024-04-23T19:03:43.709366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388767+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:03:43.388767+0000","last_peered":"2024-04-23T19:03:43.388767+0000","last_clean":"2024-04-23T19:03:43.388767+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:03:43.388767+0000","last_undegraded":"2024-04-23T19:03:43.388767+0000","last_fullsized":"2024-04-23T19:03:43.388767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709535+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:03:43.709535+0000","last_peered":"2024-04-23T19:03:43.709535+0000","last_clean":"2024-04-23T19:03:43.709535+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:03:43.709535+0000","last_undegraded":"2024-04-23T19:03:43.709535+0000","last_fullsized":"2024-04-23T19:03:43.709535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394020+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:03:43.394020+0000","last_peered":"2024-04-23T19:03:43.394020+0000","last_clean":"2024-04-23T19:03:43.394020+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:03:43.394020+0000","last_undegraded":"2024-04-23T19:03:43.394020+0000","last_fullsized":"2024-04-23T19:03:43.394020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"97'16","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910749+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:43.910749+0000","last_peered":"2024-04-23T19:03:43.910749+0000","last_clean":"2024-04-23T19:03:43.910749+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:43.910749+0000","last_undegraded":"2024-04-23T19:03:43.910749+0000","last_fullsized":"2024-04-23T19:03:43.910749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393743+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:03:43.393743+0000","last_peered":"2024-04-23T19:03:43.393743+0000","last_clean":"2024-04-23T19:03:43.393743+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:03:43.393743+0000","last_undegraded":"2024-04-23T19:03:43.393743+0000","last_fullsized":"2024-04-23T19:03:43.393743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"97'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392095+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:43.392095+0000","last_peered":"2024-04-23T19:03:43.392095+0000","last_clean":"2024-04-23T19:03:43.392095+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:43.392095+0000","last_undegraded":"2024-04-23T19:03:43.392095+0000","last_fullsized":"2024-04-23T19:03:43.392095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910786+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:03:43.910786+0000","last_peered":"2024-04-23T19:03:43.910786+0000","last_clean":"2024-04-23T19:03:43.910786+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:03:43.910786+0000","last_undegraded":"2024-04-23T19:03:43.910786+0000","last_fullsized":"2024-04-23T19:03:43.910786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112591+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:44.112591+0000","last_peered":"2024-04-23T19:03:44.112591+0000","last_clean":"2024-04-23T19:03:44.112591+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:44.112591+0000","last_undegraded":"2024-04-23T19:03:44.112591+0000","last_fullsized":"2024-04-23T19:03:44.112591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908784+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908784+0000","last_peered":"2024-04-23T19:03:43.908784+0000","last_clean":"2024-04-23T19:03:43.908784+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908784+0000","last_undegraded":"2024-04-23T19:03:43.908784+0000","last_fullsized":"2024-04-23T19:03:43.908784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391510+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:03:43.391510+0000","last_peered":"2024-04-23T19:03:43.391510+0000","last_clean":"2024-04-23T19:03:43.391510+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:03:43.391510+0000","last_undegraded":"2024-04-23T19:03:43.391510+0000","last_fullsized":"2024-04-23T19:03:43.391510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'24","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393870+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:03:43.393870+0000","last_peered":"2024-04-23T19:03:43.393870+0000","last_clean":"2024-04-23T19:03:43.393870+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:03:43.393870+0000","last_undegraded":"2024-04-23T19:03:43.393870+0000","last_fullsized":"2024-04-23T19:03:43.393870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389567+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:03:43.389567+0000","last_peered":"2024-04-23T19:03:43.389567+0000","last_clean":"2024-04-23T19:03:43.389567+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:03:43.389567+0000","last_undegraded":"2024-04-23T19:03:43.389567+0000","last_fullsized":"2024-04-23T19:03:43.389567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'19","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113502+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:44.113502+0000","last_peered":"2024-04-23T19:03:44.113502+0000","last_clean":"2024-04-23T19:03:44.113502+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:44.113502+0000","last_undegraded":"2024-04-23T19:03:44.113502+0000","last_fullsized":"2024-04-23T19:03:44.113502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114445+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114445+0000","last_peered":"2024-04-23T19:03:44.114445+0000","last_clean":"2024-04-23T19:03:44.114445+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114445+0000","last_undegraded":"2024-04-23T19:03:44.114445+0000","last_fullsized":"2024-04-23T19:03:44.114445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387854+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.387854+0000","last_peered":"2024-04-23T19:03:43.387854+0000","last_clean":"2024-04-23T19:03:43.387854+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.387854+0000","last_undegraded":"2024-04-23T19:03:43.387854+0000","last_fullsized":"2024-04-23T19:03:43.387854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390204+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:03:43.390204+0000","last_peered":"2024-04-23T19:03:43.390204+0000","last_clean":"2024-04-23T19:03:43.390204+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:03:43.390204+0000","last_undegraded":"2024-04-23T19:03:43.390204+0000","last_fullsized":"2024-04-23T19:03:43.390204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"97'31","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112702+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:44.112702+0000","last_peered":"2024-04-23T19:03:44.112702+0000","last_clean":"2024-04-23T19:03:44.112702+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:44.112702+0000","last_undegraded":"2024-04-23T19:03:44.112702+0000","last_fullsized":"2024-04-23T19:03:44.112702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391268+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391268+0000","last_peered":"2024-04-23T19:03:43.391268+0000","last_clean":"2024-04-23T19:03:43.391268+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391268+0000","last_undegraded":"2024-04-23T19:03:43.391268+0000","last_fullsized":"2024-04-23T19:03:43.391268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911442+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:03:43.911442+0000","last_peered":"2024-04-23T19:03:43.911442+0000","last_clean":"2024-04-23T19:03:43.911442+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:03:43.911442+0000","last_undegraded":"2024-04-23T19:03:43.911442+0000","last_fullsized":"2024-04-23T19:03:43.911442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910291+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910291+0000","last_peered":"2024-04-23T19:03:43.910291+0000","last_clean":"2024-04-23T19:03:43.910291+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910291+0000","last_undegraded":"2024-04-23T19:03:43.910291+0000","last_fullsized":"2024-04-23T19:03:43.910291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112392+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:03:44.112392+0000","last_peered":"2024-04-23T19:03:44.112392+0000","last_clean":"2024-04-23T19:03:44.112392+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:03:44.112392+0000","last_undegraded":"2024-04-23T19:03:44.112392+0000","last_fullsized":"2024-04-23T19:03:44.112392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114249+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:03:44.114249+0000","last_peered":"2024-04-23T19:03:44.114249+0000","last_clean":"2024-04-23T19:03:44.114249+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:03:44.114249+0000","last_undegraded":"2024-04-23T19:03:44.114249+0000","last_fullsized":"2024-04-23T19:03:44.114249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113863+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:44.113863+0000","last_peered":"2024-04-23T19:03:44.113863+0000","last_clean":"2024-04-23T19:03:44.113863+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:44.113863+0000","last_undegraded":"2024-04-23T19:03:44.113863+0000","last_fullsized":"2024-04-23T19:03:44.113863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393525+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:03:43.393525+0000","last_peered":"2024-04-23T19:03:43.393525+0000","last_clean":"2024-04-23T19:03:43.393525+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:03:43.393525+0000","last_undegraded":"2024-04-23T19:03:43.393525+0000","last_fullsized":"2024-04-23T19:03:43.393525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393562+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:03:43.393562+0000","last_peered":"2024-04-23T19:03:43.393562+0000","last_clean":"2024-04-23T19:03:43.393562+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:03:43.393562+0000","last_undegraded":"2024-04-23T19:03:43.393562+0000","last_fullsized":"2024-04-23T19:03:43.393562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"98'134","reported_seq":357,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114101+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:44.114101+0000","last_peered":"2024-04-23T19:03:44.114101+0000","last_clean":"2024-04-23T19:03:44.114101+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:44.114101+0000","last_undegraded":"2024-04-23T19:03:44.114101+0000","last_fullsized":"2024-04-23T19:03:44.114101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909665+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909665+0000","last_peered":"2024-04-23T19:03:43.909665+0000","last_clean":"2024-04-23T19:03:43.909665+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909665+0000","last_undegraded":"2024-04-23T19:03:43.909665+0000","last_fullsized":"2024-04-23T19:03:43.909665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393124+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:03:43.393124+0000","last_peered":"2024-04-23T19:03:43.393124+0000","last_clean":"2024-04-23T19:03:43.393124+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:03:43.393124+0000","last_undegraded":"2024-04-23T19:03:43.393124+0000","last_fullsized":"2024-04-23T19:03:43.393124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"97'24","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708227+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:03:43.708227+0000","last_peered":"2024-04-23T19:03:43.708227+0000","last_clean":"2024-04-23T19:03:43.708227+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:03:43.708227+0000","last_undegraded":"2024-04-23T19:03:43.708227+0000","last_fullsized":"2024-04-23T19:03:43.708227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389457+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:03:43.389457+0000","last_peered":"2024-04-23T19:03:43.389457+0000","last_clean":"2024-04-23T19:03:43.389457+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:03:43.389457+0000","last_undegraded":"2024-04-23T19:03:43.389457+0000","last_fullsized":"2024-04-23T19:03:43.389457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114533+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:03:44.114533+0000","last_peered":"2024-04-23T19:03:44.114533+0000","last_clean":"2024-04-23T19:03:44.114533+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:03:44.114533+0000","last_undegraded":"2024-04-23T19:03:44.114533+0000","last_fullsized":"2024-04-23T19:03:44.114533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"98'134","reported_seq":359,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390814+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:03:43.390814+0000","last_peered":"2024-04-23T19:03:43.390814+0000","last_clean":"2024-04-23T19:03:43.390814+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:03:43.390814+0000","last_undegraded":"2024-04-23T19:03:43.390814+0000","last_fullsized":"2024-04-23T19:03:43.390814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388486+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:03:43.388486+0000","last_peered":"2024-04-23T19:03:43.388486+0000","last_clean":"2024-04-23T19:03:43.388486+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:03:43.388486+0000","last_undegraded":"2024-04-23T19:03:43.388486+0000","last_fullsized":"2024-04-23T19:03:43.388486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115034+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:03:44.115034+0000","last_peered":"2024-04-23T19:03:44.115034+0000","last_clean":"2024-04-23T19:03:44.115034+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:03:44.115034+0000","last_undegraded":"2024-04-23T19:03:44.115034+0000","last_fullsized":"2024-04-23T19:03:44.115034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112930+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:03:44.112930+0000","last_peered":"2024-04-23T19:03:44.112930+0000","last_clean":"2024-04-23T19:03:44.112930+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:03:44.112930+0000","last_undegraded":"2024-04-23T19:03:44.112930+0000","last_fullsized":"2024-04-23T19:03:44.112930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388052+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:03:43.388052+0000","last_peered":"2024-04-23T19:03:43.388052+0000","last_clean":"2024-04-23T19:03:43.388052+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:03:43.388052+0000","last_undegraded":"2024-04-23T19:03:43.388052+0000","last_fullsized":"2024-04-23T19:03:43.388052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113425+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:03:44.113425+0000","last_peered":"2024-04-23T19:03:44.113425+0000","last_clean":"2024-04-23T19:03:44.113425+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:03:44.113425+0000","last_undegraded":"2024-04-23T19:03:44.113425+0000","last_fullsized":"2024-04-23T19:03:44.113425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388724+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388724+0000","last_peered":"2024-04-23T19:03:43.388724+0000","last_clean":"2024-04-23T19:03:43.388724+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388724+0000","last_undegraded":"2024-04-23T19:03:43.388724+0000","last_fullsized":"2024-04-23T19:03:43.388724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909389+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909389+0000","last_peered":"2024-04-23T19:03:43.909389+0000","last_clean":"2024-04-23T19:03:43.909389+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909389+0000","last_undegraded":"2024-04-23T19:03:43.909389+0000","last_fullsized":"2024-04-23T19:03:43.909389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'31","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115277+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:44.115277+0000","last_peered":"2024-04-23T19:03:44.115277+0000","last_clean":"2024-04-23T19:03:44.115277+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:44.115277+0000","last_undegraded":"2024-04-23T19:03:44.115277+0000","last_fullsized":"2024-04-23T19:03:44.115277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388320+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:03:43.388320+0000","last_peered":"2024-04-23T19:03:43.388320+0000","last_clean":"2024-04-23T19:03:43.388320+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:03:43.388320+0000","last_undegraded":"2024-04-23T19:03:43.388320+0000","last_fullsized":"2024-04-23T19:03:43.388320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392626+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:03:43.392626+0000","last_peered":"2024-04-23T19:03:43.392626+0000","last_clean":"2024-04-23T19:03:43.392626+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:03:43.392626+0000","last_undegraded":"2024-04-23T19:03:43.392626+0000","last_fullsized":"2024-04-23T19:03:43.392626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390803+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:03:43.390803+0000","last_peered":"2024-04-23T19:03:43.390803+0000","last_clean":"2024-04-23T19:03:43.390803+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:03:43.390803+0000","last_undegraded":"2024-04-23T19:03:43.390803+0000","last_fullsized":"2024-04-23T19:03:43.390803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708652+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708652+0000","last_peered":"2024-04-23T19:03:43.708652+0000","last_clean":"2024-04-23T19:03:43.708652+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708652+0000","last_undegraded":"2024-04-23T19:03:43.708652+0000","last_fullsized":"2024-04-23T19:03:43.708652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708882+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:03:43.708882+0000","last_peered":"2024-04-23T19:03:43.708882+0000","last_clean":"2024-04-23T19:03:43.708882+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:03:43.708882+0000","last_undegraded":"2024-04-23T19:03:43.708882+0000","last_fullsized":"2024-04-23T19:03:43.708882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"97'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115464+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:03:44.115464+0000","last_peered":"2024-04-23T19:03:44.115464+0000","last_clean":"2024-04-23T19:03:44.115464+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:03:44.115464+0000","last_undegraded":"2024-04-23T19:03:44.115464+0000","last_fullsized":"2024-04-23T19:03:44.115464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394271+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:03:43.394271+0000","last_peered":"2024-04-23T19:03:43.394271+0000","last_clean":"2024-04-23T19:03:43.394271+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:03:43.394271+0000","last_undegraded":"2024-04-23T19:03:43.394271+0000","last_fullsized":"2024-04-23T19:03:43.394271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'23","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113515+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:03:44.113515+0000","last_peered":"2024-04-23T19:03:44.113515+0000","last_clean":"2024-04-23T19:03:44.113515+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:03:44.113515+0000","last_undegraded":"2024-04-23T19:03:44.113515+0000","last_fullsized":"2024-04-23T19:03:44.113515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"98'134","reported_seq":359,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112599+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:03:44.112599+0000","last_peered":"2024-04-23T19:03:44.112599+0000","last_clean":"2024-04-23T19:03:44.112599+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:03:44.112599+0000","last_undegraded":"2024-04-23T19:03:44.112599+0000","last_fullsized":"2024-04-23T19:03:44.112599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113763+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:03:44.113763+0000","last_peered":"2024-04-23T19:03:44.113763+0000","last_clean":"2024-04-23T19:03:44.113763+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:44.113763+0000","last_undegraded":"2024-04-23T19:03:44.113763+0000","last_fullsized":"2024-04-23T19:03:44.113763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113964+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.113964+0000","last_peered":"2024-04-23T19:03:44.113964+0000","last_clean":"2024-04-23T19:03:44.113964+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.113964+0000","last_undegraded":"2024-04-23T19:03:44.113964+0000","last_fullsized":"2024-04-23T19:03:44.113964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389851+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:43.389851+0000","last_peered":"2024-04-23T19:03:43.389851+0000","last_clean":"2024-04-23T19:03:43.389851+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:43.389851+0000","last_undegraded":"2024-04-23T19:03:43.389851+0000","last_fullsized":"2024-04-23T19:03:43.389851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393360+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:03:43.393360+0000","last_peered":"2024-04-23T19:03:43.393360+0000","last_clean":"2024-04-23T19:03:43.393360+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:03:43.393360+0000","last_undegraded":"2024-04-23T19:03:43.393360+0000","last_fullsized":"2024-04-23T19:03:43.393360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'30","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112891+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:03:44.112891+0000","last_peered":"2024-04-23T19:03:44.112891+0000","last_clean":"2024-04-23T19:03:44.112891+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:03:44.112891+0000","last_undegraded":"2024-04-23T19:03:44.112891+0000","last_fullsized":"2024-04-23T19:03:44.112891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389128+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:03:43.389128+0000","last_peered":"2024-04-23T19:03:43.389128+0000","last_clean":"2024-04-23T19:03:43.389128+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:03:43.389128+0000","last_undegraded":"2024-04-23T19:03:43.389128+0000","last_fullsized":"2024-04-23T19:03:43.389128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'8","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115520+0000","last_change":"2024-04-23T19:03:32.295412+0000","last_active":"2024-04-23T19:03:44.115520+0000","last_peered":"2024-04-23T19:03:44.115520+0000","last_clean":"2024-04-23T19:03:44.115520+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:03:44.115520+0000","last_undegraded":"2024-04-23T19:03:44.115520+0000","last_fullsized":"2024-04-23T19:03:44.115520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:38.660742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911690+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:03:43.911690+0000","last_peered":"2024-04-23T19:03:43.911690+0000","last_clean":"2024-04-23T19:03:43.911690+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:03:43.911690+0000","last_undegraded":"2024-04-23T19:03:43.911690+0000","last_fullsized":"2024-04-23T19:03:43.911690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391669+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:43.391669+0000","last_peered":"2024-04-23T19:03:43.391669+0000","last_clean":"2024-04-23T19:03:43.391669+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:43.391669+0000","last_undegraded":"2024-04-23T19:03:43.391669+0000","last_fullsized":"2024-04-23T19:03:43.391669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393878+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:03:43.393878+0000","last_peered":"2024-04-23T19:03:43.393878+0000","last_clean":"2024-04-23T19:03:43.393878+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:03:43.393878+0000","last_undegraded":"2024-04-23T19:03:43.393878+0000","last_fullsized":"2024-04-23T19:03:43.393878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910655+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:03:43.910655+0000","last_peered":"2024-04-23T19:03:43.910655+0000","last_clean":"2024-04-23T19:03:43.910655+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:03:43.910655+0000","last_undegraded":"2024-04-23T19:03:43.910655+0000","last_fullsized":"2024-04-23T19:03:43.910655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114514+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114514+0000","last_peered":"2024-04-23T19:03:44.114514+0000","last_clean":"2024-04-23T19:03:44.114514+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114514+0000","last_undegraded":"2024-04-23T19:03:44.114514+0000","last_fullsized":"2024-04-23T19:03:44.114514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388173+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388173+0000","last_peered":"2024-04-23T19:03:43.388173+0000","last_clean":"2024-04-23T19:03:43.388173+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388173+0000","last_undegraded":"2024-04-23T19:03:43.388173+0000","last_fullsized":"2024-04-23T19:03:43.388173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911045+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:03:43.911045+0000","last_peered":"2024-04-23T19:03:43.911045+0000","last_clean":"2024-04-23T19:03:43.911045+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:03:43.911045+0000","last_undegraded":"2024-04-23T19:03:43.911045+0000","last_fullsized":"2024-04-23T19:03:43.911045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709068+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:03:43.709068+0000","last_peered":"2024-04-23T19:03:43.709068+0000","last_clean":"2024-04-23T19:03:43.709068+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:03:43.709068+0000","last_undegraded":"2024-04-23T19:03:43.709068+0000","last_fullsized":"2024-04-23T19:03:43.709068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113707+0000","last_change":"2024-04-23T19:03:32.296246+0000","last_active":"2024-04-23T19:03:44.113707+0000","last_peered":"2024-04-23T19:03:44.113707+0000","last_clean":"2024-04-23T19:03:44.113707+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:03:44.113707+0000","last_undegraded":"2024-04-23T19:03:44.113707+0000","last_fullsized":"2024-04-23T19:03:44.113707+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:48.818498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394174+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:03:43.394174+0000","last_peered":"2024-04-23T19:03:43.394174+0000","last_clean":"2024-04-23T19:03:43.394174+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:03:43.394174+0000","last_undegraded":"2024-04-23T19:03:43.394174+0000","last_fullsized":"2024-04-23T19:03:43.394174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"98'134","reported_seq":374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393832+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:03:43.393832+0000","last_peered":"2024-04-23T19:03:43.393832+0000","last_clean":"2024-04-23T19:03:43.393832+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:03:43.393832+0000","last_undegraded":"2024-04-23T19:03:43.393832+0000","last_fullsized":"2024-04-23T19:03:43.393832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":154,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112679+0000","last_change":"2024-04-23T19:03:32.290672+0000","last_active":"2024-04-23T19:03:44.112679+0000","last_peered":"2024-04-23T19:03:44.112679+0000","last_clean":"2024-04-23T19:03:44.112679+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:03:44.112679+0000","last_undegraded":"2024-04-23T19:03:44.112679+0000","last_fullsized":"2024-04-23T19:03:44.112679+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:19.410020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911686+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:03:43.911686+0000","last_peered":"2024-04-23T19:03:43.911686+0000","last_clean":"2024-04-23T19:03:43.911686+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:03:43.911686+0000","last_undegraded":"2024-04-23T19:03:43.911686+0000","last_fullsized":"2024-04-23T19:03:43.911686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910029+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:43.910029+0000","last_peered":"2024-04-23T19:03:43.910029+0000","last_clean":"2024-04-23T19:03:43.910029+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:43.910029+0000","last_undegraded":"2024-04-23T19:03:43.910029+0000","last_fullsized":"2024-04-23T19:03:43.910029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390002+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:03:43.390002+0000","last_peered":"2024-04-23T19:03:43.390002+0000","last_clean":"2024-04-23T19:03:43.390002+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:03:43.390002+0000","last_undegraded":"2024-04-23T19:03:43.390002+0000","last_fullsized":"2024-04-23T19:03:43.390002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"98'12","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390965+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:03:43.390965+0000","last_peered":"2024-04-23T19:03:43.390965+0000","last_clean":"2024-04-23T19:03:43.390965+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:03:43.390965+0000","last_undegraded":"2024-04-23T19:03:43.390965+0000","last_fullsized":"2024-04-23T19:03:43.390965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"98'134","reported_seq":405,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708913+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:03:43.708913+0000","last_peered":"2024-04-23T19:03:43.708913+0000","last_clean":"2024-04-23T19:03:43.708913+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:03:43.708913+0000","last_undegraded":"2024-04-23T19:03:43.708913+0000","last_fullsized":"2024-04-23T19:03:43.708913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910131+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910131+0000","last_peered":"2024-04-23T19:03:43.910131+0000","last_clean":"2024-04-23T19:03:43.910131+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910131+0000","last_undegraded":"2024-04-23T19:03:43.910131+0000","last_fullsized":"2024-04-23T19:03:43.910131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115660+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:03:44.115660+0000","last_peered":"2024-04-23T19:03:44.115660+0000","last_clean":"2024-04-23T19:03:44.115660+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:03:44.115660+0000","last_undegraded":"2024-04-23T19:03:44.115660+0000","last_fullsized":"2024-04-23T19:03:44.115660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391592+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:43.391592+0000","last_peered":"2024-04-23T19:03:43.391592+0000","last_clean":"2024-04-23T19:03:43.391592+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:43.391592+0000","last_undegraded":"2024-04-23T19:03:43.391592+0000","last_fullsized":"2024-04-23T19:03:43.391592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910950+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:03:43.910950+0000","last_peered":"2024-04-23T19:03:43.910950+0000","last_clean":"2024-04-23T19:03:43.910950+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:03:43.910950+0000","last_undegraded":"2024-04-23T19:03:43.910950+0000","last_fullsized":"2024-04-23T19:03:43.910950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'26","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389169+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:43.389169+0000","last_peered":"2024-04-23T19:03:43.389169+0000","last_clean":"2024-04-23T19:03:43.389169+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:43.389169+0000","last_undegraded":"2024-04-23T19:03:43.389169+0000","last_fullsized":"2024-04-23T19:03:43.389169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708197+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:03:43.708197+0000","last_peered":"2024-04-23T19:03:43.708197+0000","last_clean":"2024-04-23T19:03:43.708197+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:03:43.708197+0000","last_undegraded":"2024-04-23T19:03:43.708197+0000","last_fullsized":"2024-04-23T19:03:43.708197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113320+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113320+0000","last_peered":"2024-04-23T19:03:44.113320+0000","last_clean":"2024-04-23T19:03:44.113320+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113320+0000","last_undegraded":"2024-04-23T19:03:44.113320+0000","last_fullsized":"2024-04-23T19:03:44.113320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:09.210430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709271+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:03:43.709271+0000","last_peered":"2024-04-23T19:03:43.709271+0000","last_clean":"2024-04-23T19:03:43.709271+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:03:43.709271+0000","last_undegraded":"2024-04-23T19:03:43.709271+0000","last_fullsized":"2024-04-23T19:03:43.709271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113725+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:03:44.113725+0000","last_peered":"2024-04-23T19:03:44.113725+0000","last_clean":"2024-04-23T19:03:44.113725+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:03:44.113725+0000","last_undegraded":"2024-04-23T19:03:44.113725+0000","last_fullsized":"2024-04-23T19:03:44.113725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389218+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:03:43.389218+0000","last_peered":"2024-04-23T19:03:43.389218+0000","last_clean":"2024-04-23T19:03:43.389218+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:03:43.389218+0000","last_undegraded":"2024-04-23T19:03:43.389218+0000","last_fullsized":"2024-04-23T19:03:43.389218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391341+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:43.391341+0000","last_peered":"2024-04-23T19:03:43.391341+0000","last_clean":"2024-04-23T19:03:43.391341+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:43.391341+0000","last_undegraded":"2024-04-23T19:03:43.391341+0000","last_fullsized":"2024-04-23T19:03:43.391341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114228+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:03:44.114228+0000","last_peered":"2024-04-23T19:03:44.114228+0000","last_clean":"2024-04-23T19:03:44.114228+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:03:44.114228+0000","last_undegraded":"2024-04-23T19:03:44.114228+0000","last_fullsized":"2024-04-23T19:03:44.114228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'39","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390341+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:03:43.390341+0000","last_peered":"2024-04-23T19:03:43.390341+0000","last_clean":"2024-04-23T19:03:43.390341+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:03:43.390341+0000","last_undegraded":"2024-04-23T19:03:43.390341+0000","last_fullsized":"2024-04-23T19:03:43.390341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113854+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:03:44.113854+0000","last_peered":"2024-04-23T19:03:44.113854+0000","last_clean":"2024-04-23T19:03:44.113854+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:03:44.113854+0000","last_undegraded":"2024-04-23T19:03:44.113854+0000","last_fullsized":"2024-04-23T19:03:44.113854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707656+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707656+0000","last_peered":"2024-04-23T19:03:43.707656+0000","last_clean":"2024-04-23T19:03:43.707656+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707656+0000","last_undegraded":"2024-04-23T19:03:43.707656+0000","last_fullsized":"2024-04-23T19:03:43.707656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114161+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:03:44.114161+0000","last_peered":"2024-04-23T19:03:44.114161+0000","last_clean":"2024-04-23T19:03:44.114161+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:03:44.114161+0000","last_undegraded":"2024-04-23T19:03:44.114161+0000","last_fullsized":"2024-04-23T19:03:44.114161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113340+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:03:44.113340+0000","last_peered":"2024-04-23T19:03:44.113340+0000","last_clean":"2024-04-23T19:03:44.113340+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:03:44.113340+0000","last_undegraded":"2024-04-23T19:03:44.113340+0000","last_fullsized":"2024-04-23T19:03:44.113340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112983+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:44.112983+0000","last_peered":"2024-04-23T19:03:44.112983+0000","last_clean":"2024-04-23T19:03:44.112983+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:44.112983+0000","last_undegraded":"2024-04-23T19:03:44.112983+0000","last_fullsized":"2024-04-23T19:03:44.112983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390688+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:03:43.390688+0000","last_peered":"2024-04-23T19:03:43.390688+0000","last_clean":"2024-04-23T19:03:43.390688+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:03:43.390688+0000","last_undegraded":"2024-04-23T19:03:43.390688+0000","last_fullsized":"2024-04-23T19:03:43.390688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"98'136","reported_seq":427,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113611+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:03:44.113611+0000","last_peered":"2024-04-23T19:03:44.113611+0000","last_clean":"2024-04-23T19:03:44.113611+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:03:44.113611+0000","last_undegraded":"2024-04-23T19:03:44.113611+0000","last_fullsized":"2024-04-23T19:03:44.113611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114354+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114354+0000","last_peered":"2024-04-23T19:03:44.114354+0000","last_clean":"2024-04-23T19:03:44.114354+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114354+0000","last_undegraded":"2024-04-23T19:03:44.114354+0000","last_fullsized":"2024-04-23T19:03:44.114354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112303+0000","last_change":"2024-04-23T19:03:32.286556+0000","last_active":"2024-04-23T19:03:44.112303+0000","last_peered":"2024-04-23T19:03:44.112303+0000","last_clean":"2024-04-23T19:03:44.112303+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:03:44.112303+0000","last_undegraded":"2024-04-23T19:03:44.112303+0000","last_fullsized":"2024-04-23T19:03:44.112303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:18.008985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115727+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:03:44.115727+0000","last_peered":"2024-04-23T19:03:44.115727+0000","last_clean":"2024-04-23T19:03:44.115727+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:03:44.115727+0000","last_undegraded":"2024-04-23T19:03:44.115727+0000","last_fullsized":"2024-04-23T19:03:44.115727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389027+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:03:43.389027+0000","last_peered":"2024-04-23T19:03:43.389027+0000","last_clean":"2024-04-23T19:03:43.389027+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:03:43.389027+0000","last_undegraded":"2024-04-23T19:03:43.389027+0000","last_fullsized":"2024-04-23T19:03:43.389027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"96'14","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112139+0000","last_change":"2024-04-23T19:03:32.290315+0000","last_active":"2024-04-23T19:03:44.112139+0000","last_peered":"2024-04-23T19:03:44.112139+0000","last_clean":"2024-04-23T19:03:44.112139+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:03:44.112139+0000","last_undegraded":"2024-04-23T19:03:44.112139+0000","last_fullsized":"2024-04-23T19:03:44.112139+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:50.252138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393921+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:03:43.393921+0000","last_peered":"2024-04-23T19:03:43.393921+0000","last_clean":"2024-04-23T19:03:43.393921+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:03:43.393921+0000","last_undegraded":"2024-04-23T19:03:43.393921+0000","last_fullsized":"2024-04-23T19:03:43.393921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'16","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114809+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:44.114809+0000","last_peered":"2024-04-23T19:03:44.114809+0000","last_clean":"2024-04-23T19:03:44.114809+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:44.114809+0000","last_undegraded":"2024-04-23T19:03:44.114809+0000","last_fullsized":"2024-04-23T19:03:44.114809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113413+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:03:44.113413+0000","last_peered":"2024-04-23T19:03:44.113413+0000","last_clean":"2024-04-23T19:03:44.113413+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:03:44.113413+0000","last_undegraded":"2024-04-23T19:03:44.113413+0000","last_fullsized":"2024-04-23T19:03:44.113413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392383+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392383+0000","last_peered":"2024-04-23T19:03:43.392383+0000","last_clean":"2024-04-23T19:03:43.392383+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392383+0000","last_undegraded":"2024-04-23T19:03:43.392383+0000","last_fullsized":"2024-04-23T19:03:43.392383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113895+0000","last_change":"2024-04-23T19:03:32.300198+0000","last_active":"2024-04-23T19:03:44.113895+0000","last_peered":"2024-04-23T19:03:44.113895+0000","last_clean":"2024-04-23T19:03:44.113895+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:03:44.113895+0000","last_undegraded":"2024-04-23T19:03:44.113895+0000","last_fullsized":"2024-04-23T19:03:44.113895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:55:20.076349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389317+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:03:43.389317+0000","last_peered":"2024-04-23T19:03:43.389317+0000","last_clean":"2024-04-23T19:03:43.389317+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:03:43.389317+0000","last_undegraded":"2024-04-23T19:03:43.389317+0000","last_fullsized":"2024-04-23T19:03:43.389317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911323+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:43.911323+0000","last_peered":"2024-04-23T19:03:43.911323+0000","last_clean":"2024-04-23T19:03:43.911323+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:43.911323+0000","last_undegraded":"2024-04-23T19:03:43.911323+0000","last_fullsized":"2024-04-23T19:03:43.911323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":280,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113800+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:03:44.113800+0000","last_peered":"2024-04-23T19:03:44.113800+0000","last_clean":"2024-04-23T19:03:44.113800+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:03:44.113800+0000","last_undegraded":"2024-04-23T19:03:44.113800+0000","last_fullsized":"2024-04-23T19:03:44.113800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393082+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393082+0000","last_peered":"2024-04-23T19:03:43.393082+0000","last_clean":"2024-04-23T19:03:43.393082+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393082+0000","last_undegraded":"2024-04-23T19:03:43.393082+0000","last_fullsized":"2024-04-23T19:03:43.393082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709817+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709817+0000","last_peered":"2024-04-23T19:03:43.709817+0000","last_clean":"2024-04-23T19:03:43.709817+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709817+0000","last_undegraded":"2024-04-23T19:03:43.709817+0000","last_fullsized":"2024-04-23T19:03:43.709817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387614+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387614+0000","last_peered":"2024-04-23T19:03:43.387614+0000","last_clean":"2024-04-23T19:03:43.387614+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387614+0000","last_undegraded":"2024-04-23T19:03:43.387614+0000","last_fullsized":"2024-04-23T19:03:43.387614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113459+0000","last_change":"2024-04-23T19:03:32.295129+0000","last_active":"2024-04-23T19:03:44.113459+0000","last_peered":"2024-04-23T19:03:44.113459+0000","last_clean":"2024-04-23T19:03:44.113459+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:03:44.113459+0000","last_undegraded":"2024-04-23T19:03:44.113459+0000","last_fullsized":"2024-04-23T19:03:44.113459+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:35:11.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390260+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:43.390260+0000","last_peered":"2024-04-23T19:03:43.390260+0000","last_clean":"2024-04-23T19:03:43.390260+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:43.390260+0000","last_undegraded":"2024-04-23T19:03:43.390260+0000","last_fullsized":"2024-04-23T19:03:43.390260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114156+0000","last_change":"2024-04-23T19:03:32.293904+0000","last_active":"2024-04-23T19:03:44.114156+0000","last_peered":"2024-04-23T19:03:44.114156+0000","last_clean":"2024-04-23T19:03:44.114156+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:03:44.114156+0000","last_undegraded":"2024-04-23T19:03:44.114156+0000","last_fullsized":"2024-04-23T19:03:44.114156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:21.520365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113604+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:03:44.113604+0000","last_peered":"2024-04-23T19:03:44.113604+0000","last_clean":"2024-04-23T19:03:44.113604+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:03:44.113604+0000","last_undegraded":"2024-04-23T19:03:44.113604+0000","last_fullsized":"2024-04-23T19:03:44.113604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'34","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112855+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:03:44.112855+0000","last_peered":"2024-04-23T19:03:44.112855+0000","last_clean":"2024-04-23T19:03:44.112855+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:03:44.112855+0000","last_undegraded":"2024-04-23T19:03:44.112855+0000","last_fullsized":"2024-04-23T19:03:44.112855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908951+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.908951+0000","last_peered":"2024-04-23T19:03:43.908951+0000","last_clean":"2024-04-23T19:03:43.908951+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.908951+0000","last_undegraded":"2024-04-23T19:03:43.908951+0000","last_fullsized":"2024-04-23T19:03:43.908951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113600+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:03:44.113600+0000","last_peered":"2024-04-23T19:03:44.113600+0000","last_clean":"2024-04-23T19:03:44.113600+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:03:44.113600+0000","last_undegraded":"2024-04-23T19:03:44.113600+0000","last_fullsized":"2024-04-23T19:03:44.113600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113874+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:03:44.113874+0000","last_peered":"2024-04-23T19:03:44.113874+0000","last_clean":"2024-04-23T19:03:44.113874+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:03:44.113874+0000","last_undegraded":"2024-04-23T19:03:44.113874+0000","last_fullsized":"2024-04-23T19:03:44.113874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"97'22","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113983+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:44.113983+0000","last_peered":"2024-04-23T19:03:44.113983+0000","last_clean":"2024-04-23T19:03:44.113983+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:44.113983+0000","last_undegraded":"2024-04-23T19:03:44.113983+0000","last_fullsized":"2024-04-23T19:03:44.113983+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.348240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115650+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:03:44.115650+0000","last_peered":"2024-04-23T19:03:44.115650+0000","last_clean":"2024-04-23T19:03:44.115650+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:03:44.115650+0000","last_undegraded":"2024-04-23T19:03:44.115650+0000","last_fullsized":"2024-04-23T19:03:44.115650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708440+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:03:43.708440+0000","last_peered":"2024-04-23T19:03:43.708440+0000","last_clean":"2024-04-23T19:03:43.708440+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:03:43.708440+0000","last_undegraded":"2024-04-23T19:03:43.708440+0000","last_fullsized":"2024-04-23T19:03:43.708440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112369+0000","last_change":"2024-04-23T19:03:32.300841+0000","last_active":"2024-04-23T19:03:44.112369+0000","last_peered":"2024-04-23T19:03:44.112369+0000","last_clean":"2024-04-23T19:03:44.112369+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:03:44.112369+0000","last_undegraded":"2024-04-23T19:03:44.112369+0000","last_fullsized":"2024-04-23T19:03:44.112369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:36.411296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"98'134","reported_seq":359,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388634+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:43.388634+0000","last_peered":"2024-04-23T19:03:43.388634+0000","last_clean":"2024-04-23T19:03:43.388634+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:43.388634+0000","last_undegraded":"2024-04-23T19:03:43.388634+0000","last_fullsized":"2024-04-23T19:03:43.388634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393276+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393276+0000","last_peered":"2024-04-23T19:03:43.393276+0000","last_clean":"2024-04-23T19:03:43.393276+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393276+0000","last_undegraded":"2024-04-23T19:03:43.393276+0000","last_fullsized":"2024-04-23T19:03:43.393276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391087+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:03:43.391087+0000","last_peered":"2024-04-23T19:03:43.391087+0000","last_clean":"2024-04-23T19:03:43.391087+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:03:43.391087+0000","last_undegraded":"2024-04-23T19:03:43.391087+0000","last_fullsized":"2024-04-23T19:03:43.391087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"97'20","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392954+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:43.392954+0000","last_peered":"2024-04-23T19:03:43.392954+0000","last_clean":"2024-04-23T19:03:43.392954+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:43.392954+0000","last_undegraded":"2024-04-23T19:03:43.392954+0000","last_fullsized":"2024-04-23T19:03:43.392954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115534+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115534+0000","last_peered":"2024-04-23T19:03:44.115534+0000","last_clean":"2024-04-23T19:03:44.115534+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115534+0000","last_undegraded":"2024-04-23T19:03:44.115534+0000","last_fullsized":"2024-04-23T19:03:44.115534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:41.115956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909201+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:03:43.909201+0000","last_peered":"2024-04-23T19:03:43.909201+0000","last_clean":"2024-04-23T19:03:43.909201+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:03:43.909201+0000","last_undegraded":"2024-04-23T19:03:43.909201+0000","last_fullsized":"2024-04-23T19:03:43.909201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910617+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:03:43.910617+0000","last_peered":"2024-04-23T19:03:43.910617+0000","last_clean":"2024-04-23T19:03:43.910617+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:03:43.910617+0000","last_undegraded":"2024-04-23T19:03:43.910617+0000","last_fullsized":"2024-04-23T19:03:43.910617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"98'134","reported_seq":437,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392929+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:03:43.392929+0000","last_peered":"2024-04-23T19:03:43.392929+0000","last_clean":"2024-04-23T19:03:43.392929+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:03:43.392929+0000","last_undegraded":"2024-04-23T19:03:43.392929+0000","last_fullsized":"2024-04-23T19:03:43.392929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113500+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:44.113500+0000","last_peered":"2024-04-23T19:03:44.113500+0000","last_clean":"2024-04-23T19:03:44.113500+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:44.113500+0000","last_undegraded":"2024-04-23T19:03:44.113500+0000","last_fullsized":"2024-04-23T19:03:44.113500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909395+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909395+0000","last_peered":"2024-04-23T19:03:43.909395+0000","last_clean":"2024-04-23T19:03:43.909395+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909395+0000","last_undegraded":"2024-04-23T19:03:43.909395+0000","last_fullsized":"2024-04-23T19:03:43.909395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"97'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114287+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:44.114287+0000","last_peered":"2024-04-23T19:03:44.114287+0000","last_clean":"2024-04-23T19:03:44.114287+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:44.114287+0000","last_undegraded":"2024-04-23T19:03:44.114287+0000","last_fullsized":"2024-04-23T19:03:44.114287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710129+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:03:43.710129+0000","last_peered":"2024-04-23T19:03:43.710129+0000","last_clean":"2024-04-23T19:03:43.710129+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:03:43.710129+0000","last_undegraded":"2024-04-23T19:03:43.710129+0000","last_fullsized":"2024-04-23T19:03:43.710129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390843+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:03:43.390843+0000","last_peered":"2024-04-23T19:03:43.390843+0000","last_clean":"2024-04-23T19:03:43.390843+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:03:43.390843+0000","last_undegraded":"2024-04-23T19:03:43.390843+0000","last_fullsized":"2024-04-23T19:03:43.390843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390945+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:03:43.390945+0000","last_peered":"2024-04-23T19:03:43.390945+0000","last_clean":"2024-04-23T19:03:43.390945+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:03:43.390945+0000","last_undegraded":"2024-04-23T19:03:43.390945+0000","last_fullsized":"2024-04-23T19:03:43.390945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388873+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.388873+0000","last_peered":"2024-04-23T19:03:43.388873+0000","last_clean":"2024-04-23T19:03:43.388873+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.388873+0000","last_undegraded":"2024-04-23T19:03:43.388873+0000","last_fullsized":"2024-04-23T19:03:43.388873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114432+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:03:44.114432+0000","last_peered":"2024-04-23T19:03:44.114432+0000","last_clean":"2024-04-23T19:03:44.114432+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:03:44.114432+0000","last_undegraded":"2024-04-23T19:03:44.114432+0000","last_fullsized":"2024-04-23T19:03:44.114432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909827+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:03:43.909827+0000","last_peered":"2024-04-23T19:03:43.909827+0000","last_clean":"2024-04-23T19:03:43.909827+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:03:43.909827+0000","last_undegraded":"2024-04-23T19:03:43.909827+0000","last_fullsized":"2024-04-23T19:03:43.909827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910450+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:43.910450+0000","last_peered":"2024-04-23T19:03:43.910450+0000","last_clean":"2024-04-23T19:03:43.910450+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:43.910450+0000","last_undegraded":"2024-04-23T19:03:43.910450+0000","last_fullsized":"2024-04-23T19:03:43.910450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113537+0000","last_change":"2024-04-23T19:03:32.294993+0000","last_active":"2024-04-23T19:03:44.113537+0000","last_peered":"2024-04-23T19:03:44.113537+0000","last_clean":"2024-04-23T19:03:44.113537+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:03:44.113537+0000","last_undegraded":"2024-04-23T19:03:44.113537+0000","last_fullsized":"2024-04-23T19:03:44.113537+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:50.832778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'19","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388829+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:03:43.388829+0000","last_peered":"2024-04-23T19:03:43.388829+0000","last_clean":"2024-04-23T19:03:43.388829+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:03:43.388829+0000","last_undegraded":"2024-04-23T19:03:43.388829+0000","last_fullsized":"2024-04-23T19:03:43.388829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388406+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:03:43.388406+0000","last_peered":"2024-04-23T19:03:43.388406+0000","last_clean":"2024-04-23T19:03:43.388406+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:03:43.388406+0000","last_undegraded":"2024-04-23T19:03:43.388406+0000","last_fullsized":"2024-04-23T19:03:43.388406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392779+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:03:43.392779+0000","last_peered":"2024-04-23T19:03:43.392779+0000","last_clean":"2024-04-23T19:03:43.392779+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:03:43.392779+0000","last_undegraded":"2024-04-23T19:03:43.392779+0000","last_fullsized":"2024-04-23T19:03:43.392779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113434+0000","last_change":"2024-04-23T19:03:32.300516+0000","last_active":"2024-04-23T19:03:44.113434+0000","last_peered":"2024-04-23T19:03:44.113434+0000","last_clean":"2024-04-23T19:03:44.113434+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:03:44.113434+0000","last_undegraded":"2024-04-23T19:03:44.113434+0000","last_fullsized":"2024-04-23T19:03:44.113434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:02.485036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"97'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115124+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:44.115124+0000","last_peered":"2024-04-23T19:03:44.115124+0000","last_clean":"2024-04-23T19:03:44.115124+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:44.115124+0000","last_undegraded":"2024-04-23T19:03:44.115124+0000","last_fullsized":"2024-04-23T19:03:44.115124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392243+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:03:43.392243+0000","last_peered":"2024-04-23T19:03:43.392243+0000","last_clean":"2024-04-23T19:03:43.392243+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:03:43.392243+0000","last_undegraded":"2024-04-23T19:03:43.392243+0000","last_fullsized":"2024-04-23T19:03:43.392243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"100'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112763+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:03:44.112763+0000","last_peered":"2024-04-23T19:03:44.112763+0000","last_clean":"2024-04-23T19:03:44.112763+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:03:44.112763+0000","last_undegraded":"2024-04-23T19:03:44.112763+0000","last_fullsized":"2024-04-23T19:03:44.112763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113317+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:03:44.113317+0000","last_peered":"2024-04-23T19:03:44.113317+0000","last_clean":"2024-04-23T19:03:44.113317+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:03:44.113317+0000","last_undegraded":"2024-04-23T19:03:44.113317+0000","last_fullsized":"2024-04-23T19:03:44.113317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113692+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:44.113692+0000","last_peered":"2024-04-23T19:03:44.113692+0000","last_clean":"2024-04-23T19:03:44.113692+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:44.113692+0000","last_undegraded":"2024-04-23T19:03:44.113692+0000","last_fullsized":"2024-04-23T19:03:44.113692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389971+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:03:43.389971+0000","last_peered":"2024-04-23T19:03:43.389971+0000","last_clean":"2024-04-23T19:03:43.389971+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:03:43.389971+0000","last_undegraded":"2024-04-23T19:03:43.389971+0000","last_fullsized":"2024-04-23T19:03:43.389971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390374+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:03:43.390374+0000","last_peered":"2024-04-23T19:03:43.390374+0000","last_clean":"2024-04-23T19:03:43.390374+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:03:43.390374+0000","last_undegraded":"2024-04-23T19:03:43.390374+0000","last_fullsized":"2024-04-23T19:03:43.390374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112637+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:03:44.112637+0000","last_peered":"2024-04-23T19:03:44.112637+0000","last_clean":"2024-04-23T19:03:44.112637+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:03:44.112637+0000","last_undegraded":"2024-04-23T19:03:44.112637+0000","last_fullsized":"2024-04-23T19:03:44.112637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391944+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:03:43.391944+0000","last_peered":"2024-04-23T19:03:43.391944+0000","last_clean":"2024-04-23T19:03:43.391944+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:03:43.391944+0000","last_undegraded":"2024-04-23T19:03:43.391944+0000","last_fullsized":"2024-04-23T19:03:43.391944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708373+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:03:43.708373+0000","last_peered":"2024-04-23T19:03:43.708373+0000","last_clean":"2024-04-23T19:03:43.708373+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:03:43.708373+0000","last_undegraded":"2024-04-23T19:03:43.708373+0000","last_fullsized":"2024-04-23T19:03:43.708373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388390+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388390+0000","last_peered":"2024-04-23T19:03:43.388390+0000","last_clean":"2024-04-23T19:03:43.388390+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388390+0000","last_undegraded":"2024-04-23T19:03:43.388390+0000","last_fullsized":"2024-04-23T19:03:43.388390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391315+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391315+0000","last_peered":"2024-04-23T19:03:43.391315+0000","last_clean":"2024-04-23T19:03:43.391315+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391315+0000","last_undegraded":"2024-04-23T19:03:43.391315+0000","last_fullsized":"2024-04-23T19:03:43.391315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"97'28","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114624+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:44.114624+0000","last_peered":"2024-04-23T19:03:44.114624+0000","last_clean":"2024-04-23T19:03:44.114624+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:44.114624+0000","last_undegraded":"2024-04-23T19:03:44.114624+0000","last_fullsized":"2024-04-23T19:03:44.114624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708231+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:03:43.708231+0000","last_peered":"2024-04-23T19:03:43.708231+0000","last_clean":"2024-04-23T19:03:43.708231+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:03:43.708231+0000","last_undegraded":"2024-04-23T19:03:43.708231+0000","last_fullsized":"2024-04-23T19:03:43.708231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113187+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:03:44.113187+0000","last_peered":"2024-04-23T19:03:44.113187+0000","last_clean":"2024-04-23T19:03:44.113187+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:03:44.113187+0000","last_undegraded":"2024-04-23T19:03:44.113187+0000","last_fullsized":"2024-04-23T19:03:44.113187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113407+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:03:44.113407+0000","last_peered":"2024-04-23T19:03:44.113407+0000","last_clean":"2024-04-23T19:03:44.113407+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:03:44.113407+0000","last_undegraded":"2024-04-23T19:03:44.113407+0000","last_fullsized":"2024-04-23T19:03:44.113407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710040+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:03:43.710040+0000","last_peered":"2024-04-23T19:03:43.710040+0000","last_clean":"2024-04-23T19:03:43.710040+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:03:43.710040+0000","last_undegraded":"2024-04-23T19:03:43.710040+0000","last_fullsized":"2024-04-23T19:03:43.710040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"96'20","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391502+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:43.391502+0000","last_peered":"2024-04-23T19:03:43.391502+0000","last_clean":"2024-04-23T19:03:43.391502+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:43.391502+0000","last_undegraded":"2024-04-23T19:03:43.391502+0000","last_fullsized":"2024-04-23T19:03:43.391502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113935+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:03:44.113935+0000","last_peered":"2024-04-23T19:03:44.113935+0000","last_clean":"2024-04-23T19:03:44.113935+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:03:44.113935+0000","last_undegraded":"2024-04-23T19:03:44.113935+0000","last_fullsized":"2024-04-23T19:03:44.113935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'29","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114486+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:44.114486+0000","last_peered":"2024-04-23T19:03:44.114486+0000","last_clean":"2024-04-23T19:03:44.114486+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:44.114486+0000","last_undegraded":"2024-04-23T19:03:44.114486+0000","last_fullsized":"2024-04-23T19:03:44.114486+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:28.797026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388731+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:03:43.388731+0000","last_peered":"2024-04-23T19:03:43.388731+0000","last_clean":"2024-04-23T19:03:43.388731+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:03:43.388731+0000","last_undegraded":"2024-04-23T19:03:43.388731+0000","last_fullsized":"2024-04-23T19:03:43.388731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391467+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391467+0000","last_peered":"2024-04-23T19:03:43.391467+0000","last_clean":"2024-04-23T19:03:43.391467+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391467+0000","last_undegraded":"2024-04-23T19:03:43.391467+0000","last_fullsized":"2024-04-23T19:03:43.391467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114062+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:03:44.114062+0000","last_peered":"2024-04-23T19:03:44.114062+0000","last_clean":"2024-04-23T19:03:44.114062+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:03:44.114062+0000","last_undegraded":"2024-04-23T19:03:44.114062+0000","last_fullsized":"2024-04-23T19:03:44.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"97'30","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113127+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:03:44.113127+0000","last_peered":"2024-04-23T19:03:44.113127+0000","last_clean":"2024-04-23T19:03:44.113127+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:03:44.113127+0000","last_undegraded":"2024-04-23T19:03:44.113127+0000","last_fullsized":"2024-04-23T19:03:44.113127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709898+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:03:43.709898+0000","last_peered":"2024-04-23T19:03:43.709898+0000","last_clean":"2024-04-23T19:03:43.709898+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:03:43.709898+0000","last_undegraded":"2024-04-23T19:03:43.709898+0000","last_fullsized":"2024-04-23T19:03:43.709898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114003+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:03:44.114003+0000","last_peered":"2024-04-23T19:03:44.114003+0000","last_clean":"2024-04-23T19:03:44.114003+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:03:44.114003+0000","last_undegraded":"2024-04-23T19:03:44.114003+0000","last_fullsized":"2024-04-23T19:03:44.114003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114574+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:03:44.114574+0000","last_peered":"2024-04-23T19:03:44.114574+0000","last_clean":"2024-04-23T19:03:44.114574+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:03:44.114574+0000","last_undegraded":"2024-04-23T19:03:44.114574+0000","last_fullsized":"2024-04-23T19:03:44.114574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707993+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.707993+0000","last_peered":"2024-04-23T19:03:43.707993+0000","last_clean":"2024-04-23T19:03:43.707993+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.707993+0000","last_undegraded":"2024-04-23T19:03:43.707993+0000","last_fullsized":"2024-04-23T19:03:43.707993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392596+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:03:43.392596+0000","last_peered":"2024-04-23T19:03:43.392596+0000","last_clean":"2024-04-23T19:03:43.392596+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:03:43.392596+0000","last_undegraded":"2024-04-23T19:03:43.392596+0000","last_fullsized":"2024-04-23T19:03:43.392596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911521+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:43.911521+0000","last_peered":"2024-04-23T19:03:43.911521+0000","last_clean":"2024-04-23T19:03:43.911521+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:43.911521+0000","last_undegraded":"2024-04-23T19:03:43.911521+0000","last_fullsized":"2024-04-23T19:03:43.911521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.912128+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:03:43.912128+0000","last_peered":"2024-04-23T19:03:43.912128+0000","last_clean":"2024-04-23T19:03:43.912128+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:03:43.912128+0000","last_undegraded":"2024-04-23T19:03:43.912128+0000","last_fullsized":"2024-04-23T19:03:43.912128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393457+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:03:43.393457+0000","last_peered":"2024-04-23T19:03:43.393457+0000","last_clean":"2024-04-23T19:03:43.393457+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:03:43.393457+0000","last_undegraded":"2024-04-23T19:03:43.393457+0000","last_fullsized":"2024-04-23T19:03:43.393457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114358+0000","last_change":"2024-04-23T19:03:32.295881+0000","last_active":"2024-04-23T19:03:44.114358+0000","last_peered":"2024-04-23T19:03:44.114358+0000","last_clean":"2024-04-23T19:03:44.114358+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:03:44.114358+0000","last_undegraded":"2024-04-23T19:03:44.114358+0000","last_fullsized":"2024-04-23T19:03:44.114358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:09.028190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388000+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388000+0000","last_peered":"2024-04-23T19:03:43.388000+0000","last_clean":"2024-04-23T19:03:43.388000+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388000+0000","last_undegraded":"2024-04-23T19:03:43.388000+0000","last_fullsized":"2024-04-23T19:03:43.388000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394414+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:03:43.394414+0000","last_peered":"2024-04-23T19:03:43.394414+0000","last_clean":"2024-04-23T19:03:43.394414+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:03:43.394414+0000","last_undegraded":"2024-04-23T19:03:43.394414+0000","last_fullsized":"2024-04-23T19:03:43.394414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"97'20","reported_seq":147,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112321+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:44.112321+0000","last_peered":"2024-04-23T19:03:44.112321+0000","last_clean":"2024-04-23T19:03:44.112321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:44.112321+0000","last_undegraded":"2024-04-23T19:03:44.112321+0000","last_fullsized":"2024-04-23T19:03:44.112321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114840+0000","last_change":"2024-04-23T19:03:32.293970+0000","last_active":"2024-04-23T19:03:44.114840+0000","last_peered":"2024-04-23T19:03:44.114840+0000","last_clean":"2024-04-23T19:03:44.114840+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:03:44.114840+0000","last_undegraded":"2024-04-23T19:03:44.114840+0000","last_fullsized":"2024-04-23T19:03:44.114840+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:29.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910798+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:03:43.910798+0000","last_peered":"2024-04-23T19:03:43.910798+0000","last_clean":"2024-04-23T19:03:43.910798+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:03:43.910798+0000","last_undegraded":"2024-04-23T19:03:43.910798+0000","last_fullsized":"2024-04-23T19:03:43.910798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"98'134","reported_seq":387,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709267+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:03:43.709267+0000","last_peered":"2024-04-23T19:03:43.709267+0000","last_clean":"2024-04-23T19:03:43.709267+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:03:43.709267+0000","last_undegraded":"2024-04-23T19:03:43.709267+0000","last_fullsized":"2024-04-23T19:03:43.709267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112611+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112611+0000","last_peered":"2024-04-23T19:03:44.112611+0000","last_clean":"2024-04-23T19:03:44.112611+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112611+0000","last_undegraded":"2024-04-23T19:03:44.112611+0000","last_fullsized":"2024-04-23T19:03:44.112611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909534+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:03:43.909534+0000","last_peered":"2024-04-23T19:03:43.909534+0000","last_clean":"2024-04-23T19:03:43.909534+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:03:43.909534+0000","last_undegraded":"2024-04-23T19:03:43.909534+0000","last_fullsized":"2024-04-23T19:03:43.909534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389562+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:03:43.389562+0000","last_peered":"2024-04-23T19:03:43.389562+0000","last_clean":"2024-04-23T19:03:43.389562+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:03:43.389562+0000","last_undegraded":"2024-04-23T19:03:43.389562+0000","last_fullsized":"2024-04-23T19:03:43.389562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113265+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:03:44.113265+0000","last_peered":"2024-04-23T19:03:44.113265+0000","last_clean":"2024-04-23T19:03:44.113265+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:03:44.113265+0000","last_undegraded":"2024-04-23T19:03:44.113265+0000","last_fullsized":"2024-04-23T19:03:44.113265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'23","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388295+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:03:43.388295+0000","last_peered":"2024-04-23T19:03:43.388295+0000","last_clean":"2024-04-23T19:03:43.388295+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:03:43.388295+0000","last_undegraded":"2024-04-23T19:03:43.388295+0000","last_fullsized":"2024-04-23T19:03:43.388295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111946+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:03:44.111946+0000","last_peered":"2024-04-23T19:03:44.111946+0000","last_clean":"2024-04-23T19:03:44.111946+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:03:44.111946+0000","last_undegraded":"2024-04-23T19:03:44.111946+0000","last_fullsized":"2024-04-23T19:03:44.111946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115183+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115183+0000","last_peered":"2024-04-23T19:03:44.115183+0000","last_clean":"2024-04-23T19:03:44.115183+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115183+0000","last_undegraded":"2024-04-23T19:03:44.115183+0000","last_fullsized":"2024-04-23T19:03:44.115183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910717+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:03:43.910717+0000","last_peered":"2024-04-23T19:03:43.910717+0000","last_clean":"2024-04-23T19:03:43.910717+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:03:43.910717+0000","last_undegraded":"2024-04-23T19:03:43.910717+0000","last_fullsized":"2024-04-23T19:03:43.910717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"97'26","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393664+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:03:43.393664+0000","last_peered":"2024-04-23T19:03:43.393664+0000","last_clean":"2024-04-23T19:03:43.393664+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:03:43.393664+0000","last_undegraded":"2024-04-23T19:03:43.393664+0000","last_fullsized":"2024-04-23T19:03:43.393664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388902+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:03:43.388902+0000","last_peered":"2024-04-23T19:03:43.388902+0000","last_clean":"2024-04-23T19:03:43.388902+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:03:43.388902+0000","last_undegraded":"2024-04-23T19:03:43.388902+0000","last_fullsized":"2024-04-23T19:03:43.388902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111823+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:44.111823+0000","last_peered":"2024-04-23T19:03:44.111823+0000","last_clean":"2024-04-23T19:03:44.111823+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:44.111823+0000","last_undegraded":"2024-04-23T19:03:44.111823+0000","last_fullsized":"2024-04-23T19:03:44.111823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707890+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:03:43.707890+0000","last_peered":"2024-04-23T19:03:43.707890+0000","last_clean":"2024-04-23T19:03:43.707890+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:03:43.707890+0000","last_undegraded":"2024-04-23T19:03:43.707890+0000","last_fullsized":"2024-04-23T19:03:43.707890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392918+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392918+0000","last_peered":"2024-04-23T19:03:43.392918+0000","last_clean":"2024-04-23T19:03:43.392918+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392918+0000","last_undegraded":"2024-04-23T19:03:43.392918+0000","last_fullsized":"2024-04-23T19:03:43.392918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390352+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:03:43.390352+0000","last_peered":"2024-04-23T19:03:43.390352+0000","last_clean":"2024-04-23T19:03:43.390352+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:03:43.390352+0000","last_undegraded":"2024-04-23T19:03:43.390352+0000","last_fullsized":"2024-04-23T19:03:43.390352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393209+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:03:43.393209+0000","last_peered":"2024-04-23T19:03:43.393209+0000","last_clean":"2024-04-23T19:03:43.393209+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:03:43.393209+0000","last_undegraded":"2024-04-23T19:03:43.393209+0000","last_fullsized":"2024-04-23T19:03:43.393209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908804+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908804+0000","last_peered":"2024-04-23T19:03:43.908804+0000","last_clean":"2024-04-23T19:03:43.908804+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908804+0000","last_undegraded":"2024-04-23T19:03:43.908804+0000","last_fullsized":"2024-04-23T19:03:43.908804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392822+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:43.392822+0000","last_peered":"2024-04-23T19:03:43.392822+0000","last_clean":"2024-04-23T19:03:43.392822+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:43.392822+0000","last_undegraded":"2024-04-23T19:03:43.392822+0000","last_fullsized":"2024-04-23T19:03:43.392822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909207+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909207+0000","last_peered":"2024-04-23T19:03:43.909207+0000","last_clean":"2024-04-23T19:03:43.909207+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909207+0000","last_undegraded":"2024-04-23T19:03:43.909207+0000","last_fullsized":"2024-04-23T19:03:43.909207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114601+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114601+0000","last_peered":"2024-04-23T19:03:44.114601+0000","last_clean":"2024-04-23T19:03:44.114601+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114601+0000","last_undegraded":"2024-04-23T19:03:44.114601+0000","last_fullsized":"2024-04-23T19:03:44.114601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909065+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:03:43.909065+0000","last_peered":"2024-04-23T19:03:43.909065+0000","last_clean":"2024-04-23T19:03:43.909065+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:03:43.909065+0000","last_undegraded":"2024-04-23T19:03:43.909065+0000","last_fullsized":"2024-04-23T19:03:43.909065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"97'25","reported_seq":151,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114439+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:44.114439+0000","last_peered":"2024-04-23T19:03:44.114439+0000","last_clean":"2024-04-23T19:03:44.114439+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:44.114439+0000","last_undegraded":"2024-04-23T19:03:44.114439+0000","last_fullsized":"2024-04-23T19:03:44.114439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113085+0000","last_change":"2024-04-23T19:03:32.303428+0000","last_active":"2024-04-23T19:03:44.113085+0000","last_peered":"2024-04-23T19:03:44.113085+0000","last_clean":"2024-04-23T19:03:44.113085+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:03:44.113085+0000","last_undegraded":"2024-04-23T19:03:44.113085+0000","last_fullsized":"2024-04-23T19:03:44.113085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:39.837391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909644+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:03:43.909644+0000","last_peered":"2024-04-23T19:03:43.909644+0000","last_clean":"2024-04-23T19:03:43.909644+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:03:43.909644+0000","last_undegraded":"2024-04-23T19:03:43.909644+0000","last_fullsized":"2024-04-23T19:03:43.909644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113318+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:03:44.113318+0000","last_peered":"2024-04-23T19:03:44.113318+0000","last_clean":"2024-04-23T19:03:44.113318+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:03:44.113318+0000","last_undegraded":"2024-04-23T19:03:44.113318+0000","last_fullsized":"2024-04-23T19:03:44.113318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909653+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.909653+0000","last_peered":"2024-04-23T19:03:43.909653+0000","last_clean":"2024-04-23T19:03:43.909653+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.909653+0000","last_undegraded":"2024-04-23T19:03:43.909653+0000","last_fullsized":"2024-04-23T19:03:43.909653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115632+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115632+0000","last_peered":"2024-04-23T19:03:44.115632+0000","last_clean":"2024-04-23T19:03:44.115632+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115632+0000","last_undegraded":"2024-04-23T19:03:44.115632+0000","last_fullsized":"2024-04-23T19:03:44.115632+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:01.164433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"97'29","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707924+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:43.707924+0000","last_peered":"2024-04-23T19:03:43.707924+0000","last_clean":"2024-04-23T19:03:43.707924+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:43.707924+0000","last_undegraded":"2024-04-23T19:03:43.707924+0000","last_fullsized":"2024-04-23T19:03:43.707924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115428+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115428+0000","last_peered":"2024-04-23T19:03:44.115428+0000","last_clean":"2024-04-23T19:03:44.115428+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115428+0000","last_undegraded":"2024-04-23T19:03:44.115428+0000","last_fullsized":"2024-04-23T19:03:44.115428+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:38.798295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388809+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:03:43.388809+0000","last_peered":"2024-04-23T19:03:43.388809+0000","last_clean":"2024-04-23T19:03:43.388809+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:03:43.388809+0000","last_undegraded":"2024-04-23T19:03:43.388809+0000","last_fullsized":"2024-04-23T19:03:43.388809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389504+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:03:43.389504+0000","last_peered":"2024-04-23T19:03:43.389504+0000","last_clean":"2024-04-23T19:03:43.389504+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:03:43.389504+0000","last_undegraded":"2024-04-23T19:03:43.389504+0000","last_fullsized":"2024-04-23T19:03:43.389504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"97'17","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389148+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:43.389148+0000","last_peered":"2024-04-23T19:03:43.389148+0000","last_clean":"2024-04-23T19:03:43.389148+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:43.389148+0000","last_undegraded":"2024-04-23T19:03:43.389148+0000","last_fullsized":"2024-04-23T19:03:43.389148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114071+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:03:44.114071+0000","last_peered":"2024-04-23T19:03:44.114071+0000","last_clean":"2024-04-23T19:03:44.114071+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:03:44.114071+0000","last_undegraded":"2024-04-23T19:03:44.114071+0000","last_fullsized":"2024-04-23T19:03:44.114071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"97'21","reported_seq":149,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113224+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:44.113224+0000","last_peered":"2024-04-23T19:03:44.113224+0000","last_clean":"2024-04-23T19:03:44.113224+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:44.113224+0000","last_undegraded":"2024-04-23T19:03:44.113224+0000","last_fullsized":"2024-04-23T19:03:44.113224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392559+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392559+0000","last_peered":"2024-04-23T19:03:43.392559+0000","last_clean":"2024-04-23T19:03:43.392559+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392559+0000","last_undegraded":"2024-04-23T19:03:43.392559+0000","last_fullsized":"2024-04-23T19:03:43.392559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391726+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:43.391726+0000","last_peered":"2024-04-23T19:03:43.391726+0000","last_clean":"2024-04-23T19:03:43.391726+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:43.391726+0000","last_undegraded":"2024-04-23T19:03:43.391726+0000","last_fullsized":"2024-04-23T19:03:43.391726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911075+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:03:43.911075+0000","last_peered":"2024-04-23T19:03:43.911075+0000","last_clean":"2024-04-23T19:03:43.911075+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:03:43.911075+0000","last_undegraded":"2024-04-23T19:03:43.911075+0000","last_fullsized":"2024-04-23T19:03:43.911075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"97'34","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115162+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:44.115162+0000","last_peered":"2024-04-23T19:03:44.115162+0000","last_clean":"2024-04-23T19:03:44.115162+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:44.115162+0000","last_undegraded":"2024-04-23T19:03:44.115162+0000","last_fullsized":"2024-04-23T19:03:44.115162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:41.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389646+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:03:43.389646+0000","last_peered":"2024-04-23T19:03:43.389646+0000","last_clean":"2024-04-23T19:03:43.389646+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:03:43.389646+0000","last_undegraded":"2024-04-23T19:03:43.389646+0000","last_fullsized":"2024-04-23T19:03:43.389646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"97'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709559+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:03:43.709559+0000","last_peered":"2024-04-23T19:03:43.709559+0000","last_clean":"2024-04-23T19:03:43.709559+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:03:43.709559+0000","last_undegraded":"2024-04-23T19:03:43.709559+0000","last_fullsized":"2024-04-23T19:03:43.709559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707915+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:03:43.707915+0000","last_peered":"2024-04-23T19:03:43.707915+0000","last_clean":"2024-04-23T19:03:43.707915+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:03:43.707915+0000","last_undegraded":"2024-04-23T19:03:43.707915+0000","last_fullsized":"2024-04-23T19:03:43.707915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"96'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393204+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:43.393204+0000","last_peered":"2024-04-23T19:03:43.393204+0000","last_clean":"2024-04-23T19:03:43.393204+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:43.393204+0000","last_undegraded":"2024-04-23T19:03:43.393204+0000","last_fullsized":"2024-04-23T19:03:43.393204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114590+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:03:44.114590+0000","last_peered":"2024-04-23T19:03:44.114590+0000","last_clean":"2024-04-23T19:03:44.114590+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:03:44.114590+0000","last_undegraded":"2024-04-23T19:03:44.114590+0000","last_fullsized":"2024-04-23T19:03:44.114590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"97'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389442+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:43.389442+0000","last_peered":"2024-04-23T19:03:43.389442+0000","last_clean":"2024-04-23T19:03:43.389442+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:43.389442+0000","last_undegraded":"2024-04-23T19:03:43.389442+0000","last_fullsized":"2024-04-23T19:03:43.389442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":72,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911047+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911047+0000","last_peered":"2024-04-23T19:03:43.911047+0000","last_clean":"2024-04-23T19:03:43.911047+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911047+0000","last_undegraded":"2024-04-23T19:03:43.911047+0000","last_fullsized":"2024-04-23T19:03:43.911047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"97'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390537+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:43.390537+0000","last_peered":"2024-04-23T19:03:43.390537+0000","last_clean":"2024-04-23T19:03:43.390537+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:43.390537+0000","last_undegraded":"2024-04-23T19:03:43.390537+0000","last_fullsized":"2024-04-23T19:03:43.390537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394043+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:03:43.394043+0000","last_peered":"2024-04-23T19:03:43.394043+0000","last_clean":"2024-04-23T19:03:43.394043+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:03:43.394043+0000","last_undegraded":"2024-04-23T19:03:43.394043+0000","last_fullsized":"2024-04-23T19:03:43.394043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"97'31","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388801+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:03:43.388801+0000","last_peered":"2024-04-23T19:03:43.388801+0000","last_clean":"2024-04-23T19:03:43.388801+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:03:43.388801+0000","last_undegraded":"2024-04-23T19:03:43.388801+0000","last_fullsized":"2024-04-23T19:03:43.388801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911790+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:03:43.911790+0000","last_peered":"2024-04-23T19:03:43.911790+0000","last_clean":"2024-04-23T19:03:43.911790+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:03:43.911790+0000","last_undegraded":"2024-04-23T19:03:43.911790+0000","last_fullsized":"2024-04-23T19:03:43.911790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"97'21","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113663+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:44.113663+0000","last_peered":"2024-04-23T19:03:44.113663+0000","last_clean":"2024-04-23T19:03:44.113663+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:44.113663+0000","last_undegraded":"2024-04-23T19:03:44.113663+0000","last_fullsized":"2024-04-23T19:03:44.113663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113841+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113841+0000","last_peered":"2024-04-23T19:03:44.113841+0000","last_clean":"2024-04-23T19:03:44.113841+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113841+0000","last_undegraded":"2024-04-23T19:03:44.113841+0000","last_fullsized":"2024-04-23T19:03:44.113841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708932+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:03:43.708932+0000","last_peered":"2024-04-23T19:03:43.708932+0000","last_clean":"2024-04-23T19:03:43.708932+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:03:43.708932+0000","last_undegraded":"2024-04-23T19:03:43.708932+0000","last_fullsized":"2024-04-23T19:03:43.708932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112309+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:03:44.112309+0000","last_peered":"2024-04-23T19:03:44.112309+0000","last_clean":"2024-04-23T19:03:44.112309+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:03:44.112309+0000","last_undegraded":"2024-04-23T19:03:44.112309+0000","last_fullsized":"2024-04-23T19:03:44.112309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115562+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:03:44.115562+0000","last_peered":"2024-04-23T19:03:44.115562+0000","last_clean":"2024-04-23T19:03:44.115562+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:03:44.115562+0000","last_undegraded":"2024-04-23T19:03:44.115562+0000","last_fullsized":"2024-04-23T19:03:44.115562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389396+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:03:43.389396+0000","last_peered":"2024-04-23T19:03:43.389396+0000","last_clean":"2024-04-23T19:03:43.389396+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:03:43.389396+0000","last_undegraded":"2024-04-23T19:03:43.389396+0000","last_fullsized":"2024-04-23T19:03:43.389396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"97'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394522+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:03:43.394522+0000","last_peered":"2024-04-23T19:03:43.394522+0000","last_clean":"2024-04-23T19:03:43.394522+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:03:43.394522+0000","last_undegraded":"2024-04-23T19:03:43.394522+0000","last_fullsized":"2024-04-23T19:03:43.394522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113173+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:03:44.113173+0000","last_peered":"2024-04-23T19:03:44.113173+0000","last_clean":"2024-04-23T19:03:44.113173+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:03:44.113173+0000","last_undegraded":"2024-04-23T19:03:44.113173+0000","last_fullsized":"2024-04-23T19:03:44.113173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"97'28","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393916+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:03:43.393916+0000","last_peered":"2024-04-23T19:03:43.393916+0000","last_clean":"2024-04-23T19:03:43.393916+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:03:43.393916+0000","last_undegraded":"2024-04-23T19:03:43.393916+0000","last_fullsized":"2024-04-23T19:03:43.393916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388784+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:43.388784+0000","last_peered":"2024-04-23T19:03:43.388784+0000","last_clean":"2024-04-23T19:03:43.388784+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:43.388784+0000","last_undegraded":"2024-04-23T19:03:43.388784+0000","last_fullsized":"2024-04-23T19:03:43.388784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114539+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:03:44.114539+0000","last_peered":"2024-04-23T19:03:44.114539+0000","last_clean":"2024-04-23T19:03:44.114539+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:03:44.114539+0000","last_undegraded":"2024-04-23T19:03:44.114539+0000","last_fullsized":"2024-04-23T19:03:44.114539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"97'28","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112893+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:44.112893+0000","last_peered":"2024-04-23T19:03:44.112893+0000","last_clean":"2024-04-23T19:03:44.112893+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:44.112893+0000","last_undegraded":"2024-04-23T19:03:44.112893+0000","last_fullsized":"2024-04-23T19:03:44.112893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:40.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390065+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:03:43.390065+0000","last_peered":"2024-04-23T19:03:43.390065+0000","last_clean":"2024-04-23T19:03:43.390065+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:03:43.390065+0000","last_undegraded":"2024-04-23T19:03:43.390065+0000","last_fullsized":"2024-04-23T19:03:43.390065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1072,"ondisk_log_size":1072,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386917,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":610,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1804692,"kb_used_data":1773508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92567148,"statfs":{"total":96636764160,"available":94788759552,"internally_reserved":0,"allocated":1816072192,"data_stored":1815436691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1197888,"kb_used_data":1166700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93173952,"statfs":{"total":96636764160,"available":95410126848,"internally_reserved":0,"allocated":1194700800,"data_stored":1194095951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693896,"kb_used_data":1658552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677944,"statfs":{"total":96636764160,"available":94902214656,"internally_reserved":0,"allocated":1698357248,"data_stored":1697703170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898268,"kb_used_data":1867084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473572,"statfs":{"total":96636764160,"available":94692937728,"internally_reserved":0,"allocated":1911894016,"data_stored":1911312036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1998852,"kb_used_data":1967668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92372988,"statfs":{"total":96636764160,"available":94589939712,"internally_reserved":0,"allocated":2014892032,"data_stored":2014257594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073000,"kb_used_data":1041812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93298840,"statfs":{"total":96636764160,"available":95538012160,"internally_reserved":0,"allocated":1066815488,"data_stored":1066225345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105968,"kb_used_data":1070624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93265872,"statfs":{"total":96636764160,"available":95504252928,"internally_reserved":0,"allocated":1096318976,"data_stored":1095696287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806780,"kb_used_data":1771436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92565060,"statfs":{"total":96636764160,"available":94786621440,"internally_reserved":0,"allocated":1813950464,"data_stored":1813338376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1811939328,"data_stored":1811939328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1094713344,"data_stored":1094713344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1065353216,"data_stored":1065353216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2013265920,"data_stored":2013265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1193279488,"data_stored":1193279488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814036480,"data_stored":1814036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":175817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":177182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":292907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:03:48.041 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:03:48.411 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:48.417 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:03:48.431 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-23T19:03:48.002230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823909,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3286,"num_read_kb":2969,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3890,"ondisk_log_size":3890,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12579408,"kb_used_data":12317432,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":742395312,"statfs":{"total":773094113280,"available":760212799488,"internally_reserved":0,"allocated":12613050368,"data_stored":12608096842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.647813"},"pg_stats":[{"pgid":"3.3f","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114847+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:03:44.114847+0000","last_peered":"2024-04-23T19:03:44.114847+0000","last_clean":"2024-04-23T19:03:44.114847+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:03:44.114847+0000","last_undegraded":"2024-04-23T19:03:44.114847+0000","last_fullsized":"2024-04-23T19:03:44.114847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387932+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:03:43.387932+0000","last_peered":"2024-04-23T19:03:43.387932+0000","last_clean":"2024-04-23T19:03:43.387932+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:03:43.387932+0000","last_undegraded":"2024-04-23T19:03:43.387932+0000","last_fullsized":"2024-04-23T19:03:43.387932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"97'24","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115512+0000","last_change":"2024-04-23T19:03:32.293577+0000","last_active":"2024-04-23T19:03:44.115512+0000","last_peered":"2024-04-23T19:03:44.115512+0000","last_clean":"2024-04-23T19:03:44.115512+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:03:44.115512+0000","last_undegraded":"2024-04-23T19:03:44.115512+0000","last_fullsized":"2024-04-23T19:03:44.115512+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:33.579201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113300+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:03:44.113300+0000","last_peered":"2024-04-23T19:03:44.113300+0000","last_clean":"2024-04-23T19:03:44.113300+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:03:44.113300+0000","last_undegraded":"2024-04-23T19:03:44.113300+0000","last_fullsized":"2024-04-23T19:03:44.113300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'29","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114019+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:44.114019+0000","last_peered":"2024-04-23T19:03:44.114019+0000","last_clean":"2024-04-23T19:03:44.114019+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:44.114019+0000","last_undegraded":"2024-04-23T19:03:44.114019+0000","last_fullsized":"2024-04-23T19:03:44.114019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910402+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:03:43.910402+0000","last_peered":"2024-04-23T19:03:43.910402+0000","last_clean":"2024-04-23T19:03:43.910402+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:03:43.910402+0000","last_undegraded":"2024-04-23T19:03:43.910402+0000","last_fullsized":"2024-04-23T19:03:43.910402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389189+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:03:43.389189+0000","last_peered":"2024-04-23T19:03:43.389189+0000","last_clean":"2024-04-23T19:03:43.389189+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:03:43.389189+0000","last_undegraded":"2024-04-23T19:03:43.389189+0000","last_fullsized":"2024-04-23T19:03:43.389189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113499+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113499+0000","last_peered":"2024-04-23T19:03:44.113499+0000","last_clean":"2024-04-23T19:03:44.113499+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113499+0000","last_undegraded":"2024-04-23T19:03:44.113499+0000","last_fullsized":"2024-04-23T19:03:44.113499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114187+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:44.114187+0000","last_peered":"2024-04-23T19:03:44.114187+0000","last_clean":"2024-04-23T19:03:44.114187+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:44.114187+0000","last_undegraded":"2024-04-23T19:03:44.114187+0000","last_fullsized":"2024-04-23T19:03:44.114187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708709+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:03:43.708709+0000","last_peered":"2024-04-23T19:03:43.708709+0000","last_clean":"2024-04-23T19:03:43.708709+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:03:43.708709+0000","last_undegraded":"2024-04-23T19:03:43.708709+0000","last_fullsized":"2024-04-23T19:03:43.708709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"97'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388451+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:03:43.388451+0000","last_peered":"2024-04-23T19:03:43.388451+0000","last_clean":"2024-04-23T19:03:43.388451+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:03:43.388451+0000","last_undegraded":"2024-04-23T19:03:43.388451+0000","last_fullsized":"2024-04-23T19:03:43.388451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910574+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:03:43.910574+0000","last_peered":"2024-04-23T19:03:43.910574+0000","last_clean":"2024-04-23T19:03:43.910574+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:03:43.910574+0000","last_undegraded":"2024-04-23T19:03:43.910574+0000","last_fullsized":"2024-04-23T19:03:43.910574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"97'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113605+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:44.113605+0000","last_peered":"2024-04-23T19:03:44.113605+0000","last_clean":"2024-04-23T19:03:44.113605+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:44.113605+0000","last_undegraded":"2024-04-23T19:03:44.113605+0000","last_fullsized":"2024-04-23T19:03:44.113605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389716+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:03:43.389716+0000","last_peered":"2024-04-23T19:03:43.389716+0000","last_clean":"2024-04-23T19:03:43.389716+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:03:43.389716+0000","last_undegraded":"2024-04-23T19:03:43.389716+0000","last_fullsized":"2024-04-23T19:03:43.389716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391449+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:43.391449+0000","last_peered":"2024-04-23T19:03:43.391449+0000","last_clean":"2024-04-23T19:03:43.391449+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:43.391449+0000","last_undegraded":"2024-04-23T19:03:43.391449+0000","last_fullsized":"2024-04-23T19:03:43.391449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394333+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:03:43.394333+0000","last_peered":"2024-04-23T19:03:43.394333+0000","last_clean":"2024-04-23T19:03:43.394333+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:03:43.394333+0000","last_undegraded":"2024-04-23T19:03:43.394333+0000","last_fullsized":"2024-04-23T19:03:43.394333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909061+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909061+0000","last_peered":"2024-04-23T19:03:43.909061+0000","last_clean":"2024-04-23T19:03:43.909061+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909061+0000","last_undegraded":"2024-04-23T19:03:43.909061+0000","last_fullsized":"2024-04-23T19:03:43.909061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"96'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114901+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:03:44.114901+0000","last_peered":"2024-04-23T19:03:44.114901+0000","last_clean":"2024-04-23T19:03:44.114901+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:03:44.114901+0000","last_undegraded":"2024-04-23T19:03:44.114901+0000","last_fullsized":"2024-04-23T19:03:44.114901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113766+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:03:44.113766+0000","last_peered":"2024-04-23T19:03:44.113766+0000","last_clean":"2024-04-23T19:03:44.113766+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:03:44.113766+0000","last_undegraded":"2024-04-23T19:03:44.113766+0000","last_fullsized":"2024-04-23T19:03:44.113766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709366+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:03:43.709366+0000","last_peered":"2024-04-23T19:03:43.709366+0000","last_clean":"2024-04-23T19:03:43.709366+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:03:43.709366+0000","last_undegraded":"2024-04-23T19:03:43.709366+0000","last_fullsized":"2024-04-23T19:03:43.709366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388767+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:03:43.388767+0000","last_peered":"2024-04-23T19:03:43.388767+0000","last_clean":"2024-04-23T19:03:43.388767+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:03:43.388767+0000","last_undegraded":"2024-04-23T19:03:43.388767+0000","last_fullsized":"2024-04-23T19:03:43.388767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709535+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:03:43.709535+0000","last_peered":"2024-04-23T19:03:43.709535+0000","last_clean":"2024-04-23T19:03:43.709535+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:03:43.709535+0000","last_undegraded":"2024-04-23T19:03:43.709535+0000","last_fullsized":"2024-04-23T19:03:43.709535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394020+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:03:43.394020+0000","last_peered":"2024-04-23T19:03:43.394020+0000","last_clean":"2024-04-23T19:03:43.394020+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:03:43.394020+0000","last_undegraded":"2024-04-23T19:03:43.394020+0000","last_fullsized":"2024-04-23T19:03:43.394020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"97'16","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910749+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:43.910749+0000","last_peered":"2024-04-23T19:03:43.910749+0000","last_clean":"2024-04-23T19:03:43.910749+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:43.910749+0000","last_undegraded":"2024-04-23T19:03:43.910749+0000","last_fullsized":"2024-04-23T19:03:43.910749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393743+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:03:43.393743+0000","last_peered":"2024-04-23T19:03:43.393743+0000","last_clean":"2024-04-23T19:03:43.393743+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:03:43.393743+0000","last_undegraded":"2024-04-23T19:03:43.393743+0000","last_fullsized":"2024-04-23T19:03:43.393743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"97'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392095+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:43.392095+0000","last_peered":"2024-04-23T19:03:43.392095+0000","last_clean":"2024-04-23T19:03:43.392095+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:43.392095+0000","last_undegraded":"2024-04-23T19:03:43.392095+0000","last_fullsized":"2024-04-23T19:03:43.392095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910786+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:03:43.910786+0000","last_peered":"2024-04-23T19:03:43.910786+0000","last_clean":"2024-04-23T19:03:43.910786+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:03:43.910786+0000","last_undegraded":"2024-04-23T19:03:43.910786+0000","last_fullsized":"2024-04-23T19:03:43.910786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112591+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:44.112591+0000","last_peered":"2024-04-23T19:03:44.112591+0000","last_clean":"2024-04-23T19:03:44.112591+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:44.112591+0000","last_undegraded":"2024-04-23T19:03:44.112591+0000","last_fullsized":"2024-04-23T19:03:44.112591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908784+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908784+0000","last_peered":"2024-04-23T19:03:43.908784+0000","last_clean":"2024-04-23T19:03:43.908784+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908784+0000","last_undegraded":"2024-04-23T19:03:43.908784+0000","last_fullsized":"2024-04-23T19:03:43.908784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391510+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:03:43.391510+0000","last_peered":"2024-04-23T19:03:43.391510+0000","last_clean":"2024-04-23T19:03:43.391510+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:03:43.391510+0000","last_undegraded":"2024-04-23T19:03:43.391510+0000","last_fullsized":"2024-04-23T19:03:43.391510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'24","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393870+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:03:43.393870+0000","last_peered":"2024-04-23T19:03:43.393870+0000","last_clean":"2024-04-23T19:03:43.393870+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:03:43.393870+0000","last_undegraded":"2024-04-23T19:03:43.393870+0000","last_fullsized":"2024-04-23T19:03:43.393870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389567+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:03:43.389567+0000","last_peered":"2024-04-23T19:03:43.389567+0000","last_clean":"2024-04-23T19:03:43.389567+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:03:43.389567+0000","last_undegraded":"2024-04-23T19:03:43.389567+0000","last_fullsized":"2024-04-23T19:03:43.389567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'19","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113502+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:44.113502+0000","last_peered":"2024-04-23T19:03:44.113502+0000","last_clean":"2024-04-23T19:03:44.113502+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:44.113502+0000","last_undegraded":"2024-04-23T19:03:44.113502+0000","last_fullsized":"2024-04-23T19:03:44.113502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114445+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114445+0000","last_peered":"2024-04-23T19:03:44.114445+0000","last_clean":"2024-04-23T19:03:44.114445+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114445+0000","last_undegraded":"2024-04-23T19:03:44.114445+0000","last_fullsized":"2024-04-23T19:03:44.114445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387854+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.387854+0000","last_peered":"2024-04-23T19:03:43.387854+0000","last_clean":"2024-04-23T19:03:43.387854+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.387854+0000","last_undegraded":"2024-04-23T19:03:43.387854+0000","last_fullsized":"2024-04-23T19:03:43.387854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390204+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:03:43.390204+0000","last_peered":"2024-04-23T19:03:43.390204+0000","last_clean":"2024-04-23T19:03:43.390204+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:03:43.390204+0000","last_undegraded":"2024-04-23T19:03:43.390204+0000","last_fullsized":"2024-04-23T19:03:43.390204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"97'31","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112702+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:44.112702+0000","last_peered":"2024-04-23T19:03:44.112702+0000","last_clean":"2024-04-23T19:03:44.112702+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:44.112702+0000","last_undegraded":"2024-04-23T19:03:44.112702+0000","last_fullsized":"2024-04-23T19:03:44.112702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391268+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391268+0000","last_peered":"2024-04-23T19:03:43.391268+0000","last_clean":"2024-04-23T19:03:43.391268+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391268+0000","last_undegraded":"2024-04-23T19:03:43.391268+0000","last_fullsized":"2024-04-23T19:03:43.391268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911442+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:03:43.911442+0000","last_peered":"2024-04-23T19:03:43.911442+0000","last_clean":"2024-04-23T19:03:43.911442+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:03:43.911442+0000","last_undegraded":"2024-04-23T19:03:43.911442+0000","last_fullsized":"2024-04-23T19:03:43.911442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910291+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910291+0000","last_peered":"2024-04-23T19:03:43.910291+0000","last_clean":"2024-04-23T19:03:43.910291+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910291+0000","last_undegraded":"2024-04-23T19:03:43.910291+0000","last_fullsized":"2024-04-23T19:03:43.910291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112392+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:03:44.112392+0000","last_peered":"2024-04-23T19:03:44.112392+0000","last_clean":"2024-04-23T19:03:44.112392+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:03:44.112392+0000","last_undegraded":"2024-04-23T19:03:44.112392+0000","last_fullsized":"2024-04-23T19:03:44.112392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114249+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:03:44.114249+0000","last_peered":"2024-04-23T19:03:44.114249+0000","last_clean":"2024-04-23T19:03:44.114249+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:03:44.114249+0000","last_undegraded":"2024-04-23T19:03:44.114249+0000","last_fullsized":"2024-04-23T19:03:44.114249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113863+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:44.113863+0000","last_peered":"2024-04-23T19:03:44.113863+0000","last_clean":"2024-04-23T19:03:44.113863+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:44.113863+0000","last_undegraded":"2024-04-23T19:03:44.113863+0000","last_fullsized":"2024-04-23T19:03:44.113863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393525+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:03:43.393525+0000","last_peered":"2024-04-23T19:03:43.393525+0000","last_clean":"2024-04-23T19:03:43.393525+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:03:43.393525+0000","last_undegraded":"2024-04-23T19:03:43.393525+0000","last_fullsized":"2024-04-23T19:03:43.393525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393562+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:03:43.393562+0000","last_peered":"2024-04-23T19:03:43.393562+0000","last_clean":"2024-04-23T19:03:43.393562+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:03:43.393562+0000","last_undegraded":"2024-04-23T19:03:43.393562+0000","last_fullsized":"2024-04-23T19:03:43.393562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"98'134","reported_seq":358,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114276+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:44.114276+0000","last_peered":"2024-04-23T19:03:44.114276+0000","last_clean":"2024-04-23T19:03:44.114276+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:44.114276+0000","last_undegraded":"2024-04-23T19:03:44.114276+0000","last_fullsized":"2024-04-23T19:03:44.114276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909665+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909665+0000","last_peered":"2024-04-23T19:03:43.909665+0000","last_clean":"2024-04-23T19:03:43.909665+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909665+0000","last_undegraded":"2024-04-23T19:03:43.909665+0000","last_fullsized":"2024-04-23T19:03:43.909665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393124+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:03:43.393124+0000","last_peered":"2024-04-23T19:03:43.393124+0000","last_clean":"2024-04-23T19:03:43.393124+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:03:43.393124+0000","last_undegraded":"2024-04-23T19:03:43.393124+0000","last_fullsized":"2024-04-23T19:03:43.393124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"97'24","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708227+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:03:43.708227+0000","last_peered":"2024-04-23T19:03:43.708227+0000","last_clean":"2024-04-23T19:03:43.708227+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:03:43.708227+0000","last_undegraded":"2024-04-23T19:03:43.708227+0000","last_fullsized":"2024-04-23T19:03:43.708227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389457+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:03:43.389457+0000","last_peered":"2024-04-23T19:03:43.389457+0000","last_clean":"2024-04-23T19:03:43.389457+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:03:43.389457+0000","last_undegraded":"2024-04-23T19:03:43.389457+0000","last_fullsized":"2024-04-23T19:03:43.389457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114533+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:03:44.114533+0000","last_peered":"2024-04-23T19:03:44.114533+0000","last_clean":"2024-04-23T19:03:44.114533+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:03:44.114533+0000","last_undegraded":"2024-04-23T19:03:44.114533+0000","last_fullsized":"2024-04-23T19:03:44.114533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"98'134","reported_seq":360,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390887+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:03:43.390887+0000","last_peered":"2024-04-23T19:03:43.390887+0000","last_clean":"2024-04-23T19:03:43.390887+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:03:43.390887+0000","last_undegraded":"2024-04-23T19:03:43.390887+0000","last_fullsized":"2024-04-23T19:03:43.390887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388486+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:03:43.388486+0000","last_peered":"2024-04-23T19:03:43.388486+0000","last_clean":"2024-04-23T19:03:43.388486+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:03:43.388486+0000","last_undegraded":"2024-04-23T19:03:43.388486+0000","last_fullsized":"2024-04-23T19:03:43.388486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115034+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:03:44.115034+0000","last_peered":"2024-04-23T19:03:44.115034+0000","last_clean":"2024-04-23T19:03:44.115034+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:03:44.115034+0000","last_undegraded":"2024-04-23T19:03:44.115034+0000","last_fullsized":"2024-04-23T19:03:44.115034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112930+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:03:44.112930+0000","last_peered":"2024-04-23T19:03:44.112930+0000","last_clean":"2024-04-23T19:03:44.112930+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:03:44.112930+0000","last_undegraded":"2024-04-23T19:03:44.112930+0000","last_fullsized":"2024-04-23T19:03:44.112930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388052+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:03:43.388052+0000","last_peered":"2024-04-23T19:03:43.388052+0000","last_clean":"2024-04-23T19:03:43.388052+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:03:43.388052+0000","last_undegraded":"2024-04-23T19:03:43.388052+0000","last_fullsized":"2024-04-23T19:03:43.388052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113425+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:03:44.113425+0000","last_peered":"2024-04-23T19:03:44.113425+0000","last_clean":"2024-04-23T19:03:44.113425+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:03:44.113425+0000","last_undegraded":"2024-04-23T19:03:44.113425+0000","last_fullsized":"2024-04-23T19:03:44.113425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388724+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388724+0000","last_peered":"2024-04-23T19:03:43.388724+0000","last_clean":"2024-04-23T19:03:43.388724+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388724+0000","last_undegraded":"2024-04-23T19:03:43.388724+0000","last_fullsized":"2024-04-23T19:03:43.388724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909389+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909389+0000","last_peered":"2024-04-23T19:03:43.909389+0000","last_clean":"2024-04-23T19:03:43.909389+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909389+0000","last_undegraded":"2024-04-23T19:03:43.909389+0000","last_fullsized":"2024-04-23T19:03:43.909389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'31","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115277+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:44.115277+0000","last_peered":"2024-04-23T19:03:44.115277+0000","last_clean":"2024-04-23T19:03:44.115277+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:44.115277+0000","last_undegraded":"2024-04-23T19:03:44.115277+0000","last_fullsized":"2024-04-23T19:03:44.115277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388320+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:03:43.388320+0000","last_peered":"2024-04-23T19:03:43.388320+0000","last_clean":"2024-04-23T19:03:43.388320+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:03:43.388320+0000","last_undegraded":"2024-04-23T19:03:43.388320+0000","last_fullsized":"2024-04-23T19:03:43.388320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392626+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:03:43.392626+0000","last_peered":"2024-04-23T19:03:43.392626+0000","last_clean":"2024-04-23T19:03:43.392626+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:03:43.392626+0000","last_undegraded":"2024-04-23T19:03:43.392626+0000","last_fullsized":"2024-04-23T19:03:43.392626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390803+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:03:43.390803+0000","last_peered":"2024-04-23T19:03:43.390803+0000","last_clean":"2024-04-23T19:03:43.390803+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:03:43.390803+0000","last_undegraded":"2024-04-23T19:03:43.390803+0000","last_fullsized":"2024-04-23T19:03:43.390803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708652+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708652+0000","last_peered":"2024-04-23T19:03:43.708652+0000","last_clean":"2024-04-23T19:03:43.708652+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708652+0000","last_undegraded":"2024-04-23T19:03:43.708652+0000","last_fullsized":"2024-04-23T19:03:43.708652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708882+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:03:43.708882+0000","last_peered":"2024-04-23T19:03:43.708882+0000","last_clean":"2024-04-23T19:03:43.708882+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:03:43.708882+0000","last_undegraded":"2024-04-23T19:03:43.708882+0000","last_fullsized":"2024-04-23T19:03:43.708882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"97'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115464+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:03:44.115464+0000","last_peered":"2024-04-23T19:03:44.115464+0000","last_clean":"2024-04-23T19:03:44.115464+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:03:44.115464+0000","last_undegraded":"2024-04-23T19:03:44.115464+0000","last_fullsized":"2024-04-23T19:03:44.115464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394271+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:03:43.394271+0000","last_peered":"2024-04-23T19:03:43.394271+0000","last_clean":"2024-04-23T19:03:43.394271+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:03:43.394271+0000","last_undegraded":"2024-04-23T19:03:43.394271+0000","last_fullsized":"2024-04-23T19:03:43.394271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'23","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113515+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:03:44.113515+0000","last_peered":"2024-04-23T19:03:44.113515+0000","last_clean":"2024-04-23T19:03:44.113515+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:03:44.113515+0000","last_undegraded":"2024-04-23T19:03:44.113515+0000","last_fullsized":"2024-04-23T19:03:44.113515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"98'134","reported_seq":360,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112664+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:03:44.112664+0000","last_peered":"2024-04-23T19:03:44.112664+0000","last_clean":"2024-04-23T19:03:44.112664+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:03:44.112664+0000","last_undegraded":"2024-04-23T19:03:44.112664+0000","last_fullsized":"2024-04-23T19:03:44.112664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113763+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:03:44.113763+0000","last_peered":"2024-04-23T19:03:44.113763+0000","last_clean":"2024-04-23T19:03:44.113763+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:44.113763+0000","last_undegraded":"2024-04-23T19:03:44.113763+0000","last_fullsized":"2024-04-23T19:03:44.113763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113964+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.113964+0000","last_peered":"2024-04-23T19:03:44.113964+0000","last_clean":"2024-04-23T19:03:44.113964+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.113964+0000","last_undegraded":"2024-04-23T19:03:44.113964+0000","last_fullsized":"2024-04-23T19:03:44.113964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389851+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:43.389851+0000","last_peered":"2024-04-23T19:03:43.389851+0000","last_clean":"2024-04-23T19:03:43.389851+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:43.389851+0000","last_undegraded":"2024-04-23T19:03:43.389851+0000","last_fullsized":"2024-04-23T19:03:43.389851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393360+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:03:43.393360+0000","last_peered":"2024-04-23T19:03:43.393360+0000","last_clean":"2024-04-23T19:03:43.393360+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:03:43.393360+0000","last_undegraded":"2024-04-23T19:03:43.393360+0000","last_fullsized":"2024-04-23T19:03:43.393360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'30","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112891+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:03:44.112891+0000","last_peered":"2024-04-23T19:03:44.112891+0000","last_clean":"2024-04-23T19:03:44.112891+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:03:44.112891+0000","last_undegraded":"2024-04-23T19:03:44.112891+0000","last_fullsized":"2024-04-23T19:03:44.112891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389128+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:03:43.389128+0000","last_peered":"2024-04-23T19:03:43.389128+0000","last_clean":"2024-04-23T19:03:43.389128+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:03:43.389128+0000","last_undegraded":"2024-04-23T19:03:43.389128+0000","last_fullsized":"2024-04-23T19:03:43.389128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'8","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115520+0000","last_change":"2024-04-23T19:03:32.295412+0000","last_active":"2024-04-23T19:03:44.115520+0000","last_peered":"2024-04-23T19:03:44.115520+0000","last_clean":"2024-04-23T19:03:44.115520+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:03:44.115520+0000","last_undegraded":"2024-04-23T19:03:44.115520+0000","last_fullsized":"2024-04-23T19:03:44.115520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:38.660742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911690+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:03:43.911690+0000","last_peered":"2024-04-23T19:03:43.911690+0000","last_clean":"2024-04-23T19:03:43.911690+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:03:43.911690+0000","last_undegraded":"2024-04-23T19:03:43.911690+0000","last_fullsized":"2024-04-23T19:03:43.911690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391669+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:43.391669+0000","last_peered":"2024-04-23T19:03:43.391669+0000","last_clean":"2024-04-23T19:03:43.391669+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:43.391669+0000","last_undegraded":"2024-04-23T19:03:43.391669+0000","last_fullsized":"2024-04-23T19:03:43.391669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393878+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:03:43.393878+0000","last_peered":"2024-04-23T19:03:43.393878+0000","last_clean":"2024-04-23T19:03:43.393878+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:03:43.393878+0000","last_undegraded":"2024-04-23T19:03:43.393878+0000","last_fullsized":"2024-04-23T19:03:43.393878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910655+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:03:43.910655+0000","last_peered":"2024-04-23T19:03:43.910655+0000","last_clean":"2024-04-23T19:03:43.910655+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:03:43.910655+0000","last_undegraded":"2024-04-23T19:03:43.910655+0000","last_fullsized":"2024-04-23T19:03:43.910655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114514+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114514+0000","last_peered":"2024-04-23T19:03:44.114514+0000","last_clean":"2024-04-23T19:03:44.114514+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114514+0000","last_undegraded":"2024-04-23T19:03:44.114514+0000","last_fullsized":"2024-04-23T19:03:44.114514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388173+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388173+0000","last_peered":"2024-04-23T19:03:43.388173+0000","last_clean":"2024-04-23T19:03:43.388173+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388173+0000","last_undegraded":"2024-04-23T19:03:43.388173+0000","last_fullsized":"2024-04-23T19:03:43.388173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911045+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:03:43.911045+0000","last_peered":"2024-04-23T19:03:43.911045+0000","last_clean":"2024-04-23T19:03:43.911045+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:03:43.911045+0000","last_undegraded":"2024-04-23T19:03:43.911045+0000","last_fullsized":"2024-04-23T19:03:43.911045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709068+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:03:43.709068+0000","last_peered":"2024-04-23T19:03:43.709068+0000","last_clean":"2024-04-23T19:03:43.709068+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:03:43.709068+0000","last_undegraded":"2024-04-23T19:03:43.709068+0000","last_fullsized":"2024-04-23T19:03:43.709068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113707+0000","last_change":"2024-04-23T19:03:32.296246+0000","last_active":"2024-04-23T19:03:44.113707+0000","last_peered":"2024-04-23T19:03:44.113707+0000","last_clean":"2024-04-23T19:03:44.113707+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:03:44.113707+0000","last_undegraded":"2024-04-23T19:03:44.113707+0000","last_fullsized":"2024-04-23T19:03:44.113707+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:48.818498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394174+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:03:43.394174+0000","last_peered":"2024-04-23T19:03:43.394174+0000","last_clean":"2024-04-23T19:03:43.394174+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:03:43.394174+0000","last_undegraded":"2024-04-23T19:03:43.394174+0000","last_fullsized":"2024-04-23T19:03:43.394174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"98'134","reported_seq":375,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393906+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:03:43.393906+0000","last_peered":"2024-04-23T19:03:43.393906+0000","last_clean":"2024-04-23T19:03:43.393906+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:03:43.393906+0000","last_undegraded":"2024-04-23T19:03:43.393906+0000","last_fullsized":"2024-04-23T19:03:43.393906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":154,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112679+0000","last_change":"2024-04-23T19:03:32.290672+0000","last_active":"2024-04-23T19:03:44.112679+0000","last_peered":"2024-04-23T19:03:44.112679+0000","last_clean":"2024-04-23T19:03:44.112679+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:03:44.112679+0000","last_undegraded":"2024-04-23T19:03:44.112679+0000","last_fullsized":"2024-04-23T19:03:44.112679+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:19.410020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911686+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:03:43.911686+0000","last_peered":"2024-04-23T19:03:43.911686+0000","last_clean":"2024-04-23T19:03:43.911686+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:03:43.911686+0000","last_undegraded":"2024-04-23T19:03:43.911686+0000","last_fullsized":"2024-04-23T19:03:43.911686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910029+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:43.910029+0000","last_peered":"2024-04-23T19:03:43.910029+0000","last_clean":"2024-04-23T19:03:43.910029+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:43.910029+0000","last_undegraded":"2024-04-23T19:03:43.910029+0000","last_fullsized":"2024-04-23T19:03:43.910029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390002+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:03:43.390002+0000","last_peered":"2024-04-23T19:03:43.390002+0000","last_clean":"2024-04-23T19:03:43.390002+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:03:43.390002+0000","last_undegraded":"2024-04-23T19:03:43.390002+0000","last_fullsized":"2024-04-23T19:03:43.390002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"98'12","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390965+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:03:43.390965+0000","last_peered":"2024-04-23T19:03:43.390965+0000","last_clean":"2024-04-23T19:03:43.390965+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:03:43.390965+0000","last_undegraded":"2024-04-23T19:03:43.390965+0000","last_fullsized":"2024-04-23T19:03:43.390965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"98'134","reported_seq":406,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709033+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:03:43.709033+0000","last_peered":"2024-04-23T19:03:43.709033+0000","last_clean":"2024-04-23T19:03:43.709033+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:03:43.709033+0000","last_undegraded":"2024-04-23T19:03:43.709033+0000","last_fullsized":"2024-04-23T19:03:43.709033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910131+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910131+0000","last_peered":"2024-04-23T19:03:43.910131+0000","last_clean":"2024-04-23T19:03:43.910131+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910131+0000","last_undegraded":"2024-04-23T19:03:43.910131+0000","last_fullsized":"2024-04-23T19:03:43.910131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115660+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:03:44.115660+0000","last_peered":"2024-04-23T19:03:44.115660+0000","last_clean":"2024-04-23T19:03:44.115660+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:03:44.115660+0000","last_undegraded":"2024-04-23T19:03:44.115660+0000","last_fullsized":"2024-04-23T19:03:44.115660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391592+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:43.391592+0000","last_peered":"2024-04-23T19:03:43.391592+0000","last_clean":"2024-04-23T19:03:43.391592+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:43.391592+0000","last_undegraded":"2024-04-23T19:03:43.391592+0000","last_fullsized":"2024-04-23T19:03:43.391592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910950+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:03:43.910950+0000","last_peered":"2024-04-23T19:03:43.910950+0000","last_clean":"2024-04-23T19:03:43.910950+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:03:43.910950+0000","last_undegraded":"2024-04-23T19:03:43.910950+0000","last_fullsized":"2024-04-23T19:03:43.910950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'26","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389169+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:43.389169+0000","last_peered":"2024-04-23T19:03:43.389169+0000","last_clean":"2024-04-23T19:03:43.389169+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:43.389169+0000","last_undegraded":"2024-04-23T19:03:43.389169+0000","last_fullsized":"2024-04-23T19:03:43.389169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708197+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:03:43.708197+0000","last_peered":"2024-04-23T19:03:43.708197+0000","last_clean":"2024-04-23T19:03:43.708197+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:03:43.708197+0000","last_undegraded":"2024-04-23T19:03:43.708197+0000","last_fullsized":"2024-04-23T19:03:43.708197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113320+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113320+0000","last_peered":"2024-04-23T19:03:44.113320+0000","last_clean":"2024-04-23T19:03:44.113320+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113320+0000","last_undegraded":"2024-04-23T19:03:44.113320+0000","last_fullsized":"2024-04-23T19:03:44.113320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:09.210430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709271+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:03:43.709271+0000","last_peered":"2024-04-23T19:03:43.709271+0000","last_clean":"2024-04-23T19:03:43.709271+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:03:43.709271+0000","last_undegraded":"2024-04-23T19:03:43.709271+0000","last_fullsized":"2024-04-23T19:03:43.709271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113725+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:03:44.113725+0000","last_peered":"2024-04-23T19:03:44.113725+0000","last_clean":"2024-04-23T19:03:44.113725+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:03:44.113725+0000","last_undegraded":"2024-04-23T19:03:44.113725+0000","last_fullsized":"2024-04-23T19:03:44.113725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389218+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:03:43.389218+0000","last_peered":"2024-04-23T19:03:43.389218+0000","last_clean":"2024-04-23T19:03:43.389218+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:03:43.389218+0000","last_undegraded":"2024-04-23T19:03:43.389218+0000","last_fullsized":"2024-04-23T19:03:43.389218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391341+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:43.391341+0000","last_peered":"2024-04-23T19:03:43.391341+0000","last_clean":"2024-04-23T19:03:43.391341+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:43.391341+0000","last_undegraded":"2024-04-23T19:03:43.391341+0000","last_fullsized":"2024-04-23T19:03:43.391341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114228+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:03:44.114228+0000","last_peered":"2024-04-23T19:03:44.114228+0000","last_clean":"2024-04-23T19:03:44.114228+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:03:44.114228+0000","last_undegraded":"2024-04-23T19:03:44.114228+0000","last_fullsized":"2024-04-23T19:03:44.114228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'39","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390341+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:03:43.390341+0000","last_peered":"2024-04-23T19:03:43.390341+0000","last_clean":"2024-04-23T19:03:43.390341+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:03:43.390341+0000","last_undegraded":"2024-04-23T19:03:43.390341+0000","last_fullsized":"2024-04-23T19:03:43.390341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113854+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:03:44.113854+0000","last_peered":"2024-04-23T19:03:44.113854+0000","last_clean":"2024-04-23T19:03:44.113854+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:03:44.113854+0000","last_undegraded":"2024-04-23T19:03:44.113854+0000","last_fullsized":"2024-04-23T19:03:44.113854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707656+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707656+0000","last_peered":"2024-04-23T19:03:43.707656+0000","last_clean":"2024-04-23T19:03:43.707656+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707656+0000","last_undegraded":"2024-04-23T19:03:43.707656+0000","last_fullsized":"2024-04-23T19:03:43.707656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114161+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:03:44.114161+0000","last_peered":"2024-04-23T19:03:44.114161+0000","last_clean":"2024-04-23T19:03:44.114161+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:03:44.114161+0000","last_undegraded":"2024-04-23T19:03:44.114161+0000","last_fullsized":"2024-04-23T19:03:44.114161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113340+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:03:44.113340+0000","last_peered":"2024-04-23T19:03:44.113340+0000","last_clean":"2024-04-23T19:03:44.113340+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:03:44.113340+0000","last_undegraded":"2024-04-23T19:03:44.113340+0000","last_fullsized":"2024-04-23T19:03:44.113340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112983+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:44.112983+0000","last_peered":"2024-04-23T19:03:44.112983+0000","last_clean":"2024-04-23T19:03:44.112983+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:44.112983+0000","last_undegraded":"2024-04-23T19:03:44.112983+0000","last_fullsized":"2024-04-23T19:03:44.112983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390688+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:03:43.390688+0000","last_peered":"2024-04-23T19:03:43.390688+0000","last_clean":"2024-04-23T19:03:43.390688+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:03:43.390688+0000","last_undegraded":"2024-04-23T19:03:43.390688+0000","last_fullsized":"2024-04-23T19:03:43.390688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"98'136","reported_seq":428,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113657+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:03:44.113657+0000","last_peered":"2024-04-23T19:03:44.113657+0000","last_clean":"2024-04-23T19:03:44.113657+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:03:44.113657+0000","last_undegraded":"2024-04-23T19:03:44.113657+0000","last_fullsized":"2024-04-23T19:03:44.113657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114354+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114354+0000","last_peered":"2024-04-23T19:03:44.114354+0000","last_clean":"2024-04-23T19:03:44.114354+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114354+0000","last_undegraded":"2024-04-23T19:03:44.114354+0000","last_fullsized":"2024-04-23T19:03:44.114354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112303+0000","last_change":"2024-04-23T19:03:32.286556+0000","last_active":"2024-04-23T19:03:44.112303+0000","last_peered":"2024-04-23T19:03:44.112303+0000","last_clean":"2024-04-23T19:03:44.112303+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:03:44.112303+0000","last_undegraded":"2024-04-23T19:03:44.112303+0000","last_fullsized":"2024-04-23T19:03:44.112303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:18.008985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115727+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:03:44.115727+0000","last_peered":"2024-04-23T19:03:44.115727+0000","last_clean":"2024-04-23T19:03:44.115727+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:03:44.115727+0000","last_undegraded":"2024-04-23T19:03:44.115727+0000","last_fullsized":"2024-04-23T19:03:44.115727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389027+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:03:43.389027+0000","last_peered":"2024-04-23T19:03:43.389027+0000","last_clean":"2024-04-23T19:03:43.389027+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:03:43.389027+0000","last_undegraded":"2024-04-23T19:03:43.389027+0000","last_fullsized":"2024-04-23T19:03:43.389027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"96'14","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112139+0000","last_change":"2024-04-23T19:03:32.290315+0000","last_active":"2024-04-23T19:03:44.112139+0000","last_peered":"2024-04-23T19:03:44.112139+0000","last_clean":"2024-04-23T19:03:44.112139+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:03:44.112139+0000","last_undegraded":"2024-04-23T19:03:44.112139+0000","last_fullsized":"2024-04-23T19:03:44.112139+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:50.252138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393921+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:03:43.393921+0000","last_peered":"2024-04-23T19:03:43.393921+0000","last_clean":"2024-04-23T19:03:43.393921+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:03:43.393921+0000","last_undegraded":"2024-04-23T19:03:43.393921+0000","last_fullsized":"2024-04-23T19:03:43.393921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'16","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114946+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:44.114946+0000","last_peered":"2024-04-23T19:03:44.114946+0000","last_clean":"2024-04-23T19:03:44.114946+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:44.114946+0000","last_undegraded":"2024-04-23T19:03:44.114946+0000","last_fullsized":"2024-04-23T19:03:44.114946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113413+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:03:44.113413+0000","last_peered":"2024-04-23T19:03:44.113413+0000","last_clean":"2024-04-23T19:03:44.113413+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:03:44.113413+0000","last_undegraded":"2024-04-23T19:03:44.113413+0000","last_fullsized":"2024-04-23T19:03:44.113413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392383+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392383+0000","last_peered":"2024-04-23T19:03:43.392383+0000","last_clean":"2024-04-23T19:03:43.392383+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392383+0000","last_undegraded":"2024-04-23T19:03:43.392383+0000","last_fullsized":"2024-04-23T19:03:43.392383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113895+0000","last_change":"2024-04-23T19:03:32.300198+0000","last_active":"2024-04-23T19:03:44.113895+0000","last_peered":"2024-04-23T19:03:44.113895+0000","last_clean":"2024-04-23T19:03:44.113895+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:03:44.113895+0000","last_undegraded":"2024-04-23T19:03:44.113895+0000","last_fullsized":"2024-04-23T19:03:44.113895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:55:20.076349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389317+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:03:43.389317+0000","last_peered":"2024-04-23T19:03:43.389317+0000","last_clean":"2024-04-23T19:03:43.389317+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:03:43.389317+0000","last_undegraded":"2024-04-23T19:03:43.389317+0000","last_fullsized":"2024-04-23T19:03:43.389317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911323+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:43.911323+0000","last_peered":"2024-04-23T19:03:43.911323+0000","last_clean":"2024-04-23T19:03:43.911323+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:43.911323+0000","last_undegraded":"2024-04-23T19:03:43.911323+0000","last_fullsized":"2024-04-23T19:03:43.911323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":280,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113800+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:03:44.113800+0000","last_peered":"2024-04-23T19:03:44.113800+0000","last_clean":"2024-04-23T19:03:44.113800+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:03:44.113800+0000","last_undegraded":"2024-04-23T19:03:44.113800+0000","last_fullsized":"2024-04-23T19:03:44.113800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393082+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393082+0000","last_peered":"2024-04-23T19:03:43.393082+0000","last_clean":"2024-04-23T19:03:43.393082+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393082+0000","last_undegraded":"2024-04-23T19:03:43.393082+0000","last_fullsized":"2024-04-23T19:03:43.393082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709817+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709817+0000","last_peered":"2024-04-23T19:03:43.709817+0000","last_clean":"2024-04-23T19:03:43.709817+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709817+0000","last_undegraded":"2024-04-23T19:03:43.709817+0000","last_fullsized":"2024-04-23T19:03:43.709817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387614+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387614+0000","last_peered":"2024-04-23T19:03:43.387614+0000","last_clean":"2024-04-23T19:03:43.387614+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387614+0000","last_undegraded":"2024-04-23T19:03:43.387614+0000","last_fullsized":"2024-04-23T19:03:43.387614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113459+0000","last_change":"2024-04-23T19:03:32.295129+0000","last_active":"2024-04-23T19:03:44.113459+0000","last_peered":"2024-04-23T19:03:44.113459+0000","last_clean":"2024-04-23T19:03:44.113459+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:03:44.113459+0000","last_undegraded":"2024-04-23T19:03:44.113459+0000","last_fullsized":"2024-04-23T19:03:44.113459+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:35:11.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390260+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:43.390260+0000","last_peered":"2024-04-23T19:03:43.390260+0000","last_clean":"2024-04-23T19:03:43.390260+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:43.390260+0000","last_undegraded":"2024-04-23T19:03:43.390260+0000","last_fullsized":"2024-04-23T19:03:43.390260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114156+0000","last_change":"2024-04-23T19:03:32.293904+0000","last_active":"2024-04-23T19:03:44.114156+0000","last_peered":"2024-04-23T19:03:44.114156+0000","last_clean":"2024-04-23T19:03:44.114156+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:03:44.114156+0000","last_undegraded":"2024-04-23T19:03:44.114156+0000","last_fullsized":"2024-04-23T19:03:44.114156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:21.520365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113604+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:03:44.113604+0000","last_peered":"2024-04-23T19:03:44.113604+0000","last_clean":"2024-04-23T19:03:44.113604+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:03:44.113604+0000","last_undegraded":"2024-04-23T19:03:44.113604+0000","last_fullsized":"2024-04-23T19:03:44.113604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'34","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112855+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:03:44.112855+0000","last_peered":"2024-04-23T19:03:44.112855+0000","last_clean":"2024-04-23T19:03:44.112855+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:03:44.112855+0000","last_undegraded":"2024-04-23T19:03:44.112855+0000","last_fullsized":"2024-04-23T19:03:44.112855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908951+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.908951+0000","last_peered":"2024-04-23T19:03:43.908951+0000","last_clean":"2024-04-23T19:03:43.908951+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.908951+0000","last_undegraded":"2024-04-23T19:03:43.908951+0000","last_fullsized":"2024-04-23T19:03:43.908951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113600+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:03:44.113600+0000","last_peered":"2024-04-23T19:03:44.113600+0000","last_clean":"2024-04-23T19:03:44.113600+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:03:44.113600+0000","last_undegraded":"2024-04-23T19:03:44.113600+0000","last_fullsized":"2024-04-23T19:03:44.113600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113874+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:03:44.113874+0000","last_peered":"2024-04-23T19:03:44.113874+0000","last_clean":"2024-04-23T19:03:44.113874+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:03:44.113874+0000","last_undegraded":"2024-04-23T19:03:44.113874+0000","last_fullsized":"2024-04-23T19:03:44.113874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"97'22","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113983+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:44.113983+0000","last_peered":"2024-04-23T19:03:44.113983+0000","last_clean":"2024-04-23T19:03:44.113983+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:44.113983+0000","last_undegraded":"2024-04-23T19:03:44.113983+0000","last_fullsized":"2024-04-23T19:03:44.113983+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.348240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115650+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:03:44.115650+0000","last_peered":"2024-04-23T19:03:44.115650+0000","last_clean":"2024-04-23T19:03:44.115650+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:03:44.115650+0000","last_undegraded":"2024-04-23T19:03:44.115650+0000","last_fullsized":"2024-04-23T19:03:44.115650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708440+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:03:43.708440+0000","last_peered":"2024-04-23T19:03:43.708440+0000","last_clean":"2024-04-23T19:03:43.708440+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:03:43.708440+0000","last_undegraded":"2024-04-23T19:03:43.708440+0000","last_fullsized":"2024-04-23T19:03:43.708440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112369+0000","last_change":"2024-04-23T19:03:32.300841+0000","last_active":"2024-04-23T19:03:44.112369+0000","last_peered":"2024-04-23T19:03:44.112369+0000","last_clean":"2024-04-23T19:03:44.112369+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:03:44.112369+0000","last_undegraded":"2024-04-23T19:03:44.112369+0000","last_fullsized":"2024-04-23T19:03:44.112369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:36.411296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"98'134","reported_seq":360,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388780+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:43.388780+0000","last_peered":"2024-04-23T19:03:43.388780+0000","last_clean":"2024-04-23T19:03:43.388780+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:43.388780+0000","last_undegraded":"2024-04-23T19:03:43.388780+0000","last_fullsized":"2024-04-23T19:03:43.388780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393276+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393276+0000","last_peered":"2024-04-23T19:03:43.393276+0000","last_clean":"2024-04-23T19:03:43.393276+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393276+0000","last_undegraded":"2024-04-23T19:03:43.393276+0000","last_fullsized":"2024-04-23T19:03:43.393276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391087+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:03:43.391087+0000","last_peered":"2024-04-23T19:03:43.391087+0000","last_clean":"2024-04-23T19:03:43.391087+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:03:43.391087+0000","last_undegraded":"2024-04-23T19:03:43.391087+0000","last_fullsized":"2024-04-23T19:03:43.391087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"97'20","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392954+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:43.392954+0000","last_peered":"2024-04-23T19:03:43.392954+0000","last_clean":"2024-04-23T19:03:43.392954+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:43.392954+0000","last_undegraded":"2024-04-23T19:03:43.392954+0000","last_fullsized":"2024-04-23T19:03:43.392954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115534+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115534+0000","last_peered":"2024-04-23T19:03:44.115534+0000","last_clean":"2024-04-23T19:03:44.115534+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115534+0000","last_undegraded":"2024-04-23T19:03:44.115534+0000","last_fullsized":"2024-04-23T19:03:44.115534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:41.115956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909201+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:03:43.909201+0000","last_peered":"2024-04-23T19:03:43.909201+0000","last_clean":"2024-04-23T19:03:43.909201+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:03:43.909201+0000","last_undegraded":"2024-04-23T19:03:43.909201+0000","last_fullsized":"2024-04-23T19:03:43.909201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910617+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:03:43.910617+0000","last_peered":"2024-04-23T19:03:43.910617+0000","last_clean":"2024-04-23T19:03:43.910617+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:03:43.910617+0000","last_undegraded":"2024-04-23T19:03:43.910617+0000","last_fullsized":"2024-04-23T19:03:43.910617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"98'134","reported_seq":438,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392967+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:03:43.392967+0000","last_peered":"2024-04-23T19:03:43.392967+0000","last_clean":"2024-04-23T19:03:43.392967+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:03:43.392967+0000","last_undegraded":"2024-04-23T19:03:43.392967+0000","last_fullsized":"2024-04-23T19:03:43.392967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113500+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:44.113500+0000","last_peered":"2024-04-23T19:03:44.113500+0000","last_clean":"2024-04-23T19:03:44.113500+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:44.113500+0000","last_undegraded":"2024-04-23T19:03:44.113500+0000","last_fullsized":"2024-04-23T19:03:44.113500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909395+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909395+0000","last_peered":"2024-04-23T19:03:43.909395+0000","last_clean":"2024-04-23T19:03:43.909395+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909395+0000","last_undegraded":"2024-04-23T19:03:43.909395+0000","last_fullsized":"2024-04-23T19:03:43.909395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"97'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114287+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:44.114287+0000","last_peered":"2024-04-23T19:03:44.114287+0000","last_clean":"2024-04-23T19:03:44.114287+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:44.114287+0000","last_undegraded":"2024-04-23T19:03:44.114287+0000","last_fullsized":"2024-04-23T19:03:44.114287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710129+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:03:43.710129+0000","last_peered":"2024-04-23T19:03:43.710129+0000","last_clean":"2024-04-23T19:03:43.710129+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:03:43.710129+0000","last_undegraded":"2024-04-23T19:03:43.710129+0000","last_fullsized":"2024-04-23T19:03:43.710129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390843+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:03:43.390843+0000","last_peered":"2024-04-23T19:03:43.390843+0000","last_clean":"2024-04-23T19:03:43.390843+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:03:43.390843+0000","last_undegraded":"2024-04-23T19:03:43.390843+0000","last_fullsized":"2024-04-23T19:03:43.390843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390945+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:03:43.390945+0000","last_peered":"2024-04-23T19:03:43.390945+0000","last_clean":"2024-04-23T19:03:43.390945+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:03:43.390945+0000","last_undegraded":"2024-04-23T19:03:43.390945+0000","last_fullsized":"2024-04-23T19:03:43.390945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388873+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.388873+0000","last_peered":"2024-04-23T19:03:43.388873+0000","last_clean":"2024-04-23T19:03:43.388873+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.388873+0000","last_undegraded":"2024-04-23T19:03:43.388873+0000","last_fullsized":"2024-04-23T19:03:43.388873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114432+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:03:44.114432+0000","last_peered":"2024-04-23T19:03:44.114432+0000","last_clean":"2024-04-23T19:03:44.114432+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:03:44.114432+0000","last_undegraded":"2024-04-23T19:03:44.114432+0000","last_fullsized":"2024-04-23T19:03:44.114432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909827+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:03:43.909827+0000","last_peered":"2024-04-23T19:03:43.909827+0000","last_clean":"2024-04-23T19:03:43.909827+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:03:43.909827+0000","last_undegraded":"2024-04-23T19:03:43.909827+0000","last_fullsized":"2024-04-23T19:03:43.909827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910450+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:43.910450+0000","last_peered":"2024-04-23T19:03:43.910450+0000","last_clean":"2024-04-23T19:03:43.910450+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:43.910450+0000","last_undegraded":"2024-04-23T19:03:43.910450+0000","last_fullsized":"2024-04-23T19:03:43.910450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113537+0000","last_change":"2024-04-23T19:03:32.294993+0000","last_active":"2024-04-23T19:03:44.113537+0000","last_peered":"2024-04-23T19:03:44.113537+0000","last_clean":"2024-04-23T19:03:44.113537+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:03:44.113537+0000","last_undegraded":"2024-04-23T19:03:44.113537+0000","last_fullsized":"2024-04-23T19:03:44.113537+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:50.832778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'19","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388829+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:03:43.388829+0000","last_peered":"2024-04-23T19:03:43.388829+0000","last_clean":"2024-04-23T19:03:43.388829+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:03:43.388829+0000","last_undegraded":"2024-04-23T19:03:43.388829+0000","last_fullsized":"2024-04-23T19:03:43.388829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388406+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:03:43.388406+0000","last_peered":"2024-04-23T19:03:43.388406+0000","last_clean":"2024-04-23T19:03:43.388406+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:03:43.388406+0000","last_undegraded":"2024-04-23T19:03:43.388406+0000","last_fullsized":"2024-04-23T19:03:43.388406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392779+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:03:43.392779+0000","last_peered":"2024-04-23T19:03:43.392779+0000","last_clean":"2024-04-23T19:03:43.392779+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:03:43.392779+0000","last_undegraded":"2024-04-23T19:03:43.392779+0000","last_fullsized":"2024-04-23T19:03:43.392779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113434+0000","last_change":"2024-04-23T19:03:32.300516+0000","last_active":"2024-04-23T19:03:44.113434+0000","last_peered":"2024-04-23T19:03:44.113434+0000","last_clean":"2024-04-23T19:03:44.113434+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:03:44.113434+0000","last_undegraded":"2024-04-23T19:03:44.113434+0000","last_fullsized":"2024-04-23T19:03:44.113434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:02.485036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"97'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115124+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:44.115124+0000","last_peered":"2024-04-23T19:03:44.115124+0000","last_clean":"2024-04-23T19:03:44.115124+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:44.115124+0000","last_undegraded":"2024-04-23T19:03:44.115124+0000","last_fullsized":"2024-04-23T19:03:44.115124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392243+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:03:43.392243+0000","last_peered":"2024-04-23T19:03:43.392243+0000","last_clean":"2024-04-23T19:03:43.392243+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:03:43.392243+0000","last_undegraded":"2024-04-23T19:03:43.392243+0000","last_fullsized":"2024-04-23T19:03:43.392243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"100'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112763+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:03:44.112763+0000","last_peered":"2024-04-23T19:03:44.112763+0000","last_clean":"2024-04-23T19:03:44.112763+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:03:44.112763+0000","last_undegraded":"2024-04-23T19:03:44.112763+0000","last_fullsized":"2024-04-23T19:03:44.112763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113317+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:03:44.113317+0000","last_peered":"2024-04-23T19:03:44.113317+0000","last_clean":"2024-04-23T19:03:44.113317+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:03:44.113317+0000","last_undegraded":"2024-04-23T19:03:44.113317+0000","last_fullsized":"2024-04-23T19:03:44.113317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113692+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:44.113692+0000","last_peered":"2024-04-23T19:03:44.113692+0000","last_clean":"2024-04-23T19:03:44.113692+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:44.113692+0000","last_undegraded":"2024-04-23T19:03:44.113692+0000","last_fullsized":"2024-04-23T19:03:44.113692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389971+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:03:43.389971+0000","last_peered":"2024-04-23T19:03:43.389971+0000","last_clean":"2024-04-23T19:03:43.389971+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:03:43.389971+0000","last_undegraded":"2024-04-23T19:03:43.389971+0000","last_fullsized":"2024-04-23T19:03:43.389971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390374+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:03:43.390374+0000","last_peered":"2024-04-23T19:03:43.390374+0000","last_clean":"2024-04-23T19:03:43.390374+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:03:43.390374+0000","last_undegraded":"2024-04-23T19:03:43.390374+0000","last_fullsized":"2024-04-23T19:03:43.390374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112637+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:03:44.112637+0000","last_peered":"2024-04-23T19:03:44.112637+0000","last_clean":"2024-04-23T19:03:44.112637+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:03:44.112637+0000","last_undegraded":"2024-04-23T19:03:44.112637+0000","last_fullsized":"2024-04-23T19:03:44.112637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391944+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:03:43.391944+0000","last_peered":"2024-04-23T19:03:43.391944+0000","last_clean":"2024-04-23T19:03:43.391944+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:03:43.391944+0000","last_undegraded":"2024-04-23T19:03:43.391944+0000","last_fullsized":"2024-04-23T19:03:43.391944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708373+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:03:43.708373+0000","last_peered":"2024-04-23T19:03:43.708373+0000","last_clean":"2024-04-23T19:03:43.708373+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:03:43.708373+0000","last_undegraded":"2024-04-23T19:03:43.708373+0000","last_fullsized":"2024-04-23T19:03:43.708373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388390+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388390+0000","last_peered":"2024-04-23T19:03:43.388390+0000","last_clean":"2024-04-23T19:03:43.388390+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388390+0000","last_undegraded":"2024-04-23T19:03:43.388390+0000","last_fullsized":"2024-04-23T19:03:43.388390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391315+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391315+0000","last_peered":"2024-04-23T19:03:43.391315+0000","last_clean":"2024-04-23T19:03:43.391315+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391315+0000","last_undegraded":"2024-04-23T19:03:43.391315+0000","last_fullsized":"2024-04-23T19:03:43.391315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"97'28","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114624+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:44.114624+0000","last_peered":"2024-04-23T19:03:44.114624+0000","last_clean":"2024-04-23T19:03:44.114624+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:44.114624+0000","last_undegraded":"2024-04-23T19:03:44.114624+0000","last_fullsized":"2024-04-23T19:03:44.114624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708231+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:03:43.708231+0000","last_peered":"2024-04-23T19:03:43.708231+0000","last_clean":"2024-04-23T19:03:43.708231+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:03:43.708231+0000","last_undegraded":"2024-04-23T19:03:43.708231+0000","last_fullsized":"2024-04-23T19:03:43.708231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113187+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:03:44.113187+0000","last_peered":"2024-04-23T19:03:44.113187+0000","last_clean":"2024-04-23T19:03:44.113187+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:03:44.113187+0000","last_undegraded":"2024-04-23T19:03:44.113187+0000","last_fullsized":"2024-04-23T19:03:44.113187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113407+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:03:44.113407+0000","last_peered":"2024-04-23T19:03:44.113407+0000","last_clean":"2024-04-23T19:03:44.113407+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:03:44.113407+0000","last_undegraded":"2024-04-23T19:03:44.113407+0000","last_fullsized":"2024-04-23T19:03:44.113407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710040+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:03:43.710040+0000","last_peered":"2024-04-23T19:03:43.710040+0000","last_clean":"2024-04-23T19:03:43.710040+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:03:43.710040+0000","last_undegraded":"2024-04-23T19:03:43.710040+0000","last_fullsized":"2024-04-23T19:03:43.710040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"96'20","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391502+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:43.391502+0000","last_peered":"2024-04-23T19:03:43.391502+0000","last_clean":"2024-04-23T19:03:43.391502+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:43.391502+0000","last_undegraded":"2024-04-23T19:03:43.391502+0000","last_fullsized":"2024-04-23T19:03:43.391502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113935+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:03:44.113935+0000","last_peered":"2024-04-23T19:03:44.113935+0000","last_clean":"2024-04-23T19:03:44.113935+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:03:44.113935+0000","last_undegraded":"2024-04-23T19:03:44.113935+0000","last_fullsized":"2024-04-23T19:03:44.113935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'29","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114486+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:44.114486+0000","last_peered":"2024-04-23T19:03:44.114486+0000","last_clean":"2024-04-23T19:03:44.114486+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:44.114486+0000","last_undegraded":"2024-04-23T19:03:44.114486+0000","last_fullsized":"2024-04-23T19:03:44.114486+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:28.797026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388731+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:03:43.388731+0000","last_peered":"2024-04-23T19:03:43.388731+0000","last_clean":"2024-04-23T19:03:43.388731+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:03:43.388731+0000","last_undegraded":"2024-04-23T19:03:43.388731+0000","last_fullsized":"2024-04-23T19:03:43.388731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391467+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391467+0000","last_peered":"2024-04-23T19:03:43.391467+0000","last_clean":"2024-04-23T19:03:43.391467+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391467+0000","last_undegraded":"2024-04-23T19:03:43.391467+0000","last_fullsized":"2024-04-23T19:03:43.391467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114062+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:03:44.114062+0000","last_peered":"2024-04-23T19:03:44.114062+0000","last_clean":"2024-04-23T19:03:44.114062+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:03:44.114062+0000","last_undegraded":"2024-04-23T19:03:44.114062+0000","last_fullsized":"2024-04-23T19:03:44.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"97'30","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113127+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:03:44.113127+0000","last_peered":"2024-04-23T19:03:44.113127+0000","last_clean":"2024-04-23T19:03:44.113127+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:03:44.113127+0000","last_undegraded":"2024-04-23T19:03:44.113127+0000","last_fullsized":"2024-04-23T19:03:44.113127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709898+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:03:43.709898+0000","last_peered":"2024-04-23T19:03:43.709898+0000","last_clean":"2024-04-23T19:03:43.709898+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:03:43.709898+0000","last_undegraded":"2024-04-23T19:03:43.709898+0000","last_fullsized":"2024-04-23T19:03:43.709898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114003+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:03:44.114003+0000","last_peered":"2024-04-23T19:03:44.114003+0000","last_clean":"2024-04-23T19:03:44.114003+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:03:44.114003+0000","last_undegraded":"2024-04-23T19:03:44.114003+0000","last_fullsized":"2024-04-23T19:03:44.114003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114574+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:03:44.114574+0000","last_peered":"2024-04-23T19:03:44.114574+0000","last_clean":"2024-04-23T19:03:44.114574+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:03:44.114574+0000","last_undegraded":"2024-04-23T19:03:44.114574+0000","last_fullsized":"2024-04-23T19:03:44.114574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707993+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.707993+0000","last_peered":"2024-04-23T19:03:43.707993+0000","last_clean":"2024-04-23T19:03:43.707993+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.707993+0000","last_undegraded":"2024-04-23T19:03:43.707993+0000","last_fullsized":"2024-04-23T19:03:43.707993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392596+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:03:43.392596+0000","last_peered":"2024-04-23T19:03:43.392596+0000","last_clean":"2024-04-23T19:03:43.392596+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:03:43.392596+0000","last_undegraded":"2024-04-23T19:03:43.392596+0000","last_fullsized":"2024-04-23T19:03:43.392596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911521+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:43.911521+0000","last_peered":"2024-04-23T19:03:43.911521+0000","last_clean":"2024-04-23T19:03:43.911521+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:43.911521+0000","last_undegraded":"2024-04-23T19:03:43.911521+0000","last_fullsized":"2024-04-23T19:03:43.911521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.912128+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:03:43.912128+0000","last_peered":"2024-04-23T19:03:43.912128+0000","last_clean":"2024-04-23T19:03:43.912128+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:03:43.912128+0000","last_undegraded":"2024-04-23T19:03:43.912128+0000","last_fullsized":"2024-04-23T19:03:43.912128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393457+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:03:43.393457+0000","last_peered":"2024-04-23T19:03:43.393457+0000","last_clean":"2024-04-23T19:03:43.393457+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:03:43.393457+0000","last_undegraded":"2024-04-23T19:03:43.393457+0000","last_fullsized":"2024-04-23T19:03:43.393457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114358+0000","last_change":"2024-04-23T19:03:32.295881+0000","last_active":"2024-04-23T19:03:44.114358+0000","last_peered":"2024-04-23T19:03:44.114358+0000","last_clean":"2024-04-23T19:03:44.114358+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:03:44.114358+0000","last_undegraded":"2024-04-23T19:03:44.114358+0000","last_fullsized":"2024-04-23T19:03:44.114358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:09.028190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388000+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388000+0000","last_peered":"2024-04-23T19:03:43.388000+0000","last_clean":"2024-04-23T19:03:43.388000+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388000+0000","last_undegraded":"2024-04-23T19:03:43.388000+0000","last_fullsized":"2024-04-23T19:03:43.388000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394414+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:03:43.394414+0000","last_peered":"2024-04-23T19:03:43.394414+0000","last_clean":"2024-04-23T19:03:43.394414+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:03:43.394414+0000","last_undegraded":"2024-04-23T19:03:43.394414+0000","last_fullsized":"2024-04-23T19:03:43.394414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"97'20","reported_seq":147,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112321+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:44.112321+0000","last_peered":"2024-04-23T19:03:44.112321+0000","last_clean":"2024-04-23T19:03:44.112321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:44.112321+0000","last_undegraded":"2024-04-23T19:03:44.112321+0000","last_fullsized":"2024-04-23T19:03:44.112321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114840+0000","last_change":"2024-04-23T19:03:32.293970+0000","last_active":"2024-04-23T19:03:44.114840+0000","last_peered":"2024-04-23T19:03:44.114840+0000","last_clean":"2024-04-23T19:03:44.114840+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:03:44.114840+0000","last_undegraded":"2024-04-23T19:03:44.114840+0000","last_fullsized":"2024-04-23T19:03:44.114840+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:29.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910798+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:03:43.910798+0000","last_peered":"2024-04-23T19:03:43.910798+0000","last_clean":"2024-04-23T19:03:43.910798+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:03:43.910798+0000","last_undegraded":"2024-04-23T19:03:43.910798+0000","last_fullsized":"2024-04-23T19:03:43.910798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"98'134","reported_seq":388,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709391+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:03:43.709391+0000","last_peered":"2024-04-23T19:03:43.709391+0000","last_clean":"2024-04-23T19:03:43.709391+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:03:43.709391+0000","last_undegraded":"2024-04-23T19:03:43.709391+0000","last_fullsized":"2024-04-23T19:03:43.709391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112611+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112611+0000","last_peered":"2024-04-23T19:03:44.112611+0000","last_clean":"2024-04-23T19:03:44.112611+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112611+0000","last_undegraded":"2024-04-23T19:03:44.112611+0000","last_fullsized":"2024-04-23T19:03:44.112611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909534+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:03:43.909534+0000","last_peered":"2024-04-23T19:03:43.909534+0000","last_clean":"2024-04-23T19:03:43.909534+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:03:43.909534+0000","last_undegraded":"2024-04-23T19:03:43.909534+0000","last_fullsized":"2024-04-23T19:03:43.909534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389562+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:03:43.389562+0000","last_peered":"2024-04-23T19:03:43.389562+0000","last_clean":"2024-04-23T19:03:43.389562+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:03:43.389562+0000","last_undegraded":"2024-04-23T19:03:43.389562+0000","last_fullsized":"2024-04-23T19:03:43.389562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113265+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:03:44.113265+0000","last_peered":"2024-04-23T19:03:44.113265+0000","last_clean":"2024-04-23T19:03:44.113265+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:03:44.113265+0000","last_undegraded":"2024-04-23T19:03:44.113265+0000","last_fullsized":"2024-04-23T19:03:44.113265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'23","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388295+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:03:43.388295+0000","last_peered":"2024-04-23T19:03:43.388295+0000","last_clean":"2024-04-23T19:03:43.388295+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:03:43.388295+0000","last_undegraded":"2024-04-23T19:03:43.388295+0000","last_fullsized":"2024-04-23T19:03:43.388295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111946+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:03:44.111946+0000","last_peered":"2024-04-23T19:03:44.111946+0000","last_clean":"2024-04-23T19:03:44.111946+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:03:44.111946+0000","last_undegraded":"2024-04-23T19:03:44.111946+0000","last_fullsized":"2024-04-23T19:03:44.111946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115183+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115183+0000","last_peered":"2024-04-23T19:03:44.115183+0000","last_clean":"2024-04-23T19:03:44.115183+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115183+0000","last_undegraded":"2024-04-23T19:03:44.115183+0000","last_fullsized":"2024-04-23T19:03:44.115183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910717+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:03:43.910717+0000","last_peered":"2024-04-23T19:03:43.910717+0000","last_clean":"2024-04-23T19:03:43.910717+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:03:43.910717+0000","last_undegraded":"2024-04-23T19:03:43.910717+0000","last_fullsized":"2024-04-23T19:03:43.910717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"97'26","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393664+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:03:43.393664+0000","last_peered":"2024-04-23T19:03:43.393664+0000","last_clean":"2024-04-23T19:03:43.393664+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:03:43.393664+0000","last_undegraded":"2024-04-23T19:03:43.393664+0000","last_fullsized":"2024-04-23T19:03:43.393664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388902+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:03:43.388902+0000","last_peered":"2024-04-23T19:03:43.388902+0000","last_clean":"2024-04-23T19:03:43.388902+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:03:43.388902+0000","last_undegraded":"2024-04-23T19:03:43.388902+0000","last_fullsized":"2024-04-23T19:03:43.388902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111823+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:44.111823+0000","last_peered":"2024-04-23T19:03:44.111823+0000","last_clean":"2024-04-23T19:03:44.111823+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:44.111823+0000","last_undegraded":"2024-04-23T19:03:44.111823+0000","last_fullsized":"2024-04-23T19:03:44.111823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707890+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:03:43.707890+0000","last_peered":"2024-04-23T19:03:43.707890+0000","last_clean":"2024-04-23T19:03:43.707890+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:03:43.707890+0000","last_undegraded":"2024-04-23T19:03:43.707890+0000","last_fullsized":"2024-04-23T19:03:43.707890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392918+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392918+0000","last_peered":"2024-04-23T19:03:43.392918+0000","last_clean":"2024-04-23T19:03:43.392918+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392918+0000","last_undegraded":"2024-04-23T19:03:43.392918+0000","last_fullsized":"2024-04-23T19:03:43.392918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390352+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:03:43.390352+0000","last_peered":"2024-04-23T19:03:43.390352+0000","last_clean":"2024-04-23T19:03:43.390352+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:03:43.390352+0000","last_undegraded":"2024-04-23T19:03:43.390352+0000","last_fullsized":"2024-04-23T19:03:43.390352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393209+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:03:43.393209+0000","last_peered":"2024-04-23T19:03:43.393209+0000","last_clean":"2024-04-23T19:03:43.393209+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:03:43.393209+0000","last_undegraded":"2024-04-23T19:03:43.393209+0000","last_fullsized":"2024-04-23T19:03:43.393209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908804+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908804+0000","last_peered":"2024-04-23T19:03:43.908804+0000","last_clean":"2024-04-23T19:03:43.908804+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908804+0000","last_undegraded":"2024-04-23T19:03:43.908804+0000","last_fullsized":"2024-04-23T19:03:43.908804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392822+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:43.392822+0000","last_peered":"2024-04-23T19:03:43.392822+0000","last_clean":"2024-04-23T19:03:43.392822+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:43.392822+0000","last_undegraded":"2024-04-23T19:03:43.392822+0000","last_fullsized":"2024-04-23T19:03:43.392822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909207+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909207+0000","last_peered":"2024-04-23T19:03:43.909207+0000","last_clean":"2024-04-23T19:03:43.909207+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909207+0000","last_undegraded":"2024-04-23T19:03:43.909207+0000","last_fullsized":"2024-04-23T19:03:43.909207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114601+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114601+0000","last_peered":"2024-04-23T19:03:44.114601+0000","last_clean":"2024-04-23T19:03:44.114601+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114601+0000","last_undegraded":"2024-04-23T19:03:44.114601+0000","last_fullsized":"2024-04-23T19:03:44.114601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909065+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:03:43.909065+0000","last_peered":"2024-04-23T19:03:43.909065+0000","last_clean":"2024-04-23T19:03:43.909065+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:03:43.909065+0000","last_undegraded":"2024-04-23T19:03:43.909065+0000","last_fullsized":"2024-04-23T19:03:43.909065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"97'25","reported_seq":151,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114439+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:44.114439+0000","last_peered":"2024-04-23T19:03:44.114439+0000","last_clean":"2024-04-23T19:03:44.114439+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:44.114439+0000","last_undegraded":"2024-04-23T19:03:44.114439+0000","last_fullsized":"2024-04-23T19:03:44.114439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113085+0000","last_change":"2024-04-23T19:03:32.303428+0000","last_active":"2024-04-23T19:03:44.113085+0000","last_peered":"2024-04-23T19:03:44.113085+0000","last_clean":"2024-04-23T19:03:44.113085+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:03:44.113085+0000","last_undegraded":"2024-04-23T19:03:44.113085+0000","last_fullsized":"2024-04-23T19:03:44.113085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:39.837391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909644+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:03:43.909644+0000","last_peered":"2024-04-23T19:03:43.909644+0000","last_clean":"2024-04-23T19:03:43.909644+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:03:43.909644+0000","last_undegraded":"2024-04-23T19:03:43.909644+0000","last_fullsized":"2024-04-23T19:03:43.909644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113318+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:03:44.113318+0000","last_peered":"2024-04-23T19:03:44.113318+0000","last_clean":"2024-04-23T19:03:44.113318+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:03:44.113318+0000","last_undegraded":"2024-04-23T19:03:44.113318+0000","last_fullsized":"2024-04-23T19:03:44.113318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909653+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.909653+0000","last_peered":"2024-04-23T19:03:43.909653+0000","last_clean":"2024-04-23T19:03:43.909653+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.909653+0000","last_undegraded":"2024-04-23T19:03:43.909653+0000","last_fullsized":"2024-04-23T19:03:43.909653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115632+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115632+0000","last_peered":"2024-04-23T19:03:44.115632+0000","last_clean":"2024-04-23T19:03:44.115632+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115632+0000","last_undegraded":"2024-04-23T19:03:44.115632+0000","last_fullsized":"2024-04-23T19:03:44.115632+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:01.164433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"97'29","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707924+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:43.707924+0000","last_peered":"2024-04-23T19:03:43.707924+0000","last_clean":"2024-04-23T19:03:43.707924+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:43.707924+0000","last_undegraded":"2024-04-23T19:03:43.707924+0000","last_fullsized":"2024-04-23T19:03:43.707924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115428+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115428+0000","last_peered":"2024-04-23T19:03:44.115428+0000","last_clean":"2024-04-23T19:03:44.115428+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115428+0000","last_undegraded":"2024-04-23T19:03:44.115428+0000","last_fullsized":"2024-04-23T19:03:44.115428+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:38.798295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388809+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:03:43.388809+0000","last_peered":"2024-04-23T19:03:43.388809+0000","last_clean":"2024-04-23T19:03:43.388809+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:03:43.388809+0000","last_undegraded":"2024-04-23T19:03:43.388809+0000","last_fullsized":"2024-04-23T19:03:43.388809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389504+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:03:43.389504+0000","last_peered":"2024-04-23T19:03:43.389504+0000","last_clean":"2024-04-23T19:03:43.389504+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:03:43.389504+0000","last_undegraded":"2024-04-23T19:03:43.389504+0000","last_fullsized":"2024-04-23T19:03:43.389504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"97'17","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389148+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:43.389148+0000","last_peered":"2024-04-23T19:03:43.389148+0000","last_clean":"2024-04-23T19:03:43.389148+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:43.389148+0000","last_undegraded":"2024-04-23T19:03:43.389148+0000","last_fullsized":"2024-04-23T19:03:43.389148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114071+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:03:44.114071+0000","last_peered":"2024-04-23T19:03:44.114071+0000","last_clean":"2024-04-23T19:03:44.114071+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:03:44.114071+0000","last_undegraded":"2024-04-23T19:03:44.114071+0000","last_fullsized":"2024-04-23T19:03:44.114071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"97'21","reported_seq":150,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113268+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:44.113268+0000","last_peered":"2024-04-23T19:03:44.113268+0000","last_clean":"2024-04-23T19:03:44.113268+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:44.113268+0000","last_undegraded":"2024-04-23T19:03:44.113268+0000","last_fullsized":"2024-04-23T19:03:44.113268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392559+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392559+0000","last_peered":"2024-04-23T19:03:43.392559+0000","last_clean":"2024-04-23T19:03:43.392559+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392559+0000","last_undegraded":"2024-04-23T19:03:43.392559+0000","last_fullsized":"2024-04-23T19:03:43.392559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391726+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:43.391726+0000","last_peered":"2024-04-23T19:03:43.391726+0000","last_clean":"2024-04-23T19:03:43.391726+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:43.391726+0000","last_undegraded":"2024-04-23T19:03:43.391726+0000","last_fullsized":"2024-04-23T19:03:43.391726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911075+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:03:43.911075+0000","last_peered":"2024-04-23T19:03:43.911075+0000","last_clean":"2024-04-23T19:03:43.911075+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:03:43.911075+0000","last_undegraded":"2024-04-23T19:03:43.911075+0000","last_fullsized":"2024-04-23T19:03:43.911075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"97'34","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115162+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:44.115162+0000","last_peered":"2024-04-23T19:03:44.115162+0000","last_clean":"2024-04-23T19:03:44.115162+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:44.115162+0000","last_undegraded":"2024-04-23T19:03:44.115162+0000","last_fullsized":"2024-04-23T19:03:44.115162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:41.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389646+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:03:43.389646+0000","last_peered":"2024-04-23T19:03:43.389646+0000","last_clean":"2024-04-23T19:03:43.389646+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:03:43.389646+0000","last_undegraded":"2024-04-23T19:03:43.389646+0000","last_fullsized":"2024-04-23T19:03:43.389646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"97'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709559+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:03:43.709559+0000","last_peered":"2024-04-23T19:03:43.709559+0000","last_clean":"2024-04-23T19:03:43.709559+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:03:43.709559+0000","last_undegraded":"2024-04-23T19:03:43.709559+0000","last_fullsized":"2024-04-23T19:03:43.709559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707915+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:03:43.707915+0000","last_peered":"2024-04-23T19:03:43.707915+0000","last_clean":"2024-04-23T19:03:43.707915+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:03:43.707915+0000","last_undegraded":"2024-04-23T19:03:43.707915+0000","last_fullsized":"2024-04-23T19:03:43.707915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"96'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393204+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:43.393204+0000","last_peered":"2024-04-23T19:03:43.393204+0000","last_clean":"2024-04-23T19:03:43.393204+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:43.393204+0000","last_undegraded":"2024-04-23T19:03:43.393204+0000","last_fullsized":"2024-04-23T19:03:43.393204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114590+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:03:44.114590+0000","last_peered":"2024-04-23T19:03:44.114590+0000","last_clean":"2024-04-23T19:03:44.114590+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:03:44.114590+0000","last_undegraded":"2024-04-23T19:03:44.114590+0000","last_fullsized":"2024-04-23T19:03:44.114590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"97'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389442+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:43.389442+0000","last_peered":"2024-04-23T19:03:43.389442+0000","last_clean":"2024-04-23T19:03:43.389442+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:43.389442+0000","last_undegraded":"2024-04-23T19:03:43.389442+0000","last_fullsized":"2024-04-23T19:03:43.389442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":72,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911047+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911047+0000","last_peered":"2024-04-23T19:03:43.911047+0000","last_clean":"2024-04-23T19:03:43.911047+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911047+0000","last_undegraded":"2024-04-23T19:03:43.911047+0000","last_fullsized":"2024-04-23T19:03:43.911047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"97'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390537+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:43.390537+0000","last_peered":"2024-04-23T19:03:43.390537+0000","last_clean":"2024-04-23T19:03:43.390537+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:43.390537+0000","last_undegraded":"2024-04-23T19:03:43.390537+0000","last_fullsized":"2024-04-23T19:03:43.390537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394043+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:03:43.394043+0000","last_peered":"2024-04-23T19:03:43.394043+0000","last_clean":"2024-04-23T19:03:43.394043+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:03:43.394043+0000","last_undegraded":"2024-04-23T19:03:43.394043+0000","last_fullsized":"2024-04-23T19:03:43.394043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"97'31","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388801+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:03:43.388801+0000","last_peered":"2024-04-23T19:03:43.388801+0000","last_clean":"2024-04-23T19:03:43.388801+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:03:43.388801+0000","last_undegraded":"2024-04-23T19:03:43.388801+0000","last_fullsized":"2024-04-23T19:03:43.388801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911790+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:03:43.911790+0000","last_peered":"2024-04-23T19:03:43.911790+0000","last_clean":"2024-04-23T19:03:43.911790+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:03:43.911790+0000","last_undegraded":"2024-04-23T19:03:43.911790+0000","last_fullsized":"2024-04-23T19:03:43.911790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"97'21","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113663+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:44.113663+0000","last_peered":"2024-04-23T19:03:44.113663+0000","last_clean":"2024-04-23T19:03:44.113663+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:44.113663+0000","last_undegraded":"2024-04-23T19:03:44.113663+0000","last_fullsized":"2024-04-23T19:03:44.113663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113841+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113841+0000","last_peered":"2024-04-23T19:03:44.113841+0000","last_clean":"2024-04-23T19:03:44.113841+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113841+0000","last_undegraded":"2024-04-23T19:03:44.113841+0000","last_fullsized":"2024-04-23T19:03:44.113841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708932+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:03:43.708932+0000","last_peered":"2024-04-23T19:03:43.708932+0000","last_clean":"2024-04-23T19:03:43.708932+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:03:43.708932+0000","last_undegraded":"2024-04-23T19:03:43.708932+0000","last_fullsized":"2024-04-23T19:03:43.708932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112309+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:03:44.112309+0000","last_peered":"2024-04-23T19:03:44.112309+0000","last_clean":"2024-04-23T19:03:44.112309+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:03:44.112309+0000","last_undegraded":"2024-04-23T19:03:44.112309+0000","last_fullsized":"2024-04-23T19:03:44.112309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115562+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:03:44.115562+0000","last_peered":"2024-04-23T19:03:44.115562+0000","last_clean":"2024-04-23T19:03:44.115562+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:03:44.115562+0000","last_undegraded":"2024-04-23T19:03:44.115562+0000","last_fullsized":"2024-04-23T19:03:44.115562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389396+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:03:43.389396+0000","last_peered":"2024-04-23T19:03:43.389396+0000","last_clean":"2024-04-23T19:03:43.389396+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:03:43.389396+0000","last_undegraded":"2024-04-23T19:03:43.389396+0000","last_fullsized":"2024-04-23T19:03:43.389396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"97'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394522+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:03:43.394522+0000","last_peered":"2024-04-23T19:03:43.394522+0000","last_clean":"2024-04-23T19:03:43.394522+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:03:43.394522+0000","last_undegraded":"2024-04-23T19:03:43.394522+0000","last_fullsized":"2024-04-23T19:03:43.394522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113173+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:03:44.113173+0000","last_peered":"2024-04-23T19:03:44.113173+0000","last_clean":"2024-04-23T19:03:44.113173+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:03:44.113173+0000","last_undegraded":"2024-04-23T19:03:44.113173+0000","last_fullsized":"2024-04-23T19:03:44.113173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"97'28","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393916+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:03:43.393916+0000","last_peered":"2024-04-23T19:03:43.393916+0000","last_clean":"2024-04-23T19:03:43.393916+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:03:43.393916+0000","last_undegraded":"2024-04-23T19:03:43.393916+0000","last_fullsized":"2024-04-23T19:03:43.393916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388784+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:43.388784+0000","last_peered":"2024-04-23T19:03:43.388784+0000","last_clean":"2024-04-23T19:03:43.388784+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:43.388784+0000","last_undegraded":"2024-04-23T19:03:43.388784+0000","last_fullsized":"2024-04-23T19:03:43.388784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114539+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:03:44.114539+0000","last_peered":"2024-04-23T19:03:44.114539+0000","last_clean":"2024-04-23T19:03:44.114539+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:03:44.114539+0000","last_undegraded":"2024-04-23T19:03:44.114539+0000","last_fullsized":"2024-04-23T19:03:44.114539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"97'28","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112893+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:44.112893+0000","last_peered":"2024-04-23T19:03:44.112893+0000","last_clean":"2024-04-23T19:03:44.112893+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:44.112893+0000","last_undegraded":"2024-04-23T19:03:44.112893+0000","last_fullsized":"2024-04-23T19:03:44.112893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:40.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390065+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:03:43.390065+0000","last_peered":"2024-04-23T19:03:43.390065+0000","last_clean":"2024-04-23T19:03:43.390065+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:03:43.390065+0000","last_undegraded":"2024-04-23T19:03:43.390065+0000","last_fullsized":"2024-04-23T19:03:43.390065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1072,"ondisk_log_size":1072,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386917,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":610,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1804708,"kb_used_data":1773520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92567132,"statfs":{"total":96636764160,"available":94788743168,"internally_reserved":0,"allocated":1816084480,"data_stored":1815444539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1197888,"kb_used_data":1166700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93173952,"statfs":{"total":96636764160,"available":95410126848,"internally_reserved":0,"allocated":1194700800,"data_stored":1194095951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693896,"kb_used_data":1658552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677944,"statfs":{"total":96636764160,"available":94902214656,"internally_reserved":0,"allocated":1698357248,"data_stored":1697703170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898284,"kb_used_data":1867096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473556,"statfs":{"total":96636764160,"available":94692921344,"internally_reserved":0,"allocated":1911906304,"data_stored":1911319884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1998852,"kb_used_data":1967668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92372988,"statfs":{"total":96636764160,"available":94589939712,"internally_reserved":0,"allocated":2014892032,"data_stored":2014257594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073000,"kb_used_data":1041812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93298840,"statfs":{"total":96636764160,"available":95538012160,"internally_reserved":0,"allocated":1066815488,"data_stored":1066225345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105984,"kb_used_data":1070636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93265856,"statfs":{"total":96636764160,"available":95504236544,"internally_reserved":0,"allocated":1096331264,"data_stored":1095704135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806796,"kb_used_data":1771448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92565044,"statfs":{"total":96636764160,"available":94786605056,"internally_reserved":0,"allocated":1813962752,"data_stored":1813346224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1811939328,"data_stored":1811939328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1094713344,"data_stored":1094713344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1065353216,"data_stored":1065353216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2013265920,"data_stored":2013265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1193279488,"data_stored":1193279488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814036480,"data_stored":1814036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":175817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":177182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":292907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:03:48.441 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-23T19:03:48.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-23T19:03:48.797 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-23T19:03:48.807 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-23T19:03:48.807 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:03:48.808 INFO:tasks.rgw.client.0.smithi169.stdout:2024-04-23T19:03:48.808+0000 7f6e366fb640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31971) UID: 0 2024-04-23T19:03:48.808 INFO:tasks.rgw.client.0.smithi169.stdout:2024-04-23T19:03:48.808+0000 7f6e39f43a40 -1 shutting down 2024-04-23T19:03:50.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-23T19:03:54.909 INFO:tasks.rgw.client.0:Stopped 2024-04-23T19:03:54.909 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-23T19:03:54.916 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/vault-root-token 2024-04-23T19:03:54.970 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-23T19:03:55.026 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-23T19:03:55.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-23T19:03:55.026 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-23T19:03:56.339 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T19:03:56.349 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T19:03:56.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:03:56.696 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:56.703 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:03:56.719 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-23T19:03:56.006641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823909,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3286,"num_read_kb":2969,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3900,"ondisk_log_size":3900,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12579344,"kb_used_data":12317432,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":742395376,"statfs":{"total":773094113280,"available":760212865024,"internally_reserved":0,"allocated":12613050368,"data_stored":12608096842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.041558"},"pg_stats":[{"pgid":"3.3f","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114847+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:03:44.114847+0000","last_peered":"2024-04-23T19:03:44.114847+0000","last_clean":"2024-04-23T19:03:44.114847+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:03:44.114847+0000","last_undegraded":"2024-04-23T19:03:44.114847+0000","last_fullsized":"2024-04-23T19:03:44.114847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387932+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:03:43.387932+0000","last_peered":"2024-04-23T19:03:43.387932+0000","last_clean":"2024-04-23T19:03:43.387932+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:03:43.387932+0000","last_undegraded":"2024-04-23T19:03:43.387932+0000","last_fullsized":"2024-04-23T19:03:43.387932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"97'24","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115512+0000","last_change":"2024-04-23T19:03:32.293577+0000","last_active":"2024-04-23T19:03:44.115512+0000","last_peered":"2024-04-23T19:03:44.115512+0000","last_clean":"2024-04-23T19:03:44.115512+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:03:44.115512+0000","last_undegraded":"2024-04-23T19:03:44.115512+0000","last_fullsized":"2024-04-23T19:03:44.115512+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:33.579201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113300+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:03:44.113300+0000","last_peered":"2024-04-23T19:03:44.113300+0000","last_clean":"2024-04-23T19:03:44.113300+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:03:44.113300+0000","last_undegraded":"2024-04-23T19:03:44.113300+0000","last_fullsized":"2024-04-23T19:03:44.113300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'29","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114019+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:44.114019+0000","last_peered":"2024-04-23T19:03:44.114019+0000","last_clean":"2024-04-23T19:03:44.114019+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:44.114019+0000","last_undegraded":"2024-04-23T19:03:44.114019+0000","last_fullsized":"2024-04-23T19:03:44.114019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910402+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:03:43.910402+0000","last_peered":"2024-04-23T19:03:43.910402+0000","last_clean":"2024-04-23T19:03:43.910402+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:03:43.910402+0000","last_undegraded":"2024-04-23T19:03:43.910402+0000","last_fullsized":"2024-04-23T19:03:43.910402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389189+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:03:43.389189+0000","last_peered":"2024-04-23T19:03:43.389189+0000","last_clean":"2024-04-23T19:03:43.389189+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:03:43.389189+0000","last_undegraded":"2024-04-23T19:03:43.389189+0000","last_fullsized":"2024-04-23T19:03:43.389189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113499+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113499+0000","last_peered":"2024-04-23T19:03:44.113499+0000","last_clean":"2024-04-23T19:03:44.113499+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113499+0000","last_undegraded":"2024-04-23T19:03:44.113499+0000","last_fullsized":"2024-04-23T19:03:44.113499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114187+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:44.114187+0000","last_peered":"2024-04-23T19:03:44.114187+0000","last_clean":"2024-04-23T19:03:44.114187+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:44.114187+0000","last_undegraded":"2024-04-23T19:03:44.114187+0000","last_fullsized":"2024-04-23T19:03:44.114187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708709+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:03:43.708709+0000","last_peered":"2024-04-23T19:03:43.708709+0000","last_clean":"2024-04-23T19:03:43.708709+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:03:43.708709+0000","last_undegraded":"2024-04-23T19:03:43.708709+0000","last_fullsized":"2024-04-23T19:03:43.708709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"97'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388451+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:03:43.388451+0000","last_peered":"2024-04-23T19:03:43.388451+0000","last_clean":"2024-04-23T19:03:43.388451+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:03:43.388451+0000","last_undegraded":"2024-04-23T19:03:43.388451+0000","last_fullsized":"2024-04-23T19:03:43.388451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910574+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:03:43.910574+0000","last_peered":"2024-04-23T19:03:43.910574+0000","last_clean":"2024-04-23T19:03:43.910574+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:03:43.910574+0000","last_undegraded":"2024-04-23T19:03:43.910574+0000","last_fullsized":"2024-04-23T19:03:43.910574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"97'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113605+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:44.113605+0000","last_peered":"2024-04-23T19:03:44.113605+0000","last_clean":"2024-04-23T19:03:44.113605+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:44.113605+0000","last_undegraded":"2024-04-23T19:03:44.113605+0000","last_fullsized":"2024-04-23T19:03:44.113605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389716+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:03:43.389716+0000","last_peered":"2024-04-23T19:03:43.389716+0000","last_clean":"2024-04-23T19:03:43.389716+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:03:43.389716+0000","last_undegraded":"2024-04-23T19:03:43.389716+0000","last_fullsized":"2024-04-23T19:03:43.389716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391449+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:43.391449+0000","last_peered":"2024-04-23T19:03:43.391449+0000","last_clean":"2024-04-23T19:03:43.391449+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:43.391449+0000","last_undegraded":"2024-04-23T19:03:43.391449+0000","last_fullsized":"2024-04-23T19:03:43.391449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394333+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:03:43.394333+0000","last_peered":"2024-04-23T19:03:43.394333+0000","last_clean":"2024-04-23T19:03:43.394333+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:03:43.394333+0000","last_undegraded":"2024-04-23T19:03:43.394333+0000","last_fullsized":"2024-04-23T19:03:43.394333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909061+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909061+0000","last_peered":"2024-04-23T19:03:43.909061+0000","last_clean":"2024-04-23T19:03:43.909061+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909061+0000","last_undegraded":"2024-04-23T19:03:43.909061+0000","last_fullsized":"2024-04-23T19:03:43.909061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"96'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114901+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:03:44.114901+0000","last_peered":"2024-04-23T19:03:44.114901+0000","last_clean":"2024-04-23T19:03:44.114901+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:03:44.114901+0000","last_undegraded":"2024-04-23T19:03:44.114901+0000","last_fullsized":"2024-04-23T19:03:44.114901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113766+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:03:44.113766+0000","last_peered":"2024-04-23T19:03:44.113766+0000","last_clean":"2024-04-23T19:03:44.113766+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:03:44.113766+0000","last_undegraded":"2024-04-23T19:03:44.113766+0000","last_fullsized":"2024-04-23T19:03:44.113766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709366+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:03:43.709366+0000","last_peered":"2024-04-23T19:03:43.709366+0000","last_clean":"2024-04-23T19:03:43.709366+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:03:43.709366+0000","last_undegraded":"2024-04-23T19:03:43.709366+0000","last_fullsized":"2024-04-23T19:03:43.709366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388767+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:03:43.388767+0000","last_peered":"2024-04-23T19:03:43.388767+0000","last_clean":"2024-04-23T19:03:43.388767+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:03:43.388767+0000","last_undegraded":"2024-04-23T19:03:43.388767+0000","last_fullsized":"2024-04-23T19:03:43.388767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709535+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:03:43.709535+0000","last_peered":"2024-04-23T19:03:43.709535+0000","last_clean":"2024-04-23T19:03:43.709535+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:03:43.709535+0000","last_undegraded":"2024-04-23T19:03:43.709535+0000","last_fullsized":"2024-04-23T19:03:43.709535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394020+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:03:43.394020+0000","last_peered":"2024-04-23T19:03:43.394020+0000","last_clean":"2024-04-23T19:03:43.394020+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:03:43.394020+0000","last_undegraded":"2024-04-23T19:03:43.394020+0000","last_fullsized":"2024-04-23T19:03:43.394020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"97'16","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910749+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:43.910749+0000","last_peered":"2024-04-23T19:03:43.910749+0000","last_clean":"2024-04-23T19:03:43.910749+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:43.910749+0000","last_undegraded":"2024-04-23T19:03:43.910749+0000","last_fullsized":"2024-04-23T19:03:43.910749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393743+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:03:43.393743+0000","last_peered":"2024-04-23T19:03:43.393743+0000","last_clean":"2024-04-23T19:03:43.393743+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:03:43.393743+0000","last_undegraded":"2024-04-23T19:03:43.393743+0000","last_fullsized":"2024-04-23T19:03:43.393743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"97'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392095+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:43.392095+0000","last_peered":"2024-04-23T19:03:43.392095+0000","last_clean":"2024-04-23T19:03:43.392095+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:43.392095+0000","last_undegraded":"2024-04-23T19:03:43.392095+0000","last_fullsized":"2024-04-23T19:03:43.392095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910786+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:03:43.910786+0000","last_peered":"2024-04-23T19:03:43.910786+0000","last_clean":"2024-04-23T19:03:43.910786+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:03:43.910786+0000","last_undegraded":"2024-04-23T19:03:43.910786+0000","last_fullsized":"2024-04-23T19:03:43.910786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112591+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:44.112591+0000","last_peered":"2024-04-23T19:03:44.112591+0000","last_clean":"2024-04-23T19:03:44.112591+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:44.112591+0000","last_undegraded":"2024-04-23T19:03:44.112591+0000","last_fullsized":"2024-04-23T19:03:44.112591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908784+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908784+0000","last_peered":"2024-04-23T19:03:43.908784+0000","last_clean":"2024-04-23T19:03:43.908784+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908784+0000","last_undegraded":"2024-04-23T19:03:43.908784+0000","last_fullsized":"2024-04-23T19:03:43.908784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391510+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:03:43.391510+0000","last_peered":"2024-04-23T19:03:43.391510+0000","last_clean":"2024-04-23T19:03:43.391510+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:03:43.391510+0000","last_undegraded":"2024-04-23T19:03:43.391510+0000","last_fullsized":"2024-04-23T19:03:43.391510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'24","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393870+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:03:43.393870+0000","last_peered":"2024-04-23T19:03:43.393870+0000","last_clean":"2024-04-23T19:03:43.393870+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:03:43.393870+0000","last_undegraded":"2024-04-23T19:03:43.393870+0000","last_fullsized":"2024-04-23T19:03:43.393870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389567+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:03:43.389567+0000","last_peered":"2024-04-23T19:03:43.389567+0000","last_clean":"2024-04-23T19:03:43.389567+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:03:43.389567+0000","last_undegraded":"2024-04-23T19:03:43.389567+0000","last_fullsized":"2024-04-23T19:03:43.389567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'19","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113502+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:44.113502+0000","last_peered":"2024-04-23T19:03:44.113502+0000","last_clean":"2024-04-23T19:03:44.113502+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:44.113502+0000","last_undegraded":"2024-04-23T19:03:44.113502+0000","last_fullsized":"2024-04-23T19:03:44.113502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114445+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114445+0000","last_peered":"2024-04-23T19:03:44.114445+0000","last_clean":"2024-04-23T19:03:44.114445+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114445+0000","last_undegraded":"2024-04-23T19:03:44.114445+0000","last_fullsized":"2024-04-23T19:03:44.114445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387854+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.387854+0000","last_peered":"2024-04-23T19:03:43.387854+0000","last_clean":"2024-04-23T19:03:43.387854+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.387854+0000","last_undegraded":"2024-04-23T19:03:43.387854+0000","last_fullsized":"2024-04-23T19:03:43.387854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390204+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:03:43.390204+0000","last_peered":"2024-04-23T19:03:43.390204+0000","last_clean":"2024-04-23T19:03:43.390204+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:03:43.390204+0000","last_undegraded":"2024-04-23T19:03:43.390204+0000","last_fullsized":"2024-04-23T19:03:43.390204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"97'31","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112702+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:44.112702+0000","last_peered":"2024-04-23T19:03:44.112702+0000","last_clean":"2024-04-23T19:03:44.112702+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:44.112702+0000","last_undegraded":"2024-04-23T19:03:44.112702+0000","last_fullsized":"2024-04-23T19:03:44.112702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391268+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391268+0000","last_peered":"2024-04-23T19:03:43.391268+0000","last_clean":"2024-04-23T19:03:43.391268+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391268+0000","last_undegraded":"2024-04-23T19:03:43.391268+0000","last_fullsized":"2024-04-23T19:03:43.391268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911442+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:03:43.911442+0000","last_peered":"2024-04-23T19:03:43.911442+0000","last_clean":"2024-04-23T19:03:43.911442+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:03:43.911442+0000","last_undegraded":"2024-04-23T19:03:43.911442+0000","last_fullsized":"2024-04-23T19:03:43.911442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910291+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910291+0000","last_peered":"2024-04-23T19:03:43.910291+0000","last_clean":"2024-04-23T19:03:43.910291+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910291+0000","last_undegraded":"2024-04-23T19:03:43.910291+0000","last_fullsized":"2024-04-23T19:03:43.910291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112392+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:03:44.112392+0000","last_peered":"2024-04-23T19:03:44.112392+0000","last_clean":"2024-04-23T19:03:44.112392+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:03:44.112392+0000","last_undegraded":"2024-04-23T19:03:44.112392+0000","last_fullsized":"2024-04-23T19:03:44.112392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114249+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:03:44.114249+0000","last_peered":"2024-04-23T19:03:44.114249+0000","last_clean":"2024-04-23T19:03:44.114249+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:03:44.114249+0000","last_undegraded":"2024-04-23T19:03:44.114249+0000","last_fullsized":"2024-04-23T19:03:44.114249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113863+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:44.113863+0000","last_peered":"2024-04-23T19:03:44.113863+0000","last_clean":"2024-04-23T19:03:44.113863+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:44.113863+0000","last_undegraded":"2024-04-23T19:03:44.113863+0000","last_fullsized":"2024-04-23T19:03:44.113863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393525+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:03:43.393525+0000","last_peered":"2024-04-23T19:03:43.393525+0000","last_clean":"2024-04-23T19:03:43.393525+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:03:43.393525+0000","last_undegraded":"2024-04-23T19:03:43.393525+0000","last_fullsized":"2024-04-23T19:03:43.393525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393562+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:03:43.393562+0000","last_peered":"2024-04-23T19:03:43.393562+0000","last_clean":"2024-04-23T19:03:43.393562+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:03:43.393562+0000","last_undegraded":"2024-04-23T19:03:43.393562+0000","last_fullsized":"2024-04-23T19:03:43.393562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'135","reported_seq":359,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558126+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:44.558126+0000","last_peered":"2024-04-23T19:03:44.558126+0000","last_clean":"2024-04-23T19:03:44.558126+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:44.558126+0000","last_undegraded":"2024-04-23T19:03:44.558126+0000","last_fullsized":"2024-04-23T19:03:44.558126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909665+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909665+0000","last_peered":"2024-04-23T19:03:43.909665+0000","last_clean":"2024-04-23T19:03:43.909665+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909665+0000","last_undegraded":"2024-04-23T19:03:43.909665+0000","last_fullsized":"2024-04-23T19:03:43.909665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393124+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:03:43.393124+0000","last_peered":"2024-04-23T19:03:43.393124+0000","last_clean":"2024-04-23T19:03:43.393124+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:03:43.393124+0000","last_undegraded":"2024-04-23T19:03:43.393124+0000","last_fullsized":"2024-04-23T19:03:43.393124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"97'24","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708227+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:03:43.708227+0000","last_peered":"2024-04-23T19:03:43.708227+0000","last_clean":"2024-04-23T19:03:43.708227+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:03:43.708227+0000","last_undegraded":"2024-04-23T19:03:43.708227+0000","last_fullsized":"2024-04-23T19:03:43.708227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389457+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:03:43.389457+0000","last_peered":"2024-04-23T19:03:43.389457+0000","last_clean":"2024-04-23T19:03:43.389457+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:03:43.389457+0000","last_undegraded":"2024-04-23T19:03:43.389457+0000","last_fullsized":"2024-04-23T19:03:43.389457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114533+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:03:44.114533+0000","last_peered":"2024-04-23T19:03:44.114533+0000","last_clean":"2024-04-23T19:03:44.114533+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:03:44.114533+0000","last_undegraded":"2024-04-23T19:03:44.114533+0000","last_fullsized":"2024-04-23T19:03:44.114533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557946+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:03:44.557946+0000","last_peered":"2024-04-23T19:03:44.557946+0000","last_clean":"2024-04-23T19:03:44.557946+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:03:44.557946+0000","last_undegraded":"2024-04-23T19:03:44.557946+0000","last_fullsized":"2024-04-23T19:03:44.557946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388486+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:03:43.388486+0000","last_peered":"2024-04-23T19:03:43.388486+0000","last_clean":"2024-04-23T19:03:43.388486+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:03:43.388486+0000","last_undegraded":"2024-04-23T19:03:43.388486+0000","last_fullsized":"2024-04-23T19:03:43.388486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115034+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:03:44.115034+0000","last_peered":"2024-04-23T19:03:44.115034+0000","last_clean":"2024-04-23T19:03:44.115034+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:03:44.115034+0000","last_undegraded":"2024-04-23T19:03:44.115034+0000","last_fullsized":"2024-04-23T19:03:44.115034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112930+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:03:44.112930+0000","last_peered":"2024-04-23T19:03:44.112930+0000","last_clean":"2024-04-23T19:03:44.112930+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:03:44.112930+0000","last_undegraded":"2024-04-23T19:03:44.112930+0000","last_fullsized":"2024-04-23T19:03:44.112930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388052+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:03:43.388052+0000","last_peered":"2024-04-23T19:03:43.388052+0000","last_clean":"2024-04-23T19:03:43.388052+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:03:43.388052+0000","last_undegraded":"2024-04-23T19:03:43.388052+0000","last_fullsized":"2024-04-23T19:03:43.388052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113425+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:03:44.113425+0000","last_peered":"2024-04-23T19:03:44.113425+0000","last_clean":"2024-04-23T19:03:44.113425+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:03:44.113425+0000","last_undegraded":"2024-04-23T19:03:44.113425+0000","last_fullsized":"2024-04-23T19:03:44.113425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388724+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388724+0000","last_peered":"2024-04-23T19:03:43.388724+0000","last_clean":"2024-04-23T19:03:43.388724+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388724+0000","last_undegraded":"2024-04-23T19:03:43.388724+0000","last_fullsized":"2024-04-23T19:03:43.388724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909389+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909389+0000","last_peered":"2024-04-23T19:03:43.909389+0000","last_clean":"2024-04-23T19:03:43.909389+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909389+0000","last_undegraded":"2024-04-23T19:03:43.909389+0000","last_fullsized":"2024-04-23T19:03:43.909389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'31","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115277+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:44.115277+0000","last_peered":"2024-04-23T19:03:44.115277+0000","last_clean":"2024-04-23T19:03:44.115277+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:44.115277+0000","last_undegraded":"2024-04-23T19:03:44.115277+0000","last_fullsized":"2024-04-23T19:03:44.115277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388320+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:03:43.388320+0000","last_peered":"2024-04-23T19:03:43.388320+0000","last_clean":"2024-04-23T19:03:43.388320+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:03:43.388320+0000","last_undegraded":"2024-04-23T19:03:43.388320+0000","last_fullsized":"2024-04-23T19:03:43.388320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392626+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:03:43.392626+0000","last_peered":"2024-04-23T19:03:43.392626+0000","last_clean":"2024-04-23T19:03:43.392626+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:03:43.392626+0000","last_undegraded":"2024-04-23T19:03:43.392626+0000","last_fullsized":"2024-04-23T19:03:43.392626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390803+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:03:43.390803+0000","last_peered":"2024-04-23T19:03:43.390803+0000","last_clean":"2024-04-23T19:03:43.390803+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:03:43.390803+0000","last_undegraded":"2024-04-23T19:03:43.390803+0000","last_fullsized":"2024-04-23T19:03:43.390803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708652+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708652+0000","last_peered":"2024-04-23T19:03:43.708652+0000","last_clean":"2024-04-23T19:03:43.708652+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708652+0000","last_undegraded":"2024-04-23T19:03:43.708652+0000","last_fullsized":"2024-04-23T19:03:43.708652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708882+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:03:43.708882+0000","last_peered":"2024-04-23T19:03:43.708882+0000","last_clean":"2024-04-23T19:03:43.708882+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:03:43.708882+0000","last_undegraded":"2024-04-23T19:03:43.708882+0000","last_fullsized":"2024-04-23T19:03:43.708882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"97'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115464+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:03:44.115464+0000","last_peered":"2024-04-23T19:03:44.115464+0000","last_clean":"2024-04-23T19:03:44.115464+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:03:44.115464+0000","last_undegraded":"2024-04-23T19:03:44.115464+0000","last_fullsized":"2024-04-23T19:03:44.115464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394271+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:03:43.394271+0000","last_peered":"2024-04-23T19:03:43.394271+0000","last_clean":"2024-04-23T19:03:43.394271+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:03:43.394271+0000","last_undegraded":"2024-04-23T19:03:43.394271+0000","last_fullsized":"2024-04-23T19:03:43.394271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'23","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113515+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:03:44.113515+0000","last_peered":"2024-04-23T19:03:44.113515+0000","last_clean":"2024-04-23T19:03:44.113515+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:03:44.113515+0000","last_undegraded":"2024-04-23T19:03:44.113515+0000","last_fullsized":"2024-04-23T19:03:44.113515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557648+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:03:44.557648+0000","last_peered":"2024-04-23T19:03:44.557648+0000","last_clean":"2024-04-23T19:03:44.557648+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:03:44.557648+0000","last_undegraded":"2024-04-23T19:03:44.557648+0000","last_fullsized":"2024-04-23T19:03:44.557648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113763+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:03:44.113763+0000","last_peered":"2024-04-23T19:03:44.113763+0000","last_clean":"2024-04-23T19:03:44.113763+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:44.113763+0000","last_undegraded":"2024-04-23T19:03:44.113763+0000","last_fullsized":"2024-04-23T19:03:44.113763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113964+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.113964+0000","last_peered":"2024-04-23T19:03:44.113964+0000","last_clean":"2024-04-23T19:03:44.113964+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.113964+0000","last_undegraded":"2024-04-23T19:03:44.113964+0000","last_fullsized":"2024-04-23T19:03:44.113964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389851+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:43.389851+0000","last_peered":"2024-04-23T19:03:43.389851+0000","last_clean":"2024-04-23T19:03:43.389851+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:43.389851+0000","last_undegraded":"2024-04-23T19:03:43.389851+0000","last_fullsized":"2024-04-23T19:03:43.389851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393360+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:03:43.393360+0000","last_peered":"2024-04-23T19:03:43.393360+0000","last_clean":"2024-04-23T19:03:43.393360+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:03:43.393360+0000","last_undegraded":"2024-04-23T19:03:43.393360+0000","last_fullsized":"2024-04-23T19:03:43.393360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'30","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112891+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:03:44.112891+0000","last_peered":"2024-04-23T19:03:44.112891+0000","last_clean":"2024-04-23T19:03:44.112891+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:03:44.112891+0000","last_undegraded":"2024-04-23T19:03:44.112891+0000","last_fullsized":"2024-04-23T19:03:44.112891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389128+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:03:43.389128+0000","last_peered":"2024-04-23T19:03:43.389128+0000","last_clean":"2024-04-23T19:03:43.389128+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:03:43.389128+0000","last_undegraded":"2024-04-23T19:03:43.389128+0000","last_fullsized":"2024-04-23T19:03:43.389128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'8","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115520+0000","last_change":"2024-04-23T19:03:32.295412+0000","last_active":"2024-04-23T19:03:44.115520+0000","last_peered":"2024-04-23T19:03:44.115520+0000","last_clean":"2024-04-23T19:03:44.115520+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:03:44.115520+0000","last_undegraded":"2024-04-23T19:03:44.115520+0000","last_fullsized":"2024-04-23T19:03:44.115520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:38.660742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911690+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:03:43.911690+0000","last_peered":"2024-04-23T19:03:43.911690+0000","last_clean":"2024-04-23T19:03:43.911690+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:03:43.911690+0000","last_undegraded":"2024-04-23T19:03:43.911690+0000","last_fullsized":"2024-04-23T19:03:43.911690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391669+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:43.391669+0000","last_peered":"2024-04-23T19:03:43.391669+0000","last_clean":"2024-04-23T19:03:43.391669+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:43.391669+0000","last_undegraded":"2024-04-23T19:03:43.391669+0000","last_fullsized":"2024-04-23T19:03:43.391669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393878+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:03:43.393878+0000","last_peered":"2024-04-23T19:03:43.393878+0000","last_clean":"2024-04-23T19:03:43.393878+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:03:43.393878+0000","last_undegraded":"2024-04-23T19:03:43.393878+0000","last_fullsized":"2024-04-23T19:03:43.393878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910655+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:03:43.910655+0000","last_peered":"2024-04-23T19:03:43.910655+0000","last_clean":"2024-04-23T19:03:43.910655+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:03:43.910655+0000","last_undegraded":"2024-04-23T19:03:43.910655+0000","last_fullsized":"2024-04-23T19:03:43.910655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114514+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114514+0000","last_peered":"2024-04-23T19:03:44.114514+0000","last_clean":"2024-04-23T19:03:44.114514+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114514+0000","last_undegraded":"2024-04-23T19:03:44.114514+0000","last_fullsized":"2024-04-23T19:03:44.114514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388173+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388173+0000","last_peered":"2024-04-23T19:03:43.388173+0000","last_clean":"2024-04-23T19:03:43.388173+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388173+0000","last_undegraded":"2024-04-23T19:03:43.388173+0000","last_fullsized":"2024-04-23T19:03:43.388173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911045+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:03:43.911045+0000","last_peered":"2024-04-23T19:03:43.911045+0000","last_clean":"2024-04-23T19:03:43.911045+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:03:43.911045+0000","last_undegraded":"2024-04-23T19:03:43.911045+0000","last_fullsized":"2024-04-23T19:03:43.911045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709068+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:03:43.709068+0000","last_peered":"2024-04-23T19:03:43.709068+0000","last_clean":"2024-04-23T19:03:43.709068+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:03:43.709068+0000","last_undegraded":"2024-04-23T19:03:43.709068+0000","last_fullsized":"2024-04-23T19:03:43.709068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113707+0000","last_change":"2024-04-23T19:03:32.296246+0000","last_active":"2024-04-23T19:03:44.113707+0000","last_peered":"2024-04-23T19:03:44.113707+0000","last_clean":"2024-04-23T19:03:44.113707+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:03:44.113707+0000","last_undegraded":"2024-04-23T19:03:44.113707+0000","last_fullsized":"2024-04-23T19:03:44.113707+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:48.818498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394174+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:03:43.394174+0000","last_peered":"2024-04-23T19:03:43.394174+0000","last_clean":"2024-04-23T19:03:43.394174+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:03:43.394174+0000","last_undegraded":"2024-04-23T19:03:43.394174+0000","last_fullsized":"2024-04-23T19:03:43.394174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'135","reported_seq":376,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558589+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:03:44.558589+0000","last_peered":"2024-04-23T19:03:44.558589+0000","last_clean":"2024-04-23T19:03:44.558589+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:03:44.558589+0000","last_undegraded":"2024-04-23T19:03:44.558589+0000","last_fullsized":"2024-04-23T19:03:44.558589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":154,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112679+0000","last_change":"2024-04-23T19:03:32.290672+0000","last_active":"2024-04-23T19:03:44.112679+0000","last_peered":"2024-04-23T19:03:44.112679+0000","last_clean":"2024-04-23T19:03:44.112679+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:03:44.112679+0000","last_undegraded":"2024-04-23T19:03:44.112679+0000","last_fullsized":"2024-04-23T19:03:44.112679+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:19.410020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911686+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:03:43.911686+0000","last_peered":"2024-04-23T19:03:43.911686+0000","last_clean":"2024-04-23T19:03:43.911686+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:03:43.911686+0000","last_undegraded":"2024-04-23T19:03:43.911686+0000","last_fullsized":"2024-04-23T19:03:43.911686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910029+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:43.910029+0000","last_peered":"2024-04-23T19:03:43.910029+0000","last_clean":"2024-04-23T19:03:43.910029+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:43.910029+0000","last_undegraded":"2024-04-23T19:03:43.910029+0000","last_fullsized":"2024-04-23T19:03:43.910029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390002+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:03:43.390002+0000","last_peered":"2024-04-23T19:03:43.390002+0000","last_clean":"2024-04-23T19:03:43.390002+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:03:43.390002+0000","last_undegraded":"2024-04-23T19:03:43.390002+0000","last_fullsized":"2024-04-23T19:03:43.390002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"98'12","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390965+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:03:43.390965+0000","last_peered":"2024-04-23T19:03:43.390965+0000","last_clean":"2024-04-23T19:03:43.390965+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:03:43.390965+0000","last_undegraded":"2024-04-23T19:03:43.390965+0000","last_fullsized":"2024-04-23T19:03:43.390965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'135","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557251+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:03:44.557251+0000","last_peered":"2024-04-23T19:03:44.557251+0000","last_clean":"2024-04-23T19:03:44.557251+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:03:44.557251+0000","last_undegraded":"2024-04-23T19:03:44.557251+0000","last_fullsized":"2024-04-23T19:03:44.557251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910131+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910131+0000","last_peered":"2024-04-23T19:03:43.910131+0000","last_clean":"2024-04-23T19:03:43.910131+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910131+0000","last_undegraded":"2024-04-23T19:03:43.910131+0000","last_fullsized":"2024-04-23T19:03:43.910131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115660+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:03:44.115660+0000","last_peered":"2024-04-23T19:03:44.115660+0000","last_clean":"2024-04-23T19:03:44.115660+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:03:44.115660+0000","last_undegraded":"2024-04-23T19:03:44.115660+0000","last_fullsized":"2024-04-23T19:03:44.115660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391592+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:43.391592+0000","last_peered":"2024-04-23T19:03:43.391592+0000","last_clean":"2024-04-23T19:03:43.391592+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:43.391592+0000","last_undegraded":"2024-04-23T19:03:43.391592+0000","last_fullsized":"2024-04-23T19:03:43.391592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910950+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:03:43.910950+0000","last_peered":"2024-04-23T19:03:43.910950+0000","last_clean":"2024-04-23T19:03:43.910950+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:03:43.910950+0000","last_undegraded":"2024-04-23T19:03:43.910950+0000","last_fullsized":"2024-04-23T19:03:43.910950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'26","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389169+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:43.389169+0000","last_peered":"2024-04-23T19:03:43.389169+0000","last_clean":"2024-04-23T19:03:43.389169+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:43.389169+0000","last_undegraded":"2024-04-23T19:03:43.389169+0000","last_fullsized":"2024-04-23T19:03:43.389169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708197+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:03:43.708197+0000","last_peered":"2024-04-23T19:03:43.708197+0000","last_clean":"2024-04-23T19:03:43.708197+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:03:43.708197+0000","last_undegraded":"2024-04-23T19:03:43.708197+0000","last_fullsized":"2024-04-23T19:03:43.708197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113320+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113320+0000","last_peered":"2024-04-23T19:03:44.113320+0000","last_clean":"2024-04-23T19:03:44.113320+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113320+0000","last_undegraded":"2024-04-23T19:03:44.113320+0000","last_fullsized":"2024-04-23T19:03:44.113320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:09.210430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709271+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:03:43.709271+0000","last_peered":"2024-04-23T19:03:43.709271+0000","last_clean":"2024-04-23T19:03:43.709271+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:03:43.709271+0000","last_undegraded":"2024-04-23T19:03:43.709271+0000","last_fullsized":"2024-04-23T19:03:43.709271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113725+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:03:44.113725+0000","last_peered":"2024-04-23T19:03:44.113725+0000","last_clean":"2024-04-23T19:03:44.113725+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:03:44.113725+0000","last_undegraded":"2024-04-23T19:03:44.113725+0000","last_fullsized":"2024-04-23T19:03:44.113725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389218+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:03:43.389218+0000","last_peered":"2024-04-23T19:03:43.389218+0000","last_clean":"2024-04-23T19:03:43.389218+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:03:43.389218+0000","last_undegraded":"2024-04-23T19:03:43.389218+0000","last_fullsized":"2024-04-23T19:03:43.389218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391341+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:43.391341+0000","last_peered":"2024-04-23T19:03:43.391341+0000","last_clean":"2024-04-23T19:03:43.391341+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:43.391341+0000","last_undegraded":"2024-04-23T19:03:43.391341+0000","last_fullsized":"2024-04-23T19:03:43.391341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114228+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:03:44.114228+0000","last_peered":"2024-04-23T19:03:44.114228+0000","last_clean":"2024-04-23T19:03:44.114228+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:03:44.114228+0000","last_undegraded":"2024-04-23T19:03:44.114228+0000","last_fullsized":"2024-04-23T19:03:44.114228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'39","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390341+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:03:43.390341+0000","last_peered":"2024-04-23T19:03:43.390341+0000","last_clean":"2024-04-23T19:03:43.390341+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:03:43.390341+0000","last_undegraded":"2024-04-23T19:03:43.390341+0000","last_fullsized":"2024-04-23T19:03:43.390341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113854+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:03:44.113854+0000","last_peered":"2024-04-23T19:03:44.113854+0000","last_clean":"2024-04-23T19:03:44.113854+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:03:44.113854+0000","last_undegraded":"2024-04-23T19:03:44.113854+0000","last_fullsized":"2024-04-23T19:03:44.113854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707656+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707656+0000","last_peered":"2024-04-23T19:03:43.707656+0000","last_clean":"2024-04-23T19:03:43.707656+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707656+0000","last_undegraded":"2024-04-23T19:03:43.707656+0000","last_fullsized":"2024-04-23T19:03:43.707656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114161+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:03:44.114161+0000","last_peered":"2024-04-23T19:03:44.114161+0000","last_clean":"2024-04-23T19:03:44.114161+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:03:44.114161+0000","last_undegraded":"2024-04-23T19:03:44.114161+0000","last_fullsized":"2024-04-23T19:03:44.114161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113340+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:03:44.113340+0000","last_peered":"2024-04-23T19:03:44.113340+0000","last_clean":"2024-04-23T19:03:44.113340+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:03:44.113340+0000","last_undegraded":"2024-04-23T19:03:44.113340+0000","last_fullsized":"2024-04-23T19:03:44.113340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112983+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:44.112983+0000","last_peered":"2024-04-23T19:03:44.112983+0000","last_clean":"2024-04-23T19:03:44.112983+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:44.112983+0000","last_undegraded":"2024-04-23T19:03:44.112983+0000","last_fullsized":"2024-04-23T19:03:44.112983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390688+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:03:43.390688+0000","last_peered":"2024-04-23T19:03:43.390688+0000","last_clean":"2024-04-23T19:03:43.390688+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:03:43.390688+0000","last_undegraded":"2024-04-23T19:03:43.390688+0000","last_fullsized":"2024-04-23T19:03:43.390688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'137","reported_seq":429,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558590+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:03:44.558590+0000","last_peered":"2024-04-23T19:03:44.558590+0000","last_clean":"2024-04-23T19:03:44.558590+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:03:44.558590+0000","last_undegraded":"2024-04-23T19:03:44.558590+0000","last_fullsized":"2024-04-23T19:03:44.558590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114354+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114354+0000","last_peered":"2024-04-23T19:03:44.114354+0000","last_clean":"2024-04-23T19:03:44.114354+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114354+0000","last_undegraded":"2024-04-23T19:03:44.114354+0000","last_fullsized":"2024-04-23T19:03:44.114354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112303+0000","last_change":"2024-04-23T19:03:32.286556+0000","last_active":"2024-04-23T19:03:44.112303+0000","last_peered":"2024-04-23T19:03:44.112303+0000","last_clean":"2024-04-23T19:03:44.112303+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:03:44.112303+0000","last_undegraded":"2024-04-23T19:03:44.112303+0000","last_fullsized":"2024-04-23T19:03:44.112303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:18.008985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115727+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:03:44.115727+0000","last_peered":"2024-04-23T19:03:44.115727+0000","last_clean":"2024-04-23T19:03:44.115727+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:03:44.115727+0000","last_undegraded":"2024-04-23T19:03:44.115727+0000","last_fullsized":"2024-04-23T19:03:44.115727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389027+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:03:43.389027+0000","last_peered":"2024-04-23T19:03:43.389027+0000","last_clean":"2024-04-23T19:03:43.389027+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:03:43.389027+0000","last_undegraded":"2024-04-23T19:03:43.389027+0000","last_fullsized":"2024-04-23T19:03:43.389027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"96'14","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112139+0000","last_change":"2024-04-23T19:03:32.290315+0000","last_active":"2024-04-23T19:03:44.112139+0000","last_peered":"2024-04-23T19:03:44.112139+0000","last_clean":"2024-04-23T19:03:44.112139+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:03:44.112139+0000","last_undegraded":"2024-04-23T19:03:44.112139+0000","last_fullsized":"2024-04-23T19:03:44.112139+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:50.252138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393921+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:03:43.393921+0000","last_peered":"2024-04-23T19:03:43.393921+0000","last_clean":"2024-04-23T19:03:43.393921+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:03:43.393921+0000","last_undegraded":"2024-04-23T19:03:43.393921+0000","last_fullsized":"2024-04-23T19:03:43.393921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113413+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:03:44.113413+0000","last_peered":"2024-04-23T19:03:44.113413+0000","last_clean":"2024-04-23T19:03:44.113413+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:03:44.113413+0000","last_undegraded":"2024-04-23T19:03:44.113413+0000","last_fullsized":"2024-04-23T19:03:44.113413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392383+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392383+0000","last_peered":"2024-04-23T19:03:43.392383+0000","last_clean":"2024-04-23T19:03:43.392383+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392383+0000","last_undegraded":"2024-04-23T19:03:43.392383+0000","last_fullsized":"2024-04-23T19:03:43.392383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113895+0000","last_change":"2024-04-23T19:03:32.300198+0000","last_active":"2024-04-23T19:03:44.113895+0000","last_peered":"2024-04-23T19:03:44.113895+0000","last_clean":"2024-04-23T19:03:44.113895+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:03:44.113895+0000","last_undegraded":"2024-04-23T19:03:44.113895+0000","last_fullsized":"2024-04-23T19:03:44.113895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:55:20.076349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389317+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:03:43.389317+0000","last_peered":"2024-04-23T19:03:43.389317+0000","last_clean":"2024-04-23T19:03:43.389317+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:03:43.389317+0000","last_undegraded":"2024-04-23T19:03:43.389317+0000","last_fullsized":"2024-04-23T19:03:43.389317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911323+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:43.911323+0000","last_peered":"2024-04-23T19:03:43.911323+0000","last_clean":"2024-04-23T19:03:43.911323+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:43.911323+0000","last_undegraded":"2024-04-23T19:03:43.911323+0000","last_fullsized":"2024-04-23T19:03:43.911323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":280,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113800+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:03:44.113800+0000","last_peered":"2024-04-23T19:03:44.113800+0000","last_clean":"2024-04-23T19:03:44.113800+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:03:44.113800+0000","last_undegraded":"2024-04-23T19:03:44.113800+0000","last_fullsized":"2024-04-23T19:03:44.113800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393082+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393082+0000","last_peered":"2024-04-23T19:03:43.393082+0000","last_clean":"2024-04-23T19:03:43.393082+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393082+0000","last_undegraded":"2024-04-23T19:03:43.393082+0000","last_fullsized":"2024-04-23T19:03:43.393082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709817+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709817+0000","last_peered":"2024-04-23T19:03:43.709817+0000","last_clean":"2024-04-23T19:03:43.709817+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709817+0000","last_undegraded":"2024-04-23T19:03:43.709817+0000","last_fullsized":"2024-04-23T19:03:43.709817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387614+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387614+0000","last_peered":"2024-04-23T19:03:43.387614+0000","last_clean":"2024-04-23T19:03:43.387614+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387614+0000","last_undegraded":"2024-04-23T19:03:43.387614+0000","last_fullsized":"2024-04-23T19:03:43.387614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113459+0000","last_change":"2024-04-23T19:03:32.295129+0000","last_active":"2024-04-23T19:03:44.113459+0000","last_peered":"2024-04-23T19:03:44.113459+0000","last_clean":"2024-04-23T19:03:44.113459+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:03:44.113459+0000","last_undegraded":"2024-04-23T19:03:44.113459+0000","last_fullsized":"2024-04-23T19:03:44.113459+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:35:11.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390260+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:43.390260+0000","last_peered":"2024-04-23T19:03:43.390260+0000","last_clean":"2024-04-23T19:03:43.390260+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:43.390260+0000","last_undegraded":"2024-04-23T19:03:43.390260+0000","last_fullsized":"2024-04-23T19:03:43.390260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114156+0000","last_change":"2024-04-23T19:03:32.293904+0000","last_active":"2024-04-23T19:03:44.114156+0000","last_peered":"2024-04-23T19:03:44.114156+0000","last_clean":"2024-04-23T19:03:44.114156+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:03:44.114156+0000","last_undegraded":"2024-04-23T19:03:44.114156+0000","last_fullsized":"2024-04-23T19:03:44.114156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:21.520365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113604+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:03:44.113604+0000","last_peered":"2024-04-23T19:03:44.113604+0000","last_clean":"2024-04-23T19:03:44.113604+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:03:44.113604+0000","last_undegraded":"2024-04-23T19:03:44.113604+0000","last_fullsized":"2024-04-23T19:03:44.113604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'34","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112855+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:03:44.112855+0000","last_peered":"2024-04-23T19:03:44.112855+0000","last_clean":"2024-04-23T19:03:44.112855+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:03:44.112855+0000","last_undegraded":"2024-04-23T19:03:44.112855+0000","last_fullsized":"2024-04-23T19:03:44.112855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908951+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.908951+0000","last_peered":"2024-04-23T19:03:43.908951+0000","last_clean":"2024-04-23T19:03:43.908951+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.908951+0000","last_undegraded":"2024-04-23T19:03:43.908951+0000","last_fullsized":"2024-04-23T19:03:43.908951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113600+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:03:44.113600+0000","last_peered":"2024-04-23T19:03:44.113600+0000","last_clean":"2024-04-23T19:03:44.113600+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:03:44.113600+0000","last_undegraded":"2024-04-23T19:03:44.113600+0000","last_fullsized":"2024-04-23T19:03:44.113600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113874+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:03:44.113874+0000","last_peered":"2024-04-23T19:03:44.113874+0000","last_clean":"2024-04-23T19:03:44.113874+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:03:44.113874+0000","last_undegraded":"2024-04-23T19:03:44.113874+0000","last_fullsized":"2024-04-23T19:03:44.113874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"97'22","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113983+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:44.113983+0000","last_peered":"2024-04-23T19:03:44.113983+0000","last_clean":"2024-04-23T19:03:44.113983+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:44.113983+0000","last_undegraded":"2024-04-23T19:03:44.113983+0000","last_fullsized":"2024-04-23T19:03:44.113983+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.348240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115650+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:03:44.115650+0000","last_peered":"2024-04-23T19:03:44.115650+0000","last_clean":"2024-04-23T19:03:44.115650+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:03:44.115650+0000","last_undegraded":"2024-04-23T19:03:44.115650+0000","last_fullsized":"2024-04-23T19:03:44.115650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708440+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:03:43.708440+0000","last_peered":"2024-04-23T19:03:43.708440+0000","last_clean":"2024-04-23T19:03:43.708440+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:03:43.708440+0000","last_undegraded":"2024-04-23T19:03:43.708440+0000","last_fullsized":"2024-04-23T19:03:43.708440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112369+0000","last_change":"2024-04-23T19:03:32.300841+0000","last_active":"2024-04-23T19:03:44.112369+0000","last_peered":"2024-04-23T19:03:44.112369+0000","last_clean":"2024-04-23T19:03:44.112369+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:03:44.112369+0000","last_undegraded":"2024-04-23T19:03:44.112369+0000","last_fullsized":"2024-04-23T19:03:44.112369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:36.411296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393276+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393276+0000","last_peered":"2024-04-23T19:03:43.393276+0000","last_clean":"2024-04-23T19:03:43.393276+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393276+0000","last_undegraded":"2024-04-23T19:03:43.393276+0000","last_fullsized":"2024-04-23T19:03:43.393276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391087+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:03:43.391087+0000","last_peered":"2024-04-23T19:03:43.391087+0000","last_clean":"2024-04-23T19:03:43.391087+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:03:43.391087+0000","last_undegraded":"2024-04-23T19:03:43.391087+0000","last_fullsized":"2024-04-23T19:03:43.391087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"97'20","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392954+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:43.392954+0000","last_peered":"2024-04-23T19:03:43.392954+0000","last_clean":"2024-04-23T19:03:43.392954+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:43.392954+0000","last_undegraded":"2024-04-23T19:03:43.392954+0000","last_fullsized":"2024-04-23T19:03:43.392954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115534+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115534+0000","last_peered":"2024-04-23T19:03:44.115534+0000","last_clean":"2024-04-23T19:03:44.115534+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115534+0000","last_undegraded":"2024-04-23T19:03:44.115534+0000","last_fullsized":"2024-04-23T19:03:44.115534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:41.115956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909201+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:03:43.909201+0000","last_peered":"2024-04-23T19:03:43.909201+0000","last_clean":"2024-04-23T19:03:43.909201+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:03:43.909201+0000","last_undegraded":"2024-04-23T19:03:43.909201+0000","last_fullsized":"2024-04-23T19:03:43.909201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910617+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:03:43.910617+0000","last_peered":"2024-04-23T19:03:43.910617+0000","last_clean":"2024-04-23T19:03:43.910617+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:03:43.910617+0000","last_undegraded":"2024-04-23T19:03:43.910617+0000","last_fullsized":"2024-04-23T19:03:43.910617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'135","reported_seq":439,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557152+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:03:44.557152+0000","last_peered":"2024-04-23T19:03:44.557152+0000","last_clean":"2024-04-23T19:03:44.557152+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:03:44.557152+0000","last_undegraded":"2024-04-23T19:03:44.557152+0000","last_fullsized":"2024-04-23T19:03:44.557152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113500+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:44.113500+0000","last_peered":"2024-04-23T19:03:44.113500+0000","last_clean":"2024-04-23T19:03:44.113500+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:44.113500+0000","last_undegraded":"2024-04-23T19:03:44.113500+0000","last_fullsized":"2024-04-23T19:03:44.113500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909395+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909395+0000","last_peered":"2024-04-23T19:03:43.909395+0000","last_clean":"2024-04-23T19:03:43.909395+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909395+0000","last_undegraded":"2024-04-23T19:03:43.909395+0000","last_fullsized":"2024-04-23T19:03:43.909395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"97'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114287+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:44.114287+0000","last_peered":"2024-04-23T19:03:44.114287+0000","last_clean":"2024-04-23T19:03:44.114287+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:44.114287+0000","last_undegraded":"2024-04-23T19:03:44.114287+0000","last_fullsized":"2024-04-23T19:03:44.114287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710129+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:03:43.710129+0000","last_peered":"2024-04-23T19:03:43.710129+0000","last_clean":"2024-04-23T19:03:43.710129+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:03:43.710129+0000","last_undegraded":"2024-04-23T19:03:43.710129+0000","last_fullsized":"2024-04-23T19:03:43.710129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390843+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:03:43.390843+0000","last_peered":"2024-04-23T19:03:43.390843+0000","last_clean":"2024-04-23T19:03:43.390843+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:03:43.390843+0000","last_undegraded":"2024-04-23T19:03:43.390843+0000","last_fullsized":"2024-04-23T19:03:43.390843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390945+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:03:43.390945+0000","last_peered":"2024-04-23T19:03:43.390945+0000","last_clean":"2024-04-23T19:03:43.390945+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:03:43.390945+0000","last_undegraded":"2024-04-23T19:03:43.390945+0000","last_fullsized":"2024-04-23T19:03:43.390945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388873+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.388873+0000","last_peered":"2024-04-23T19:03:43.388873+0000","last_clean":"2024-04-23T19:03:43.388873+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.388873+0000","last_undegraded":"2024-04-23T19:03:43.388873+0000","last_fullsized":"2024-04-23T19:03:43.388873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114432+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:03:44.114432+0000","last_peered":"2024-04-23T19:03:44.114432+0000","last_clean":"2024-04-23T19:03:44.114432+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:03:44.114432+0000","last_undegraded":"2024-04-23T19:03:44.114432+0000","last_fullsized":"2024-04-23T19:03:44.114432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909827+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:03:43.909827+0000","last_peered":"2024-04-23T19:03:43.909827+0000","last_clean":"2024-04-23T19:03:43.909827+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:03:43.909827+0000","last_undegraded":"2024-04-23T19:03:43.909827+0000","last_fullsized":"2024-04-23T19:03:43.909827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910450+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:43.910450+0000","last_peered":"2024-04-23T19:03:43.910450+0000","last_clean":"2024-04-23T19:03:43.910450+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:43.910450+0000","last_undegraded":"2024-04-23T19:03:43.910450+0000","last_fullsized":"2024-04-23T19:03:43.910450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113537+0000","last_change":"2024-04-23T19:03:32.294993+0000","last_active":"2024-04-23T19:03:44.113537+0000","last_peered":"2024-04-23T19:03:44.113537+0000","last_clean":"2024-04-23T19:03:44.113537+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:03:44.113537+0000","last_undegraded":"2024-04-23T19:03:44.113537+0000","last_fullsized":"2024-04-23T19:03:44.113537+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:50.832778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'19","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388829+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:03:43.388829+0000","last_peered":"2024-04-23T19:03:43.388829+0000","last_clean":"2024-04-23T19:03:43.388829+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:03:43.388829+0000","last_undegraded":"2024-04-23T19:03:43.388829+0000","last_fullsized":"2024-04-23T19:03:43.388829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388406+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:03:43.388406+0000","last_peered":"2024-04-23T19:03:43.388406+0000","last_clean":"2024-04-23T19:03:43.388406+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:03:43.388406+0000","last_undegraded":"2024-04-23T19:03:43.388406+0000","last_fullsized":"2024-04-23T19:03:43.388406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392779+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:03:43.392779+0000","last_peered":"2024-04-23T19:03:43.392779+0000","last_clean":"2024-04-23T19:03:43.392779+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:03:43.392779+0000","last_undegraded":"2024-04-23T19:03:43.392779+0000","last_fullsized":"2024-04-23T19:03:43.392779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113434+0000","last_change":"2024-04-23T19:03:32.300516+0000","last_active":"2024-04-23T19:03:44.113434+0000","last_peered":"2024-04-23T19:03:44.113434+0000","last_clean":"2024-04-23T19:03:44.113434+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:03:44.113434+0000","last_undegraded":"2024-04-23T19:03:44.113434+0000","last_fullsized":"2024-04-23T19:03:44.113434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:02.485036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"97'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115124+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:44.115124+0000","last_peered":"2024-04-23T19:03:44.115124+0000","last_clean":"2024-04-23T19:03:44.115124+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:44.115124+0000","last_undegraded":"2024-04-23T19:03:44.115124+0000","last_fullsized":"2024-04-23T19:03:44.115124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392243+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:03:43.392243+0000","last_peered":"2024-04-23T19:03:43.392243+0000","last_clean":"2024-04-23T19:03:43.392243+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:03:43.392243+0000","last_undegraded":"2024-04-23T19:03:43.392243+0000","last_fullsized":"2024-04-23T19:03:43.392243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"100'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112763+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:03:44.112763+0000","last_peered":"2024-04-23T19:03:44.112763+0000","last_clean":"2024-04-23T19:03:44.112763+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:03:44.112763+0000","last_undegraded":"2024-04-23T19:03:44.112763+0000","last_fullsized":"2024-04-23T19:03:44.112763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113317+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:03:44.113317+0000","last_peered":"2024-04-23T19:03:44.113317+0000","last_clean":"2024-04-23T19:03:44.113317+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:03:44.113317+0000","last_undegraded":"2024-04-23T19:03:44.113317+0000","last_fullsized":"2024-04-23T19:03:44.113317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113692+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:44.113692+0000","last_peered":"2024-04-23T19:03:44.113692+0000","last_clean":"2024-04-23T19:03:44.113692+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:44.113692+0000","last_undegraded":"2024-04-23T19:03:44.113692+0000","last_fullsized":"2024-04-23T19:03:44.113692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389971+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:03:43.389971+0000","last_peered":"2024-04-23T19:03:43.389971+0000","last_clean":"2024-04-23T19:03:43.389971+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:03:43.389971+0000","last_undegraded":"2024-04-23T19:03:43.389971+0000","last_fullsized":"2024-04-23T19:03:43.389971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390374+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:03:43.390374+0000","last_peered":"2024-04-23T19:03:43.390374+0000","last_clean":"2024-04-23T19:03:43.390374+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:03:43.390374+0000","last_undegraded":"2024-04-23T19:03:43.390374+0000","last_fullsized":"2024-04-23T19:03:43.390374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112637+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:03:44.112637+0000","last_peered":"2024-04-23T19:03:44.112637+0000","last_clean":"2024-04-23T19:03:44.112637+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:03:44.112637+0000","last_undegraded":"2024-04-23T19:03:44.112637+0000","last_fullsized":"2024-04-23T19:03:44.112637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391944+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:03:43.391944+0000","last_peered":"2024-04-23T19:03:43.391944+0000","last_clean":"2024-04-23T19:03:43.391944+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:03:43.391944+0000","last_undegraded":"2024-04-23T19:03:43.391944+0000","last_fullsized":"2024-04-23T19:03:43.391944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708373+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:03:43.708373+0000","last_peered":"2024-04-23T19:03:43.708373+0000","last_clean":"2024-04-23T19:03:43.708373+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:03:43.708373+0000","last_undegraded":"2024-04-23T19:03:43.708373+0000","last_fullsized":"2024-04-23T19:03:43.708373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388390+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388390+0000","last_peered":"2024-04-23T19:03:43.388390+0000","last_clean":"2024-04-23T19:03:43.388390+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388390+0000","last_undegraded":"2024-04-23T19:03:43.388390+0000","last_fullsized":"2024-04-23T19:03:43.388390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391315+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391315+0000","last_peered":"2024-04-23T19:03:43.391315+0000","last_clean":"2024-04-23T19:03:43.391315+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391315+0000","last_undegraded":"2024-04-23T19:03:43.391315+0000","last_fullsized":"2024-04-23T19:03:43.391315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"97'28","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114624+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:44.114624+0000","last_peered":"2024-04-23T19:03:44.114624+0000","last_clean":"2024-04-23T19:03:44.114624+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:44.114624+0000","last_undegraded":"2024-04-23T19:03:44.114624+0000","last_fullsized":"2024-04-23T19:03:44.114624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708231+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:03:43.708231+0000","last_peered":"2024-04-23T19:03:43.708231+0000","last_clean":"2024-04-23T19:03:43.708231+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:03:43.708231+0000","last_undegraded":"2024-04-23T19:03:43.708231+0000","last_fullsized":"2024-04-23T19:03:43.708231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113187+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:03:44.113187+0000","last_peered":"2024-04-23T19:03:44.113187+0000","last_clean":"2024-04-23T19:03:44.113187+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:03:44.113187+0000","last_undegraded":"2024-04-23T19:03:44.113187+0000","last_fullsized":"2024-04-23T19:03:44.113187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113407+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:03:44.113407+0000","last_peered":"2024-04-23T19:03:44.113407+0000","last_clean":"2024-04-23T19:03:44.113407+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:03:44.113407+0000","last_undegraded":"2024-04-23T19:03:44.113407+0000","last_fullsized":"2024-04-23T19:03:44.113407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710040+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:03:43.710040+0000","last_peered":"2024-04-23T19:03:43.710040+0000","last_clean":"2024-04-23T19:03:43.710040+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:03:43.710040+0000","last_undegraded":"2024-04-23T19:03:43.710040+0000","last_fullsized":"2024-04-23T19:03:43.710040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"96'20","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391502+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:43.391502+0000","last_peered":"2024-04-23T19:03:43.391502+0000","last_clean":"2024-04-23T19:03:43.391502+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:43.391502+0000","last_undegraded":"2024-04-23T19:03:43.391502+0000","last_fullsized":"2024-04-23T19:03:43.391502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113935+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:03:44.113935+0000","last_peered":"2024-04-23T19:03:44.113935+0000","last_clean":"2024-04-23T19:03:44.113935+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:03:44.113935+0000","last_undegraded":"2024-04-23T19:03:44.113935+0000","last_fullsized":"2024-04-23T19:03:44.113935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'29","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114486+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:44.114486+0000","last_peered":"2024-04-23T19:03:44.114486+0000","last_clean":"2024-04-23T19:03:44.114486+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:44.114486+0000","last_undegraded":"2024-04-23T19:03:44.114486+0000","last_fullsized":"2024-04-23T19:03:44.114486+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:28.797026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388731+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:03:43.388731+0000","last_peered":"2024-04-23T19:03:43.388731+0000","last_clean":"2024-04-23T19:03:43.388731+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:03:43.388731+0000","last_undegraded":"2024-04-23T19:03:43.388731+0000","last_fullsized":"2024-04-23T19:03:43.388731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391467+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391467+0000","last_peered":"2024-04-23T19:03:43.391467+0000","last_clean":"2024-04-23T19:03:43.391467+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391467+0000","last_undegraded":"2024-04-23T19:03:43.391467+0000","last_fullsized":"2024-04-23T19:03:43.391467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114062+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:03:44.114062+0000","last_peered":"2024-04-23T19:03:44.114062+0000","last_clean":"2024-04-23T19:03:44.114062+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:03:44.114062+0000","last_undegraded":"2024-04-23T19:03:44.114062+0000","last_fullsized":"2024-04-23T19:03:44.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"97'30","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113127+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:03:44.113127+0000","last_peered":"2024-04-23T19:03:44.113127+0000","last_clean":"2024-04-23T19:03:44.113127+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:03:44.113127+0000","last_undegraded":"2024-04-23T19:03:44.113127+0000","last_fullsized":"2024-04-23T19:03:44.113127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709898+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:03:43.709898+0000","last_peered":"2024-04-23T19:03:43.709898+0000","last_clean":"2024-04-23T19:03:43.709898+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:03:43.709898+0000","last_undegraded":"2024-04-23T19:03:43.709898+0000","last_fullsized":"2024-04-23T19:03:43.709898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114003+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:03:44.114003+0000","last_peered":"2024-04-23T19:03:44.114003+0000","last_clean":"2024-04-23T19:03:44.114003+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:03:44.114003+0000","last_undegraded":"2024-04-23T19:03:44.114003+0000","last_fullsized":"2024-04-23T19:03:44.114003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114574+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:03:44.114574+0000","last_peered":"2024-04-23T19:03:44.114574+0000","last_clean":"2024-04-23T19:03:44.114574+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:03:44.114574+0000","last_undegraded":"2024-04-23T19:03:44.114574+0000","last_fullsized":"2024-04-23T19:03:44.114574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707993+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.707993+0000","last_peered":"2024-04-23T19:03:43.707993+0000","last_clean":"2024-04-23T19:03:43.707993+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.707993+0000","last_undegraded":"2024-04-23T19:03:43.707993+0000","last_fullsized":"2024-04-23T19:03:43.707993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392596+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:03:43.392596+0000","last_peered":"2024-04-23T19:03:43.392596+0000","last_clean":"2024-04-23T19:03:43.392596+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:03:43.392596+0000","last_undegraded":"2024-04-23T19:03:43.392596+0000","last_fullsized":"2024-04-23T19:03:43.392596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911521+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:43.911521+0000","last_peered":"2024-04-23T19:03:43.911521+0000","last_clean":"2024-04-23T19:03:43.911521+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:43.911521+0000","last_undegraded":"2024-04-23T19:03:43.911521+0000","last_fullsized":"2024-04-23T19:03:43.911521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.912128+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:03:43.912128+0000","last_peered":"2024-04-23T19:03:43.912128+0000","last_clean":"2024-04-23T19:03:43.912128+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:03:43.912128+0000","last_undegraded":"2024-04-23T19:03:43.912128+0000","last_fullsized":"2024-04-23T19:03:43.912128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393457+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:03:43.393457+0000","last_peered":"2024-04-23T19:03:43.393457+0000","last_clean":"2024-04-23T19:03:43.393457+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:03:43.393457+0000","last_undegraded":"2024-04-23T19:03:43.393457+0000","last_fullsized":"2024-04-23T19:03:43.393457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114358+0000","last_change":"2024-04-23T19:03:32.295881+0000","last_active":"2024-04-23T19:03:44.114358+0000","last_peered":"2024-04-23T19:03:44.114358+0000","last_clean":"2024-04-23T19:03:44.114358+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:03:44.114358+0000","last_undegraded":"2024-04-23T19:03:44.114358+0000","last_fullsized":"2024-04-23T19:03:44.114358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:09.028190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388000+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388000+0000","last_peered":"2024-04-23T19:03:43.388000+0000","last_clean":"2024-04-23T19:03:43.388000+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388000+0000","last_undegraded":"2024-04-23T19:03:43.388000+0000","last_fullsized":"2024-04-23T19:03:43.388000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394414+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:03:43.394414+0000","last_peered":"2024-04-23T19:03:43.394414+0000","last_clean":"2024-04-23T19:03:43.394414+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:03:43.394414+0000","last_undegraded":"2024-04-23T19:03:43.394414+0000","last_fullsized":"2024-04-23T19:03:43.394414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"97'20","reported_seq":147,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112321+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:44.112321+0000","last_peered":"2024-04-23T19:03:44.112321+0000","last_clean":"2024-04-23T19:03:44.112321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:44.112321+0000","last_undegraded":"2024-04-23T19:03:44.112321+0000","last_fullsized":"2024-04-23T19:03:44.112321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114840+0000","last_change":"2024-04-23T19:03:32.293970+0000","last_active":"2024-04-23T19:03:44.114840+0000","last_peered":"2024-04-23T19:03:44.114840+0000","last_clean":"2024-04-23T19:03:44.114840+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:03:44.114840+0000","last_undegraded":"2024-04-23T19:03:44.114840+0000","last_fullsized":"2024-04-23T19:03:44.114840+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:29.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910798+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:03:43.910798+0000","last_peered":"2024-04-23T19:03:43.910798+0000","last_clean":"2024-04-23T19:03:43.910798+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:03:43.910798+0000","last_undegraded":"2024-04-23T19:03:43.910798+0000","last_fullsized":"2024-04-23T19:03:43.910798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'135","reported_seq":389,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557527+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:03:44.557527+0000","last_peered":"2024-04-23T19:03:44.557527+0000","last_clean":"2024-04-23T19:03:44.557527+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:03:44.557527+0000","last_undegraded":"2024-04-23T19:03:44.557527+0000","last_fullsized":"2024-04-23T19:03:44.557527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112611+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112611+0000","last_peered":"2024-04-23T19:03:44.112611+0000","last_clean":"2024-04-23T19:03:44.112611+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112611+0000","last_undegraded":"2024-04-23T19:03:44.112611+0000","last_fullsized":"2024-04-23T19:03:44.112611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909534+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:03:43.909534+0000","last_peered":"2024-04-23T19:03:43.909534+0000","last_clean":"2024-04-23T19:03:43.909534+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:03:43.909534+0000","last_undegraded":"2024-04-23T19:03:43.909534+0000","last_fullsized":"2024-04-23T19:03:43.909534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389562+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:03:43.389562+0000","last_peered":"2024-04-23T19:03:43.389562+0000","last_clean":"2024-04-23T19:03:43.389562+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:03:43.389562+0000","last_undegraded":"2024-04-23T19:03:43.389562+0000","last_fullsized":"2024-04-23T19:03:43.389562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113265+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:03:44.113265+0000","last_peered":"2024-04-23T19:03:44.113265+0000","last_clean":"2024-04-23T19:03:44.113265+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:03:44.113265+0000","last_undegraded":"2024-04-23T19:03:44.113265+0000","last_fullsized":"2024-04-23T19:03:44.113265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'23","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388295+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:03:43.388295+0000","last_peered":"2024-04-23T19:03:43.388295+0000","last_clean":"2024-04-23T19:03:43.388295+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:03:43.388295+0000","last_undegraded":"2024-04-23T19:03:43.388295+0000","last_fullsized":"2024-04-23T19:03:43.388295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111946+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:03:44.111946+0000","last_peered":"2024-04-23T19:03:44.111946+0000","last_clean":"2024-04-23T19:03:44.111946+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:03:44.111946+0000","last_undegraded":"2024-04-23T19:03:44.111946+0000","last_fullsized":"2024-04-23T19:03:44.111946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115183+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115183+0000","last_peered":"2024-04-23T19:03:44.115183+0000","last_clean":"2024-04-23T19:03:44.115183+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115183+0000","last_undegraded":"2024-04-23T19:03:44.115183+0000","last_fullsized":"2024-04-23T19:03:44.115183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910717+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:03:43.910717+0000","last_peered":"2024-04-23T19:03:43.910717+0000","last_clean":"2024-04-23T19:03:43.910717+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:03:43.910717+0000","last_undegraded":"2024-04-23T19:03:43.910717+0000","last_fullsized":"2024-04-23T19:03:43.910717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"97'26","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393664+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:03:43.393664+0000","last_peered":"2024-04-23T19:03:43.393664+0000","last_clean":"2024-04-23T19:03:43.393664+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:03:43.393664+0000","last_undegraded":"2024-04-23T19:03:43.393664+0000","last_fullsized":"2024-04-23T19:03:43.393664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388902+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:03:43.388902+0000","last_peered":"2024-04-23T19:03:43.388902+0000","last_clean":"2024-04-23T19:03:43.388902+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:03:43.388902+0000","last_undegraded":"2024-04-23T19:03:43.388902+0000","last_fullsized":"2024-04-23T19:03:43.388902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111823+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:44.111823+0000","last_peered":"2024-04-23T19:03:44.111823+0000","last_clean":"2024-04-23T19:03:44.111823+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:44.111823+0000","last_undegraded":"2024-04-23T19:03:44.111823+0000","last_fullsized":"2024-04-23T19:03:44.111823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707890+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:03:43.707890+0000","last_peered":"2024-04-23T19:03:43.707890+0000","last_clean":"2024-04-23T19:03:43.707890+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:03:43.707890+0000","last_undegraded":"2024-04-23T19:03:43.707890+0000","last_fullsized":"2024-04-23T19:03:43.707890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392918+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392918+0000","last_peered":"2024-04-23T19:03:43.392918+0000","last_clean":"2024-04-23T19:03:43.392918+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392918+0000","last_undegraded":"2024-04-23T19:03:43.392918+0000","last_fullsized":"2024-04-23T19:03:43.392918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390352+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:03:43.390352+0000","last_peered":"2024-04-23T19:03:43.390352+0000","last_clean":"2024-04-23T19:03:43.390352+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:03:43.390352+0000","last_undegraded":"2024-04-23T19:03:43.390352+0000","last_fullsized":"2024-04-23T19:03:43.390352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393209+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:03:43.393209+0000","last_peered":"2024-04-23T19:03:43.393209+0000","last_clean":"2024-04-23T19:03:43.393209+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:03:43.393209+0000","last_undegraded":"2024-04-23T19:03:43.393209+0000","last_fullsized":"2024-04-23T19:03:43.393209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908804+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908804+0000","last_peered":"2024-04-23T19:03:43.908804+0000","last_clean":"2024-04-23T19:03:43.908804+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908804+0000","last_undegraded":"2024-04-23T19:03:43.908804+0000","last_fullsized":"2024-04-23T19:03:43.908804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392822+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:43.392822+0000","last_peered":"2024-04-23T19:03:43.392822+0000","last_clean":"2024-04-23T19:03:43.392822+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:43.392822+0000","last_undegraded":"2024-04-23T19:03:43.392822+0000","last_fullsized":"2024-04-23T19:03:43.392822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909207+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909207+0000","last_peered":"2024-04-23T19:03:43.909207+0000","last_clean":"2024-04-23T19:03:43.909207+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909207+0000","last_undegraded":"2024-04-23T19:03:43.909207+0000","last_fullsized":"2024-04-23T19:03:43.909207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114601+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114601+0000","last_peered":"2024-04-23T19:03:44.114601+0000","last_clean":"2024-04-23T19:03:44.114601+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114601+0000","last_undegraded":"2024-04-23T19:03:44.114601+0000","last_fullsized":"2024-04-23T19:03:44.114601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909065+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:03:43.909065+0000","last_peered":"2024-04-23T19:03:43.909065+0000","last_clean":"2024-04-23T19:03:43.909065+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:03:43.909065+0000","last_undegraded":"2024-04-23T19:03:43.909065+0000","last_fullsized":"2024-04-23T19:03:43.909065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"97'25","reported_seq":151,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114439+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:44.114439+0000","last_peered":"2024-04-23T19:03:44.114439+0000","last_clean":"2024-04-23T19:03:44.114439+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:44.114439+0000","last_undegraded":"2024-04-23T19:03:44.114439+0000","last_fullsized":"2024-04-23T19:03:44.114439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113085+0000","last_change":"2024-04-23T19:03:32.303428+0000","last_active":"2024-04-23T19:03:44.113085+0000","last_peered":"2024-04-23T19:03:44.113085+0000","last_clean":"2024-04-23T19:03:44.113085+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:03:44.113085+0000","last_undegraded":"2024-04-23T19:03:44.113085+0000","last_fullsized":"2024-04-23T19:03:44.113085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:39.837391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909644+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:03:43.909644+0000","last_peered":"2024-04-23T19:03:43.909644+0000","last_clean":"2024-04-23T19:03:43.909644+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:03:43.909644+0000","last_undegraded":"2024-04-23T19:03:43.909644+0000","last_fullsized":"2024-04-23T19:03:43.909644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113318+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:03:44.113318+0000","last_peered":"2024-04-23T19:03:44.113318+0000","last_clean":"2024-04-23T19:03:44.113318+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:03:44.113318+0000","last_undegraded":"2024-04-23T19:03:44.113318+0000","last_fullsized":"2024-04-23T19:03:44.113318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909653+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.909653+0000","last_peered":"2024-04-23T19:03:43.909653+0000","last_clean":"2024-04-23T19:03:43.909653+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.909653+0000","last_undegraded":"2024-04-23T19:03:43.909653+0000","last_fullsized":"2024-04-23T19:03:43.909653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115632+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115632+0000","last_peered":"2024-04-23T19:03:44.115632+0000","last_clean":"2024-04-23T19:03:44.115632+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115632+0000","last_undegraded":"2024-04-23T19:03:44.115632+0000","last_fullsized":"2024-04-23T19:03:44.115632+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:01.164433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"97'29","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707924+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:43.707924+0000","last_peered":"2024-04-23T19:03:43.707924+0000","last_clean":"2024-04-23T19:03:43.707924+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:43.707924+0000","last_undegraded":"2024-04-23T19:03:43.707924+0000","last_fullsized":"2024-04-23T19:03:43.707924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115428+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115428+0000","last_peered":"2024-04-23T19:03:44.115428+0000","last_clean":"2024-04-23T19:03:44.115428+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115428+0000","last_undegraded":"2024-04-23T19:03:44.115428+0000","last_fullsized":"2024-04-23T19:03:44.115428+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:38.798295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388809+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:03:43.388809+0000","last_peered":"2024-04-23T19:03:43.388809+0000","last_clean":"2024-04-23T19:03:43.388809+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:03:43.388809+0000","last_undegraded":"2024-04-23T19:03:43.388809+0000","last_fullsized":"2024-04-23T19:03:43.388809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389504+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:03:43.389504+0000","last_peered":"2024-04-23T19:03:43.389504+0000","last_clean":"2024-04-23T19:03:43.389504+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:03:43.389504+0000","last_undegraded":"2024-04-23T19:03:43.389504+0000","last_fullsized":"2024-04-23T19:03:43.389504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"97'17","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389148+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:43.389148+0000","last_peered":"2024-04-23T19:03:43.389148+0000","last_clean":"2024-04-23T19:03:43.389148+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:43.389148+0000","last_undegraded":"2024-04-23T19:03:43.389148+0000","last_fullsized":"2024-04-23T19:03:43.389148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114071+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:03:44.114071+0000","last_peered":"2024-04-23T19:03:44.114071+0000","last_clean":"2024-04-23T19:03:44.114071+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:03:44.114071+0000","last_undegraded":"2024-04-23T19:03:44.114071+0000","last_fullsized":"2024-04-23T19:03:44.114071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"97'21","reported_seq":150,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113268+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:44.113268+0000","last_peered":"2024-04-23T19:03:44.113268+0000","last_clean":"2024-04-23T19:03:44.113268+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:44.113268+0000","last_undegraded":"2024-04-23T19:03:44.113268+0000","last_fullsized":"2024-04-23T19:03:44.113268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392559+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392559+0000","last_peered":"2024-04-23T19:03:43.392559+0000","last_clean":"2024-04-23T19:03:43.392559+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392559+0000","last_undegraded":"2024-04-23T19:03:43.392559+0000","last_fullsized":"2024-04-23T19:03:43.392559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391726+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:43.391726+0000","last_peered":"2024-04-23T19:03:43.391726+0000","last_clean":"2024-04-23T19:03:43.391726+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:43.391726+0000","last_undegraded":"2024-04-23T19:03:43.391726+0000","last_fullsized":"2024-04-23T19:03:43.391726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911075+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:03:43.911075+0000","last_peered":"2024-04-23T19:03:43.911075+0000","last_clean":"2024-04-23T19:03:43.911075+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:03:43.911075+0000","last_undegraded":"2024-04-23T19:03:43.911075+0000","last_fullsized":"2024-04-23T19:03:43.911075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"97'34","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115162+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:44.115162+0000","last_peered":"2024-04-23T19:03:44.115162+0000","last_clean":"2024-04-23T19:03:44.115162+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:44.115162+0000","last_undegraded":"2024-04-23T19:03:44.115162+0000","last_fullsized":"2024-04-23T19:03:44.115162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:41.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389646+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:03:43.389646+0000","last_peered":"2024-04-23T19:03:43.389646+0000","last_clean":"2024-04-23T19:03:43.389646+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:03:43.389646+0000","last_undegraded":"2024-04-23T19:03:43.389646+0000","last_fullsized":"2024-04-23T19:03:43.389646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"97'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709559+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:03:43.709559+0000","last_peered":"2024-04-23T19:03:43.709559+0000","last_clean":"2024-04-23T19:03:43.709559+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:03:43.709559+0000","last_undegraded":"2024-04-23T19:03:43.709559+0000","last_fullsized":"2024-04-23T19:03:43.709559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707915+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:03:43.707915+0000","last_peered":"2024-04-23T19:03:43.707915+0000","last_clean":"2024-04-23T19:03:43.707915+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:03:43.707915+0000","last_undegraded":"2024-04-23T19:03:43.707915+0000","last_fullsized":"2024-04-23T19:03:43.707915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"96'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393204+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:43.393204+0000","last_peered":"2024-04-23T19:03:43.393204+0000","last_clean":"2024-04-23T19:03:43.393204+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:43.393204+0000","last_undegraded":"2024-04-23T19:03:43.393204+0000","last_fullsized":"2024-04-23T19:03:43.393204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114590+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:03:44.114590+0000","last_peered":"2024-04-23T19:03:44.114590+0000","last_clean":"2024-04-23T19:03:44.114590+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:03:44.114590+0000","last_undegraded":"2024-04-23T19:03:44.114590+0000","last_fullsized":"2024-04-23T19:03:44.114590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"97'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389442+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:43.389442+0000","last_peered":"2024-04-23T19:03:43.389442+0000","last_clean":"2024-04-23T19:03:43.389442+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:43.389442+0000","last_undegraded":"2024-04-23T19:03:43.389442+0000","last_fullsized":"2024-04-23T19:03:43.389442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":72,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911047+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911047+0000","last_peered":"2024-04-23T19:03:43.911047+0000","last_clean":"2024-04-23T19:03:43.911047+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911047+0000","last_undegraded":"2024-04-23T19:03:43.911047+0000","last_fullsized":"2024-04-23T19:03:43.911047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"97'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390537+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:43.390537+0000","last_peered":"2024-04-23T19:03:43.390537+0000","last_clean":"2024-04-23T19:03:43.390537+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:43.390537+0000","last_undegraded":"2024-04-23T19:03:43.390537+0000","last_fullsized":"2024-04-23T19:03:43.390537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394043+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:03:43.394043+0000","last_peered":"2024-04-23T19:03:43.394043+0000","last_clean":"2024-04-23T19:03:43.394043+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:03:43.394043+0000","last_undegraded":"2024-04-23T19:03:43.394043+0000","last_fullsized":"2024-04-23T19:03:43.394043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"97'31","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388801+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:03:43.388801+0000","last_peered":"2024-04-23T19:03:43.388801+0000","last_clean":"2024-04-23T19:03:43.388801+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:03:43.388801+0000","last_undegraded":"2024-04-23T19:03:43.388801+0000","last_fullsized":"2024-04-23T19:03:43.388801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911790+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:03:43.911790+0000","last_peered":"2024-04-23T19:03:43.911790+0000","last_clean":"2024-04-23T19:03:43.911790+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:03:43.911790+0000","last_undegraded":"2024-04-23T19:03:43.911790+0000","last_fullsized":"2024-04-23T19:03:43.911790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"97'21","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113663+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:44.113663+0000","last_peered":"2024-04-23T19:03:44.113663+0000","last_clean":"2024-04-23T19:03:44.113663+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:44.113663+0000","last_undegraded":"2024-04-23T19:03:44.113663+0000","last_fullsized":"2024-04-23T19:03:44.113663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113841+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113841+0000","last_peered":"2024-04-23T19:03:44.113841+0000","last_clean":"2024-04-23T19:03:44.113841+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113841+0000","last_undegraded":"2024-04-23T19:03:44.113841+0000","last_fullsized":"2024-04-23T19:03:44.113841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708932+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:03:43.708932+0000","last_peered":"2024-04-23T19:03:43.708932+0000","last_clean":"2024-04-23T19:03:43.708932+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:03:43.708932+0000","last_undegraded":"2024-04-23T19:03:43.708932+0000","last_fullsized":"2024-04-23T19:03:43.708932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112309+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:03:44.112309+0000","last_peered":"2024-04-23T19:03:44.112309+0000","last_clean":"2024-04-23T19:03:44.112309+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:03:44.112309+0000","last_undegraded":"2024-04-23T19:03:44.112309+0000","last_fullsized":"2024-04-23T19:03:44.112309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115562+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:03:44.115562+0000","last_peered":"2024-04-23T19:03:44.115562+0000","last_clean":"2024-04-23T19:03:44.115562+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:03:44.115562+0000","last_undegraded":"2024-04-23T19:03:44.115562+0000","last_fullsized":"2024-04-23T19:03:44.115562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389396+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:03:43.389396+0000","last_peered":"2024-04-23T19:03:43.389396+0000","last_clean":"2024-04-23T19:03:43.389396+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:03:43.389396+0000","last_undegraded":"2024-04-23T19:03:43.389396+0000","last_fullsized":"2024-04-23T19:03:43.389396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"97'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394522+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:03:43.394522+0000","last_peered":"2024-04-23T19:03:43.394522+0000","last_clean":"2024-04-23T19:03:43.394522+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:03:43.394522+0000","last_undegraded":"2024-04-23T19:03:43.394522+0000","last_fullsized":"2024-04-23T19:03:43.394522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113173+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:03:44.113173+0000","last_peered":"2024-04-23T19:03:44.113173+0000","last_clean":"2024-04-23T19:03:44.113173+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:03:44.113173+0000","last_undegraded":"2024-04-23T19:03:44.113173+0000","last_fullsized":"2024-04-23T19:03:44.113173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"97'28","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393916+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:03:43.393916+0000","last_peered":"2024-04-23T19:03:43.393916+0000","last_clean":"2024-04-23T19:03:43.393916+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:03:43.393916+0000","last_undegraded":"2024-04-23T19:03:43.393916+0000","last_fullsized":"2024-04-23T19:03:43.393916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388784+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:43.388784+0000","last_peered":"2024-04-23T19:03:43.388784+0000","last_clean":"2024-04-23T19:03:43.388784+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:43.388784+0000","last_undegraded":"2024-04-23T19:03:43.388784+0000","last_fullsized":"2024-04-23T19:03:43.388784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114539+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:03:44.114539+0000","last_peered":"2024-04-23T19:03:44.114539+0000","last_clean":"2024-04-23T19:03:44.114539+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:03:44.114539+0000","last_undegraded":"2024-04-23T19:03:44.114539+0000","last_fullsized":"2024-04-23T19:03:44.114539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"97'28","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112893+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:44.112893+0000","last_peered":"2024-04-23T19:03:44.112893+0000","last_clean":"2024-04-23T19:03:44.112893+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:44.112893+0000","last_undegraded":"2024-04-23T19:03:44.112893+0000","last_fullsized":"2024-04-23T19:03:44.112893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:40.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390065+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:03:43.390065+0000","last_peered":"2024-04-23T19:03:43.390065+0000","last_clean":"2024-04-23T19:03:43.390065+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:03:43.390065+0000","last_undegraded":"2024-04-23T19:03:43.390065+0000","last_fullsized":"2024-04-23T19:03:43.390065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1080,"ondisk_log_size":1080,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386917,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":610,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1804696,"kb_used_data":1773520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92567144,"statfs":{"total":96636764160,"available":94788755456,"internally_reserved":0,"allocated":1816084480,"data_stored":1815444539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1197876,"kb_used_data":1166700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93173964,"statfs":{"total":96636764160,"available":95410139136,"internally_reserved":0,"allocated":1194700800,"data_stored":1194095951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693888,"kb_used_data":1658552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677952,"statfs":{"total":96636764160,"available":94902222848,"internally_reserved":0,"allocated":1698357248,"data_stored":1697703170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898284,"kb_used_data":1867096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473556,"statfs":{"total":96636764160,"available":94692921344,"internally_reserved":0,"allocated":1911906304,"data_stored":1911319884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1998844,"kb_used_data":1967668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92372996,"statfs":{"total":96636764160,"available":94589947904,"internally_reserved":0,"allocated":2014892032,"data_stored":2014257594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072988,"kb_used_data":1041812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93298852,"statfs":{"total":96636764160,"available":95538024448,"internally_reserved":0,"allocated":1066815488,"data_stored":1066225345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105972,"kb_used_data":1070636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93265868,"statfs":{"total":96636764160,"available":95504248832,"internally_reserved":0,"allocated":1096331264,"data_stored":1095704135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806796,"kb_used_data":1771448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92565044,"statfs":{"total":96636764160,"available":94786605056,"internally_reserved":0,"allocated":1813962752,"data_stored":1813346224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1811939328,"data_stored":1811939328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1094713344,"data_stored":1094713344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1065353216,"data_stored":1065353216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2013265920,"data_stored":2013265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1193279488,"data_stored":1193279488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814036480,"data_stored":1814036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":175817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":177182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":292907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:03:56.730 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:03:56.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-23T19:03:57.106 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:57.116 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:03:57.130 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-23T19:03:56.006641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823909,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3286,"num_read_kb":2969,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3900,"ondisk_log_size":3900,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12579344,"kb_used_data":12317432,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":742395376,"statfs":{"total":773094113280,"available":760212865024,"internally_reserved":0,"allocated":12613050368,"data_stored":12608096842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.041558"},"pg_stats":[{"pgid":"3.3f","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114847+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:03:44.114847+0000","last_peered":"2024-04-23T19:03:44.114847+0000","last_clean":"2024-04-23T19:03:44.114847+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:03:44.114847+0000","last_undegraded":"2024-04-23T19:03:44.114847+0000","last_fullsized":"2024-04-23T19:03:44.114847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387932+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:03:43.387932+0000","last_peered":"2024-04-23T19:03:43.387932+0000","last_clean":"2024-04-23T19:03:43.387932+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:03:43.387932+0000","last_undegraded":"2024-04-23T19:03:43.387932+0000","last_fullsized":"2024-04-23T19:03:43.387932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"97'24","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115512+0000","last_change":"2024-04-23T19:03:32.293577+0000","last_active":"2024-04-23T19:03:44.115512+0000","last_peered":"2024-04-23T19:03:44.115512+0000","last_clean":"2024-04-23T19:03:44.115512+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:03:44.115512+0000","last_undegraded":"2024-04-23T19:03:44.115512+0000","last_fullsized":"2024-04-23T19:03:44.115512+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:33.579201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113300+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:03:44.113300+0000","last_peered":"2024-04-23T19:03:44.113300+0000","last_clean":"2024-04-23T19:03:44.113300+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:03:44.113300+0000","last_undegraded":"2024-04-23T19:03:44.113300+0000","last_fullsized":"2024-04-23T19:03:44.113300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'29","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114019+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:44.114019+0000","last_peered":"2024-04-23T19:03:44.114019+0000","last_clean":"2024-04-23T19:03:44.114019+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:44.114019+0000","last_undegraded":"2024-04-23T19:03:44.114019+0000","last_fullsized":"2024-04-23T19:03:44.114019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910402+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:03:43.910402+0000","last_peered":"2024-04-23T19:03:43.910402+0000","last_clean":"2024-04-23T19:03:43.910402+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:03:43.910402+0000","last_undegraded":"2024-04-23T19:03:43.910402+0000","last_fullsized":"2024-04-23T19:03:43.910402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389189+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:03:43.389189+0000","last_peered":"2024-04-23T19:03:43.389189+0000","last_clean":"2024-04-23T19:03:43.389189+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:03:43.389189+0000","last_undegraded":"2024-04-23T19:03:43.389189+0000","last_fullsized":"2024-04-23T19:03:43.389189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113499+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113499+0000","last_peered":"2024-04-23T19:03:44.113499+0000","last_clean":"2024-04-23T19:03:44.113499+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113499+0000","last_undegraded":"2024-04-23T19:03:44.113499+0000","last_fullsized":"2024-04-23T19:03:44.113499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114187+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:44.114187+0000","last_peered":"2024-04-23T19:03:44.114187+0000","last_clean":"2024-04-23T19:03:44.114187+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:44.114187+0000","last_undegraded":"2024-04-23T19:03:44.114187+0000","last_fullsized":"2024-04-23T19:03:44.114187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708709+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:03:43.708709+0000","last_peered":"2024-04-23T19:03:43.708709+0000","last_clean":"2024-04-23T19:03:43.708709+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:03:43.708709+0000","last_undegraded":"2024-04-23T19:03:43.708709+0000","last_fullsized":"2024-04-23T19:03:43.708709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"97'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388451+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:03:43.388451+0000","last_peered":"2024-04-23T19:03:43.388451+0000","last_clean":"2024-04-23T19:03:43.388451+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:03:43.388451+0000","last_undegraded":"2024-04-23T19:03:43.388451+0000","last_fullsized":"2024-04-23T19:03:43.388451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910574+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:03:43.910574+0000","last_peered":"2024-04-23T19:03:43.910574+0000","last_clean":"2024-04-23T19:03:43.910574+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:03:43.910574+0000","last_undegraded":"2024-04-23T19:03:43.910574+0000","last_fullsized":"2024-04-23T19:03:43.910574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"97'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113605+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:44.113605+0000","last_peered":"2024-04-23T19:03:44.113605+0000","last_clean":"2024-04-23T19:03:44.113605+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:44.113605+0000","last_undegraded":"2024-04-23T19:03:44.113605+0000","last_fullsized":"2024-04-23T19:03:44.113605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389716+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:03:43.389716+0000","last_peered":"2024-04-23T19:03:43.389716+0000","last_clean":"2024-04-23T19:03:43.389716+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:03:43.389716+0000","last_undegraded":"2024-04-23T19:03:43.389716+0000","last_fullsized":"2024-04-23T19:03:43.389716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391449+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:43.391449+0000","last_peered":"2024-04-23T19:03:43.391449+0000","last_clean":"2024-04-23T19:03:43.391449+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:43.391449+0000","last_undegraded":"2024-04-23T19:03:43.391449+0000","last_fullsized":"2024-04-23T19:03:43.391449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394333+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:03:43.394333+0000","last_peered":"2024-04-23T19:03:43.394333+0000","last_clean":"2024-04-23T19:03:43.394333+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:03:43.394333+0000","last_undegraded":"2024-04-23T19:03:43.394333+0000","last_fullsized":"2024-04-23T19:03:43.394333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909061+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909061+0000","last_peered":"2024-04-23T19:03:43.909061+0000","last_clean":"2024-04-23T19:03:43.909061+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909061+0000","last_undegraded":"2024-04-23T19:03:43.909061+0000","last_fullsized":"2024-04-23T19:03:43.909061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"96'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114901+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:03:44.114901+0000","last_peered":"2024-04-23T19:03:44.114901+0000","last_clean":"2024-04-23T19:03:44.114901+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:03:44.114901+0000","last_undegraded":"2024-04-23T19:03:44.114901+0000","last_fullsized":"2024-04-23T19:03:44.114901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113766+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:03:44.113766+0000","last_peered":"2024-04-23T19:03:44.113766+0000","last_clean":"2024-04-23T19:03:44.113766+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:03:44.113766+0000","last_undegraded":"2024-04-23T19:03:44.113766+0000","last_fullsized":"2024-04-23T19:03:44.113766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709366+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:03:43.709366+0000","last_peered":"2024-04-23T19:03:43.709366+0000","last_clean":"2024-04-23T19:03:43.709366+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:03:43.709366+0000","last_undegraded":"2024-04-23T19:03:43.709366+0000","last_fullsized":"2024-04-23T19:03:43.709366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388767+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:03:43.388767+0000","last_peered":"2024-04-23T19:03:43.388767+0000","last_clean":"2024-04-23T19:03:43.388767+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:03:43.388767+0000","last_undegraded":"2024-04-23T19:03:43.388767+0000","last_fullsized":"2024-04-23T19:03:43.388767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709535+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:03:43.709535+0000","last_peered":"2024-04-23T19:03:43.709535+0000","last_clean":"2024-04-23T19:03:43.709535+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:03:43.709535+0000","last_undegraded":"2024-04-23T19:03:43.709535+0000","last_fullsized":"2024-04-23T19:03:43.709535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394020+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:03:43.394020+0000","last_peered":"2024-04-23T19:03:43.394020+0000","last_clean":"2024-04-23T19:03:43.394020+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:03:43.394020+0000","last_undegraded":"2024-04-23T19:03:43.394020+0000","last_fullsized":"2024-04-23T19:03:43.394020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"97'16","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910749+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:43.910749+0000","last_peered":"2024-04-23T19:03:43.910749+0000","last_clean":"2024-04-23T19:03:43.910749+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:43.910749+0000","last_undegraded":"2024-04-23T19:03:43.910749+0000","last_fullsized":"2024-04-23T19:03:43.910749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393743+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:03:43.393743+0000","last_peered":"2024-04-23T19:03:43.393743+0000","last_clean":"2024-04-23T19:03:43.393743+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:03:43.393743+0000","last_undegraded":"2024-04-23T19:03:43.393743+0000","last_fullsized":"2024-04-23T19:03:43.393743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"97'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392095+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:43.392095+0000","last_peered":"2024-04-23T19:03:43.392095+0000","last_clean":"2024-04-23T19:03:43.392095+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:43.392095+0000","last_undegraded":"2024-04-23T19:03:43.392095+0000","last_fullsized":"2024-04-23T19:03:43.392095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910786+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:03:43.910786+0000","last_peered":"2024-04-23T19:03:43.910786+0000","last_clean":"2024-04-23T19:03:43.910786+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:03:43.910786+0000","last_undegraded":"2024-04-23T19:03:43.910786+0000","last_fullsized":"2024-04-23T19:03:43.910786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112591+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:44.112591+0000","last_peered":"2024-04-23T19:03:44.112591+0000","last_clean":"2024-04-23T19:03:44.112591+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:44.112591+0000","last_undegraded":"2024-04-23T19:03:44.112591+0000","last_fullsized":"2024-04-23T19:03:44.112591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908784+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908784+0000","last_peered":"2024-04-23T19:03:43.908784+0000","last_clean":"2024-04-23T19:03:43.908784+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908784+0000","last_undegraded":"2024-04-23T19:03:43.908784+0000","last_fullsized":"2024-04-23T19:03:43.908784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391510+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:03:43.391510+0000","last_peered":"2024-04-23T19:03:43.391510+0000","last_clean":"2024-04-23T19:03:43.391510+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:03:43.391510+0000","last_undegraded":"2024-04-23T19:03:43.391510+0000","last_fullsized":"2024-04-23T19:03:43.391510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'24","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393870+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:03:43.393870+0000","last_peered":"2024-04-23T19:03:43.393870+0000","last_clean":"2024-04-23T19:03:43.393870+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:03:43.393870+0000","last_undegraded":"2024-04-23T19:03:43.393870+0000","last_fullsized":"2024-04-23T19:03:43.393870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389567+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:03:43.389567+0000","last_peered":"2024-04-23T19:03:43.389567+0000","last_clean":"2024-04-23T19:03:43.389567+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:03:43.389567+0000","last_undegraded":"2024-04-23T19:03:43.389567+0000","last_fullsized":"2024-04-23T19:03:43.389567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'19","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113502+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:44.113502+0000","last_peered":"2024-04-23T19:03:44.113502+0000","last_clean":"2024-04-23T19:03:44.113502+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:44.113502+0000","last_undegraded":"2024-04-23T19:03:44.113502+0000","last_fullsized":"2024-04-23T19:03:44.113502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114445+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114445+0000","last_peered":"2024-04-23T19:03:44.114445+0000","last_clean":"2024-04-23T19:03:44.114445+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114445+0000","last_undegraded":"2024-04-23T19:03:44.114445+0000","last_fullsized":"2024-04-23T19:03:44.114445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387854+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.387854+0000","last_peered":"2024-04-23T19:03:43.387854+0000","last_clean":"2024-04-23T19:03:43.387854+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.387854+0000","last_undegraded":"2024-04-23T19:03:43.387854+0000","last_fullsized":"2024-04-23T19:03:43.387854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390204+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:03:43.390204+0000","last_peered":"2024-04-23T19:03:43.390204+0000","last_clean":"2024-04-23T19:03:43.390204+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:03:43.390204+0000","last_undegraded":"2024-04-23T19:03:43.390204+0000","last_fullsized":"2024-04-23T19:03:43.390204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"97'31","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112702+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:44.112702+0000","last_peered":"2024-04-23T19:03:44.112702+0000","last_clean":"2024-04-23T19:03:44.112702+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:44.112702+0000","last_undegraded":"2024-04-23T19:03:44.112702+0000","last_fullsized":"2024-04-23T19:03:44.112702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391268+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391268+0000","last_peered":"2024-04-23T19:03:43.391268+0000","last_clean":"2024-04-23T19:03:43.391268+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391268+0000","last_undegraded":"2024-04-23T19:03:43.391268+0000","last_fullsized":"2024-04-23T19:03:43.391268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911442+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:03:43.911442+0000","last_peered":"2024-04-23T19:03:43.911442+0000","last_clean":"2024-04-23T19:03:43.911442+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:03:43.911442+0000","last_undegraded":"2024-04-23T19:03:43.911442+0000","last_fullsized":"2024-04-23T19:03:43.911442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910291+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910291+0000","last_peered":"2024-04-23T19:03:43.910291+0000","last_clean":"2024-04-23T19:03:43.910291+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910291+0000","last_undegraded":"2024-04-23T19:03:43.910291+0000","last_fullsized":"2024-04-23T19:03:43.910291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112392+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:03:44.112392+0000","last_peered":"2024-04-23T19:03:44.112392+0000","last_clean":"2024-04-23T19:03:44.112392+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:03:44.112392+0000","last_undegraded":"2024-04-23T19:03:44.112392+0000","last_fullsized":"2024-04-23T19:03:44.112392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114249+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:03:44.114249+0000","last_peered":"2024-04-23T19:03:44.114249+0000","last_clean":"2024-04-23T19:03:44.114249+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:03:44.114249+0000","last_undegraded":"2024-04-23T19:03:44.114249+0000","last_fullsized":"2024-04-23T19:03:44.114249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113863+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:44.113863+0000","last_peered":"2024-04-23T19:03:44.113863+0000","last_clean":"2024-04-23T19:03:44.113863+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:44.113863+0000","last_undegraded":"2024-04-23T19:03:44.113863+0000","last_fullsized":"2024-04-23T19:03:44.113863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393525+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:03:43.393525+0000","last_peered":"2024-04-23T19:03:43.393525+0000","last_clean":"2024-04-23T19:03:43.393525+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:03:43.393525+0000","last_undegraded":"2024-04-23T19:03:43.393525+0000","last_fullsized":"2024-04-23T19:03:43.393525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393562+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:03:43.393562+0000","last_peered":"2024-04-23T19:03:43.393562+0000","last_clean":"2024-04-23T19:03:43.393562+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:03:43.393562+0000","last_undegraded":"2024-04-23T19:03:43.393562+0000","last_fullsized":"2024-04-23T19:03:43.393562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'135","reported_seq":359,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558126+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:44.558126+0000","last_peered":"2024-04-23T19:03:44.558126+0000","last_clean":"2024-04-23T19:03:44.558126+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:44.558126+0000","last_undegraded":"2024-04-23T19:03:44.558126+0000","last_fullsized":"2024-04-23T19:03:44.558126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909665+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909665+0000","last_peered":"2024-04-23T19:03:43.909665+0000","last_clean":"2024-04-23T19:03:43.909665+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909665+0000","last_undegraded":"2024-04-23T19:03:43.909665+0000","last_fullsized":"2024-04-23T19:03:43.909665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393124+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:03:43.393124+0000","last_peered":"2024-04-23T19:03:43.393124+0000","last_clean":"2024-04-23T19:03:43.393124+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:03:43.393124+0000","last_undegraded":"2024-04-23T19:03:43.393124+0000","last_fullsized":"2024-04-23T19:03:43.393124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"97'24","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708227+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:03:43.708227+0000","last_peered":"2024-04-23T19:03:43.708227+0000","last_clean":"2024-04-23T19:03:43.708227+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:03:43.708227+0000","last_undegraded":"2024-04-23T19:03:43.708227+0000","last_fullsized":"2024-04-23T19:03:43.708227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389457+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:03:43.389457+0000","last_peered":"2024-04-23T19:03:43.389457+0000","last_clean":"2024-04-23T19:03:43.389457+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:03:43.389457+0000","last_undegraded":"2024-04-23T19:03:43.389457+0000","last_fullsized":"2024-04-23T19:03:43.389457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114533+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:03:44.114533+0000","last_peered":"2024-04-23T19:03:44.114533+0000","last_clean":"2024-04-23T19:03:44.114533+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:03:44.114533+0000","last_undegraded":"2024-04-23T19:03:44.114533+0000","last_fullsized":"2024-04-23T19:03:44.114533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557946+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:03:44.557946+0000","last_peered":"2024-04-23T19:03:44.557946+0000","last_clean":"2024-04-23T19:03:44.557946+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:03:44.557946+0000","last_undegraded":"2024-04-23T19:03:44.557946+0000","last_fullsized":"2024-04-23T19:03:44.557946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388486+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:03:43.388486+0000","last_peered":"2024-04-23T19:03:43.388486+0000","last_clean":"2024-04-23T19:03:43.388486+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:03:43.388486+0000","last_undegraded":"2024-04-23T19:03:43.388486+0000","last_fullsized":"2024-04-23T19:03:43.388486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115034+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:03:44.115034+0000","last_peered":"2024-04-23T19:03:44.115034+0000","last_clean":"2024-04-23T19:03:44.115034+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:03:44.115034+0000","last_undegraded":"2024-04-23T19:03:44.115034+0000","last_fullsized":"2024-04-23T19:03:44.115034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112930+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:03:44.112930+0000","last_peered":"2024-04-23T19:03:44.112930+0000","last_clean":"2024-04-23T19:03:44.112930+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:03:44.112930+0000","last_undegraded":"2024-04-23T19:03:44.112930+0000","last_fullsized":"2024-04-23T19:03:44.112930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388052+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:03:43.388052+0000","last_peered":"2024-04-23T19:03:43.388052+0000","last_clean":"2024-04-23T19:03:43.388052+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:03:43.388052+0000","last_undegraded":"2024-04-23T19:03:43.388052+0000","last_fullsized":"2024-04-23T19:03:43.388052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113425+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:03:44.113425+0000","last_peered":"2024-04-23T19:03:44.113425+0000","last_clean":"2024-04-23T19:03:44.113425+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:03:44.113425+0000","last_undegraded":"2024-04-23T19:03:44.113425+0000","last_fullsized":"2024-04-23T19:03:44.113425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388724+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388724+0000","last_peered":"2024-04-23T19:03:43.388724+0000","last_clean":"2024-04-23T19:03:43.388724+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388724+0000","last_undegraded":"2024-04-23T19:03:43.388724+0000","last_fullsized":"2024-04-23T19:03:43.388724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909389+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909389+0000","last_peered":"2024-04-23T19:03:43.909389+0000","last_clean":"2024-04-23T19:03:43.909389+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909389+0000","last_undegraded":"2024-04-23T19:03:43.909389+0000","last_fullsized":"2024-04-23T19:03:43.909389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'31","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115277+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:44.115277+0000","last_peered":"2024-04-23T19:03:44.115277+0000","last_clean":"2024-04-23T19:03:44.115277+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:44.115277+0000","last_undegraded":"2024-04-23T19:03:44.115277+0000","last_fullsized":"2024-04-23T19:03:44.115277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388320+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:03:43.388320+0000","last_peered":"2024-04-23T19:03:43.388320+0000","last_clean":"2024-04-23T19:03:43.388320+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:03:43.388320+0000","last_undegraded":"2024-04-23T19:03:43.388320+0000","last_fullsized":"2024-04-23T19:03:43.388320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392626+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:03:43.392626+0000","last_peered":"2024-04-23T19:03:43.392626+0000","last_clean":"2024-04-23T19:03:43.392626+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:03:43.392626+0000","last_undegraded":"2024-04-23T19:03:43.392626+0000","last_fullsized":"2024-04-23T19:03:43.392626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390803+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:03:43.390803+0000","last_peered":"2024-04-23T19:03:43.390803+0000","last_clean":"2024-04-23T19:03:43.390803+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:03:43.390803+0000","last_undegraded":"2024-04-23T19:03:43.390803+0000","last_fullsized":"2024-04-23T19:03:43.390803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708652+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708652+0000","last_peered":"2024-04-23T19:03:43.708652+0000","last_clean":"2024-04-23T19:03:43.708652+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708652+0000","last_undegraded":"2024-04-23T19:03:43.708652+0000","last_fullsized":"2024-04-23T19:03:43.708652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708882+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:03:43.708882+0000","last_peered":"2024-04-23T19:03:43.708882+0000","last_clean":"2024-04-23T19:03:43.708882+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:03:43.708882+0000","last_undegraded":"2024-04-23T19:03:43.708882+0000","last_fullsized":"2024-04-23T19:03:43.708882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"97'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115464+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:03:44.115464+0000","last_peered":"2024-04-23T19:03:44.115464+0000","last_clean":"2024-04-23T19:03:44.115464+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:03:44.115464+0000","last_undegraded":"2024-04-23T19:03:44.115464+0000","last_fullsized":"2024-04-23T19:03:44.115464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394271+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:03:43.394271+0000","last_peered":"2024-04-23T19:03:43.394271+0000","last_clean":"2024-04-23T19:03:43.394271+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:03:43.394271+0000","last_undegraded":"2024-04-23T19:03:43.394271+0000","last_fullsized":"2024-04-23T19:03:43.394271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'23","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113515+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:03:44.113515+0000","last_peered":"2024-04-23T19:03:44.113515+0000","last_clean":"2024-04-23T19:03:44.113515+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:03:44.113515+0000","last_undegraded":"2024-04-23T19:03:44.113515+0000","last_fullsized":"2024-04-23T19:03:44.113515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557648+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:03:44.557648+0000","last_peered":"2024-04-23T19:03:44.557648+0000","last_clean":"2024-04-23T19:03:44.557648+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:03:44.557648+0000","last_undegraded":"2024-04-23T19:03:44.557648+0000","last_fullsized":"2024-04-23T19:03:44.557648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113763+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:03:44.113763+0000","last_peered":"2024-04-23T19:03:44.113763+0000","last_clean":"2024-04-23T19:03:44.113763+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:44.113763+0000","last_undegraded":"2024-04-23T19:03:44.113763+0000","last_fullsized":"2024-04-23T19:03:44.113763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113964+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.113964+0000","last_peered":"2024-04-23T19:03:44.113964+0000","last_clean":"2024-04-23T19:03:44.113964+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.113964+0000","last_undegraded":"2024-04-23T19:03:44.113964+0000","last_fullsized":"2024-04-23T19:03:44.113964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389851+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:43.389851+0000","last_peered":"2024-04-23T19:03:43.389851+0000","last_clean":"2024-04-23T19:03:43.389851+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:43.389851+0000","last_undegraded":"2024-04-23T19:03:43.389851+0000","last_fullsized":"2024-04-23T19:03:43.389851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393360+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:03:43.393360+0000","last_peered":"2024-04-23T19:03:43.393360+0000","last_clean":"2024-04-23T19:03:43.393360+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:03:43.393360+0000","last_undegraded":"2024-04-23T19:03:43.393360+0000","last_fullsized":"2024-04-23T19:03:43.393360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'30","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112891+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:03:44.112891+0000","last_peered":"2024-04-23T19:03:44.112891+0000","last_clean":"2024-04-23T19:03:44.112891+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:03:44.112891+0000","last_undegraded":"2024-04-23T19:03:44.112891+0000","last_fullsized":"2024-04-23T19:03:44.112891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389128+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:03:43.389128+0000","last_peered":"2024-04-23T19:03:43.389128+0000","last_clean":"2024-04-23T19:03:43.389128+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:03:43.389128+0000","last_undegraded":"2024-04-23T19:03:43.389128+0000","last_fullsized":"2024-04-23T19:03:43.389128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'8","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115520+0000","last_change":"2024-04-23T19:03:32.295412+0000","last_active":"2024-04-23T19:03:44.115520+0000","last_peered":"2024-04-23T19:03:44.115520+0000","last_clean":"2024-04-23T19:03:44.115520+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:03:44.115520+0000","last_undegraded":"2024-04-23T19:03:44.115520+0000","last_fullsized":"2024-04-23T19:03:44.115520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:38.660742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911690+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:03:43.911690+0000","last_peered":"2024-04-23T19:03:43.911690+0000","last_clean":"2024-04-23T19:03:43.911690+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:03:43.911690+0000","last_undegraded":"2024-04-23T19:03:43.911690+0000","last_fullsized":"2024-04-23T19:03:43.911690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391669+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:43.391669+0000","last_peered":"2024-04-23T19:03:43.391669+0000","last_clean":"2024-04-23T19:03:43.391669+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:43.391669+0000","last_undegraded":"2024-04-23T19:03:43.391669+0000","last_fullsized":"2024-04-23T19:03:43.391669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393878+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:03:43.393878+0000","last_peered":"2024-04-23T19:03:43.393878+0000","last_clean":"2024-04-23T19:03:43.393878+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:03:43.393878+0000","last_undegraded":"2024-04-23T19:03:43.393878+0000","last_fullsized":"2024-04-23T19:03:43.393878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910655+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:03:43.910655+0000","last_peered":"2024-04-23T19:03:43.910655+0000","last_clean":"2024-04-23T19:03:43.910655+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:03:43.910655+0000","last_undegraded":"2024-04-23T19:03:43.910655+0000","last_fullsized":"2024-04-23T19:03:43.910655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114514+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114514+0000","last_peered":"2024-04-23T19:03:44.114514+0000","last_clean":"2024-04-23T19:03:44.114514+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114514+0000","last_undegraded":"2024-04-23T19:03:44.114514+0000","last_fullsized":"2024-04-23T19:03:44.114514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388173+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388173+0000","last_peered":"2024-04-23T19:03:43.388173+0000","last_clean":"2024-04-23T19:03:43.388173+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388173+0000","last_undegraded":"2024-04-23T19:03:43.388173+0000","last_fullsized":"2024-04-23T19:03:43.388173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911045+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:03:43.911045+0000","last_peered":"2024-04-23T19:03:43.911045+0000","last_clean":"2024-04-23T19:03:43.911045+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:03:43.911045+0000","last_undegraded":"2024-04-23T19:03:43.911045+0000","last_fullsized":"2024-04-23T19:03:43.911045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709068+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:03:43.709068+0000","last_peered":"2024-04-23T19:03:43.709068+0000","last_clean":"2024-04-23T19:03:43.709068+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:03:43.709068+0000","last_undegraded":"2024-04-23T19:03:43.709068+0000","last_fullsized":"2024-04-23T19:03:43.709068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113707+0000","last_change":"2024-04-23T19:03:32.296246+0000","last_active":"2024-04-23T19:03:44.113707+0000","last_peered":"2024-04-23T19:03:44.113707+0000","last_clean":"2024-04-23T19:03:44.113707+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:03:44.113707+0000","last_undegraded":"2024-04-23T19:03:44.113707+0000","last_fullsized":"2024-04-23T19:03:44.113707+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:48.818498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394174+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:03:43.394174+0000","last_peered":"2024-04-23T19:03:43.394174+0000","last_clean":"2024-04-23T19:03:43.394174+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:03:43.394174+0000","last_undegraded":"2024-04-23T19:03:43.394174+0000","last_fullsized":"2024-04-23T19:03:43.394174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'135","reported_seq":376,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558589+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:03:44.558589+0000","last_peered":"2024-04-23T19:03:44.558589+0000","last_clean":"2024-04-23T19:03:44.558589+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:03:44.558589+0000","last_undegraded":"2024-04-23T19:03:44.558589+0000","last_fullsized":"2024-04-23T19:03:44.558589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":154,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112679+0000","last_change":"2024-04-23T19:03:32.290672+0000","last_active":"2024-04-23T19:03:44.112679+0000","last_peered":"2024-04-23T19:03:44.112679+0000","last_clean":"2024-04-23T19:03:44.112679+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:03:44.112679+0000","last_undegraded":"2024-04-23T19:03:44.112679+0000","last_fullsized":"2024-04-23T19:03:44.112679+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:19.410020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911686+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:03:43.911686+0000","last_peered":"2024-04-23T19:03:43.911686+0000","last_clean":"2024-04-23T19:03:43.911686+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:03:43.911686+0000","last_undegraded":"2024-04-23T19:03:43.911686+0000","last_fullsized":"2024-04-23T19:03:43.911686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910029+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:43.910029+0000","last_peered":"2024-04-23T19:03:43.910029+0000","last_clean":"2024-04-23T19:03:43.910029+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:43.910029+0000","last_undegraded":"2024-04-23T19:03:43.910029+0000","last_fullsized":"2024-04-23T19:03:43.910029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390002+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:03:43.390002+0000","last_peered":"2024-04-23T19:03:43.390002+0000","last_clean":"2024-04-23T19:03:43.390002+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:03:43.390002+0000","last_undegraded":"2024-04-23T19:03:43.390002+0000","last_fullsized":"2024-04-23T19:03:43.390002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"98'12","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390965+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:03:43.390965+0000","last_peered":"2024-04-23T19:03:43.390965+0000","last_clean":"2024-04-23T19:03:43.390965+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:03:43.390965+0000","last_undegraded":"2024-04-23T19:03:43.390965+0000","last_fullsized":"2024-04-23T19:03:43.390965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'135","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557251+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:03:44.557251+0000","last_peered":"2024-04-23T19:03:44.557251+0000","last_clean":"2024-04-23T19:03:44.557251+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:03:44.557251+0000","last_undegraded":"2024-04-23T19:03:44.557251+0000","last_fullsized":"2024-04-23T19:03:44.557251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910131+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910131+0000","last_peered":"2024-04-23T19:03:43.910131+0000","last_clean":"2024-04-23T19:03:43.910131+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910131+0000","last_undegraded":"2024-04-23T19:03:43.910131+0000","last_fullsized":"2024-04-23T19:03:43.910131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115660+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:03:44.115660+0000","last_peered":"2024-04-23T19:03:44.115660+0000","last_clean":"2024-04-23T19:03:44.115660+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:03:44.115660+0000","last_undegraded":"2024-04-23T19:03:44.115660+0000","last_fullsized":"2024-04-23T19:03:44.115660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391592+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:43.391592+0000","last_peered":"2024-04-23T19:03:43.391592+0000","last_clean":"2024-04-23T19:03:43.391592+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:43.391592+0000","last_undegraded":"2024-04-23T19:03:43.391592+0000","last_fullsized":"2024-04-23T19:03:43.391592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910950+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:03:43.910950+0000","last_peered":"2024-04-23T19:03:43.910950+0000","last_clean":"2024-04-23T19:03:43.910950+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:03:43.910950+0000","last_undegraded":"2024-04-23T19:03:43.910950+0000","last_fullsized":"2024-04-23T19:03:43.910950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'26","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389169+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:43.389169+0000","last_peered":"2024-04-23T19:03:43.389169+0000","last_clean":"2024-04-23T19:03:43.389169+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:43.389169+0000","last_undegraded":"2024-04-23T19:03:43.389169+0000","last_fullsized":"2024-04-23T19:03:43.389169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708197+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:03:43.708197+0000","last_peered":"2024-04-23T19:03:43.708197+0000","last_clean":"2024-04-23T19:03:43.708197+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:03:43.708197+0000","last_undegraded":"2024-04-23T19:03:43.708197+0000","last_fullsized":"2024-04-23T19:03:43.708197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113320+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113320+0000","last_peered":"2024-04-23T19:03:44.113320+0000","last_clean":"2024-04-23T19:03:44.113320+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113320+0000","last_undegraded":"2024-04-23T19:03:44.113320+0000","last_fullsized":"2024-04-23T19:03:44.113320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:09.210430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709271+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:03:43.709271+0000","last_peered":"2024-04-23T19:03:43.709271+0000","last_clean":"2024-04-23T19:03:43.709271+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:03:43.709271+0000","last_undegraded":"2024-04-23T19:03:43.709271+0000","last_fullsized":"2024-04-23T19:03:43.709271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113725+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:03:44.113725+0000","last_peered":"2024-04-23T19:03:44.113725+0000","last_clean":"2024-04-23T19:03:44.113725+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:03:44.113725+0000","last_undegraded":"2024-04-23T19:03:44.113725+0000","last_fullsized":"2024-04-23T19:03:44.113725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389218+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:03:43.389218+0000","last_peered":"2024-04-23T19:03:43.389218+0000","last_clean":"2024-04-23T19:03:43.389218+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:03:43.389218+0000","last_undegraded":"2024-04-23T19:03:43.389218+0000","last_fullsized":"2024-04-23T19:03:43.389218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391341+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:43.391341+0000","last_peered":"2024-04-23T19:03:43.391341+0000","last_clean":"2024-04-23T19:03:43.391341+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:43.391341+0000","last_undegraded":"2024-04-23T19:03:43.391341+0000","last_fullsized":"2024-04-23T19:03:43.391341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114228+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:03:44.114228+0000","last_peered":"2024-04-23T19:03:44.114228+0000","last_clean":"2024-04-23T19:03:44.114228+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:03:44.114228+0000","last_undegraded":"2024-04-23T19:03:44.114228+0000","last_fullsized":"2024-04-23T19:03:44.114228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'39","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390341+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:03:43.390341+0000","last_peered":"2024-04-23T19:03:43.390341+0000","last_clean":"2024-04-23T19:03:43.390341+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:03:43.390341+0000","last_undegraded":"2024-04-23T19:03:43.390341+0000","last_fullsized":"2024-04-23T19:03:43.390341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113854+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:03:44.113854+0000","last_peered":"2024-04-23T19:03:44.113854+0000","last_clean":"2024-04-23T19:03:44.113854+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:03:44.113854+0000","last_undegraded":"2024-04-23T19:03:44.113854+0000","last_fullsized":"2024-04-23T19:03:44.113854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707656+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707656+0000","last_peered":"2024-04-23T19:03:43.707656+0000","last_clean":"2024-04-23T19:03:43.707656+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707656+0000","last_undegraded":"2024-04-23T19:03:43.707656+0000","last_fullsized":"2024-04-23T19:03:43.707656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114161+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:03:44.114161+0000","last_peered":"2024-04-23T19:03:44.114161+0000","last_clean":"2024-04-23T19:03:44.114161+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:03:44.114161+0000","last_undegraded":"2024-04-23T19:03:44.114161+0000","last_fullsized":"2024-04-23T19:03:44.114161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113340+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:03:44.113340+0000","last_peered":"2024-04-23T19:03:44.113340+0000","last_clean":"2024-04-23T19:03:44.113340+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:03:44.113340+0000","last_undegraded":"2024-04-23T19:03:44.113340+0000","last_fullsized":"2024-04-23T19:03:44.113340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112983+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:44.112983+0000","last_peered":"2024-04-23T19:03:44.112983+0000","last_clean":"2024-04-23T19:03:44.112983+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:44.112983+0000","last_undegraded":"2024-04-23T19:03:44.112983+0000","last_fullsized":"2024-04-23T19:03:44.112983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390688+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:03:43.390688+0000","last_peered":"2024-04-23T19:03:43.390688+0000","last_clean":"2024-04-23T19:03:43.390688+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:03:43.390688+0000","last_undegraded":"2024-04-23T19:03:43.390688+0000","last_fullsized":"2024-04-23T19:03:43.390688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'137","reported_seq":429,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558590+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:03:44.558590+0000","last_peered":"2024-04-23T19:03:44.558590+0000","last_clean":"2024-04-23T19:03:44.558590+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:03:44.558590+0000","last_undegraded":"2024-04-23T19:03:44.558590+0000","last_fullsized":"2024-04-23T19:03:44.558590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114354+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114354+0000","last_peered":"2024-04-23T19:03:44.114354+0000","last_clean":"2024-04-23T19:03:44.114354+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114354+0000","last_undegraded":"2024-04-23T19:03:44.114354+0000","last_fullsized":"2024-04-23T19:03:44.114354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112303+0000","last_change":"2024-04-23T19:03:32.286556+0000","last_active":"2024-04-23T19:03:44.112303+0000","last_peered":"2024-04-23T19:03:44.112303+0000","last_clean":"2024-04-23T19:03:44.112303+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:03:44.112303+0000","last_undegraded":"2024-04-23T19:03:44.112303+0000","last_fullsized":"2024-04-23T19:03:44.112303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:18.008985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115727+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:03:44.115727+0000","last_peered":"2024-04-23T19:03:44.115727+0000","last_clean":"2024-04-23T19:03:44.115727+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:03:44.115727+0000","last_undegraded":"2024-04-23T19:03:44.115727+0000","last_fullsized":"2024-04-23T19:03:44.115727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389027+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:03:43.389027+0000","last_peered":"2024-04-23T19:03:43.389027+0000","last_clean":"2024-04-23T19:03:43.389027+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:03:43.389027+0000","last_undegraded":"2024-04-23T19:03:43.389027+0000","last_fullsized":"2024-04-23T19:03:43.389027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"96'14","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112139+0000","last_change":"2024-04-23T19:03:32.290315+0000","last_active":"2024-04-23T19:03:44.112139+0000","last_peered":"2024-04-23T19:03:44.112139+0000","last_clean":"2024-04-23T19:03:44.112139+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:03:44.112139+0000","last_undegraded":"2024-04-23T19:03:44.112139+0000","last_fullsized":"2024-04-23T19:03:44.112139+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:50.252138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393921+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:03:43.393921+0000","last_peered":"2024-04-23T19:03:43.393921+0000","last_clean":"2024-04-23T19:03:43.393921+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:03:43.393921+0000","last_undegraded":"2024-04-23T19:03:43.393921+0000","last_fullsized":"2024-04-23T19:03:43.393921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113413+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:03:44.113413+0000","last_peered":"2024-04-23T19:03:44.113413+0000","last_clean":"2024-04-23T19:03:44.113413+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:03:44.113413+0000","last_undegraded":"2024-04-23T19:03:44.113413+0000","last_fullsized":"2024-04-23T19:03:44.113413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392383+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392383+0000","last_peered":"2024-04-23T19:03:43.392383+0000","last_clean":"2024-04-23T19:03:43.392383+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392383+0000","last_undegraded":"2024-04-23T19:03:43.392383+0000","last_fullsized":"2024-04-23T19:03:43.392383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113895+0000","last_change":"2024-04-23T19:03:32.300198+0000","last_active":"2024-04-23T19:03:44.113895+0000","last_peered":"2024-04-23T19:03:44.113895+0000","last_clean":"2024-04-23T19:03:44.113895+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:03:44.113895+0000","last_undegraded":"2024-04-23T19:03:44.113895+0000","last_fullsized":"2024-04-23T19:03:44.113895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:55:20.076349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389317+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:03:43.389317+0000","last_peered":"2024-04-23T19:03:43.389317+0000","last_clean":"2024-04-23T19:03:43.389317+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:03:43.389317+0000","last_undegraded":"2024-04-23T19:03:43.389317+0000","last_fullsized":"2024-04-23T19:03:43.389317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911323+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:43.911323+0000","last_peered":"2024-04-23T19:03:43.911323+0000","last_clean":"2024-04-23T19:03:43.911323+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:43.911323+0000","last_undegraded":"2024-04-23T19:03:43.911323+0000","last_fullsized":"2024-04-23T19:03:43.911323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":280,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113800+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:03:44.113800+0000","last_peered":"2024-04-23T19:03:44.113800+0000","last_clean":"2024-04-23T19:03:44.113800+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:03:44.113800+0000","last_undegraded":"2024-04-23T19:03:44.113800+0000","last_fullsized":"2024-04-23T19:03:44.113800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393082+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393082+0000","last_peered":"2024-04-23T19:03:43.393082+0000","last_clean":"2024-04-23T19:03:43.393082+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393082+0000","last_undegraded":"2024-04-23T19:03:43.393082+0000","last_fullsized":"2024-04-23T19:03:43.393082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709817+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709817+0000","last_peered":"2024-04-23T19:03:43.709817+0000","last_clean":"2024-04-23T19:03:43.709817+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709817+0000","last_undegraded":"2024-04-23T19:03:43.709817+0000","last_fullsized":"2024-04-23T19:03:43.709817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387614+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387614+0000","last_peered":"2024-04-23T19:03:43.387614+0000","last_clean":"2024-04-23T19:03:43.387614+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387614+0000","last_undegraded":"2024-04-23T19:03:43.387614+0000","last_fullsized":"2024-04-23T19:03:43.387614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113459+0000","last_change":"2024-04-23T19:03:32.295129+0000","last_active":"2024-04-23T19:03:44.113459+0000","last_peered":"2024-04-23T19:03:44.113459+0000","last_clean":"2024-04-23T19:03:44.113459+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:03:44.113459+0000","last_undegraded":"2024-04-23T19:03:44.113459+0000","last_fullsized":"2024-04-23T19:03:44.113459+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:35:11.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390260+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:43.390260+0000","last_peered":"2024-04-23T19:03:43.390260+0000","last_clean":"2024-04-23T19:03:43.390260+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:43.390260+0000","last_undegraded":"2024-04-23T19:03:43.390260+0000","last_fullsized":"2024-04-23T19:03:43.390260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114156+0000","last_change":"2024-04-23T19:03:32.293904+0000","last_active":"2024-04-23T19:03:44.114156+0000","last_peered":"2024-04-23T19:03:44.114156+0000","last_clean":"2024-04-23T19:03:44.114156+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:03:44.114156+0000","last_undegraded":"2024-04-23T19:03:44.114156+0000","last_fullsized":"2024-04-23T19:03:44.114156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:21.520365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113604+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:03:44.113604+0000","last_peered":"2024-04-23T19:03:44.113604+0000","last_clean":"2024-04-23T19:03:44.113604+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:03:44.113604+0000","last_undegraded":"2024-04-23T19:03:44.113604+0000","last_fullsized":"2024-04-23T19:03:44.113604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'34","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112855+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:03:44.112855+0000","last_peered":"2024-04-23T19:03:44.112855+0000","last_clean":"2024-04-23T19:03:44.112855+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:03:44.112855+0000","last_undegraded":"2024-04-23T19:03:44.112855+0000","last_fullsized":"2024-04-23T19:03:44.112855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908951+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.908951+0000","last_peered":"2024-04-23T19:03:43.908951+0000","last_clean":"2024-04-23T19:03:43.908951+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.908951+0000","last_undegraded":"2024-04-23T19:03:43.908951+0000","last_fullsized":"2024-04-23T19:03:43.908951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113600+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:03:44.113600+0000","last_peered":"2024-04-23T19:03:44.113600+0000","last_clean":"2024-04-23T19:03:44.113600+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:03:44.113600+0000","last_undegraded":"2024-04-23T19:03:44.113600+0000","last_fullsized":"2024-04-23T19:03:44.113600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113874+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:03:44.113874+0000","last_peered":"2024-04-23T19:03:44.113874+0000","last_clean":"2024-04-23T19:03:44.113874+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:03:44.113874+0000","last_undegraded":"2024-04-23T19:03:44.113874+0000","last_fullsized":"2024-04-23T19:03:44.113874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"97'22","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113983+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:44.113983+0000","last_peered":"2024-04-23T19:03:44.113983+0000","last_clean":"2024-04-23T19:03:44.113983+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:44.113983+0000","last_undegraded":"2024-04-23T19:03:44.113983+0000","last_fullsized":"2024-04-23T19:03:44.113983+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.348240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115650+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:03:44.115650+0000","last_peered":"2024-04-23T19:03:44.115650+0000","last_clean":"2024-04-23T19:03:44.115650+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:03:44.115650+0000","last_undegraded":"2024-04-23T19:03:44.115650+0000","last_fullsized":"2024-04-23T19:03:44.115650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708440+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:03:43.708440+0000","last_peered":"2024-04-23T19:03:43.708440+0000","last_clean":"2024-04-23T19:03:43.708440+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:03:43.708440+0000","last_undegraded":"2024-04-23T19:03:43.708440+0000","last_fullsized":"2024-04-23T19:03:43.708440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112369+0000","last_change":"2024-04-23T19:03:32.300841+0000","last_active":"2024-04-23T19:03:44.112369+0000","last_peered":"2024-04-23T19:03:44.112369+0000","last_clean":"2024-04-23T19:03:44.112369+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:03:44.112369+0000","last_undegraded":"2024-04-23T19:03:44.112369+0000","last_fullsized":"2024-04-23T19:03:44.112369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:36.411296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393276+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393276+0000","last_peered":"2024-04-23T19:03:43.393276+0000","last_clean":"2024-04-23T19:03:43.393276+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393276+0000","last_undegraded":"2024-04-23T19:03:43.393276+0000","last_fullsized":"2024-04-23T19:03:43.393276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391087+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:03:43.391087+0000","last_peered":"2024-04-23T19:03:43.391087+0000","last_clean":"2024-04-23T19:03:43.391087+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:03:43.391087+0000","last_undegraded":"2024-04-23T19:03:43.391087+0000","last_fullsized":"2024-04-23T19:03:43.391087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"97'20","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392954+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:43.392954+0000","last_peered":"2024-04-23T19:03:43.392954+0000","last_clean":"2024-04-23T19:03:43.392954+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:43.392954+0000","last_undegraded":"2024-04-23T19:03:43.392954+0000","last_fullsized":"2024-04-23T19:03:43.392954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115534+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115534+0000","last_peered":"2024-04-23T19:03:44.115534+0000","last_clean":"2024-04-23T19:03:44.115534+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115534+0000","last_undegraded":"2024-04-23T19:03:44.115534+0000","last_fullsized":"2024-04-23T19:03:44.115534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:41.115956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909201+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:03:43.909201+0000","last_peered":"2024-04-23T19:03:43.909201+0000","last_clean":"2024-04-23T19:03:43.909201+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:03:43.909201+0000","last_undegraded":"2024-04-23T19:03:43.909201+0000","last_fullsized":"2024-04-23T19:03:43.909201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910617+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:03:43.910617+0000","last_peered":"2024-04-23T19:03:43.910617+0000","last_clean":"2024-04-23T19:03:43.910617+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:03:43.910617+0000","last_undegraded":"2024-04-23T19:03:43.910617+0000","last_fullsized":"2024-04-23T19:03:43.910617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'135","reported_seq":439,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557152+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:03:44.557152+0000","last_peered":"2024-04-23T19:03:44.557152+0000","last_clean":"2024-04-23T19:03:44.557152+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:03:44.557152+0000","last_undegraded":"2024-04-23T19:03:44.557152+0000","last_fullsized":"2024-04-23T19:03:44.557152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113500+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:44.113500+0000","last_peered":"2024-04-23T19:03:44.113500+0000","last_clean":"2024-04-23T19:03:44.113500+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:44.113500+0000","last_undegraded":"2024-04-23T19:03:44.113500+0000","last_fullsized":"2024-04-23T19:03:44.113500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909395+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909395+0000","last_peered":"2024-04-23T19:03:43.909395+0000","last_clean":"2024-04-23T19:03:43.909395+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909395+0000","last_undegraded":"2024-04-23T19:03:43.909395+0000","last_fullsized":"2024-04-23T19:03:43.909395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"97'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114287+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:44.114287+0000","last_peered":"2024-04-23T19:03:44.114287+0000","last_clean":"2024-04-23T19:03:44.114287+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:44.114287+0000","last_undegraded":"2024-04-23T19:03:44.114287+0000","last_fullsized":"2024-04-23T19:03:44.114287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710129+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:03:43.710129+0000","last_peered":"2024-04-23T19:03:43.710129+0000","last_clean":"2024-04-23T19:03:43.710129+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:03:43.710129+0000","last_undegraded":"2024-04-23T19:03:43.710129+0000","last_fullsized":"2024-04-23T19:03:43.710129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390843+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:03:43.390843+0000","last_peered":"2024-04-23T19:03:43.390843+0000","last_clean":"2024-04-23T19:03:43.390843+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:03:43.390843+0000","last_undegraded":"2024-04-23T19:03:43.390843+0000","last_fullsized":"2024-04-23T19:03:43.390843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390945+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:03:43.390945+0000","last_peered":"2024-04-23T19:03:43.390945+0000","last_clean":"2024-04-23T19:03:43.390945+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:03:43.390945+0000","last_undegraded":"2024-04-23T19:03:43.390945+0000","last_fullsized":"2024-04-23T19:03:43.390945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388873+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.388873+0000","last_peered":"2024-04-23T19:03:43.388873+0000","last_clean":"2024-04-23T19:03:43.388873+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.388873+0000","last_undegraded":"2024-04-23T19:03:43.388873+0000","last_fullsized":"2024-04-23T19:03:43.388873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114432+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:03:44.114432+0000","last_peered":"2024-04-23T19:03:44.114432+0000","last_clean":"2024-04-23T19:03:44.114432+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:03:44.114432+0000","last_undegraded":"2024-04-23T19:03:44.114432+0000","last_fullsized":"2024-04-23T19:03:44.114432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909827+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:03:43.909827+0000","last_peered":"2024-04-23T19:03:43.909827+0000","last_clean":"2024-04-23T19:03:43.909827+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:03:43.909827+0000","last_undegraded":"2024-04-23T19:03:43.909827+0000","last_fullsized":"2024-04-23T19:03:43.909827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910450+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:43.910450+0000","last_peered":"2024-04-23T19:03:43.910450+0000","last_clean":"2024-04-23T19:03:43.910450+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:43.910450+0000","last_undegraded":"2024-04-23T19:03:43.910450+0000","last_fullsized":"2024-04-23T19:03:43.910450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113537+0000","last_change":"2024-04-23T19:03:32.294993+0000","last_active":"2024-04-23T19:03:44.113537+0000","last_peered":"2024-04-23T19:03:44.113537+0000","last_clean":"2024-04-23T19:03:44.113537+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:03:44.113537+0000","last_undegraded":"2024-04-23T19:03:44.113537+0000","last_fullsized":"2024-04-23T19:03:44.113537+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:50.832778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'19","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388829+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:03:43.388829+0000","last_peered":"2024-04-23T19:03:43.388829+0000","last_clean":"2024-04-23T19:03:43.388829+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:03:43.388829+0000","last_undegraded":"2024-04-23T19:03:43.388829+0000","last_fullsized":"2024-04-23T19:03:43.388829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388406+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:03:43.388406+0000","last_peered":"2024-04-23T19:03:43.388406+0000","last_clean":"2024-04-23T19:03:43.388406+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:03:43.388406+0000","last_undegraded":"2024-04-23T19:03:43.388406+0000","last_fullsized":"2024-04-23T19:03:43.388406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392779+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:03:43.392779+0000","last_peered":"2024-04-23T19:03:43.392779+0000","last_clean":"2024-04-23T19:03:43.392779+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:03:43.392779+0000","last_undegraded":"2024-04-23T19:03:43.392779+0000","last_fullsized":"2024-04-23T19:03:43.392779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113434+0000","last_change":"2024-04-23T19:03:32.300516+0000","last_active":"2024-04-23T19:03:44.113434+0000","last_peered":"2024-04-23T19:03:44.113434+0000","last_clean":"2024-04-23T19:03:44.113434+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:03:44.113434+0000","last_undegraded":"2024-04-23T19:03:44.113434+0000","last_fullsized":"2024-04-23T19:03:44.113434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:02.485036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"97'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115124+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:44.115124+0000","last_peered":"2024-04-23T19:03:44.115124+0000","last_clean":"2024-04-23T19:03:44.115124+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:44.115124+0000","last_undegraded":"2024-04-23T19:03:44.115124+0000","last_fullsized":"2024-04-23T19:03:44.115124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392243+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:03:43.392243+0000","last_peered":"2024-04-23T19:03:43.392243+0000","last_clean":"2024-04-23T19:03:43.392243+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:03:43.392243+0000","last_undegraded":"2024-04-23T19:03:43.392243+0000","last_fullsized":"2024-04-23T19:03:43.392243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"100'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112763+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:03:44.112763+0000","last_peered":"2024-04-23T19:03:44.112763+0000","last_clean":"2024-04-23T19:03:44.112763+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:03:44.112763+0000","last_undegraded":"2024-04-23T19:03:44.112763+0000","last_fullsized":"2024-04-23T19:03:44.112763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113317+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:03:44.113317+0000","last_peered":"2024-04-23T19:03:44.113317+0000","last_clean":"2024-04-23T19:03:44.113317+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:03:44.113317+0000","last_undegraded":"2024-04-23T19:03:44.113317+0000","last_fullsized":"2024-04-23T19:03:44.113317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113692+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:44.113692+0000","last_peered":"2024-04-23T19:03:44.113692+0000","last_clean":"2024-04-23T19:03:44.113692+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:44.113692+0000","last_undegraded":"2024-04-23T19:03:44.113692+0000","last_fullsized":"2024-04-23T19:03:44.113692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389971+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:03:43.389971+0000","last_peered":"2024-04-23T19:03:43.389971+0000","last_clean":"2024-04-23T19:03:43.389971+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:03:43.389971+0000","last_undegraded":"2024-04-23T19:03:43.389971+0000","last_fullsized":"2024-04-23T19:03:43.389971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390374+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:03:43.390374+0000","last_peered":"2024-04-23T19:03:43.390374+0000","last_clean":"2024-04-23T19:03:43.390374+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:03:43.390374+0000","last_undegraded":"2024-04-23T19:03:43.390374+0000","last_fullsized":"2024-04-23T19:03:43.390374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112637+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:03:44.112637+0000","last_peered":"2024-04-23T19:03:44.112637+0000","last_clean":"2024-04-23T19:03:44.112637+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:03:44.112637+0000","last_undegraded":"2024-04-23T19:03:44.112637+0000","last_fullsized":"2024-04-23T19:03:44.112637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391944+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:03:43.391944+0000","last_peered":"2024-04-23T19:03:43.391944+0000","last_clean":"2024-04-23T19:03:43.391944+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:03:43.391944+0000","last_undegraded":"2024-04-23T19:03:43.391944+0000","last_fullsized":"2024-04-23T19:03:43.391944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708373+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:03:43.708373+0000","last_peered":"2024-04-23T19:03:43.708373+0000","last_clean":"2024-04-23T19:03:43.708373+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:03:43.708373+0000","last_undegraded":"2024-04-23T19:03:43.708373+0000","last_fullsized":"2024-04-23T19:03:43.708373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388390+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388390+0000","last_peered":"2024-04-23T19:03:43.388390+0000","last_clean":"2024-04-23T19:03:43.388390+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388390+0000","last_undegraded":"2024-04-23T19:03:43.388390+0000","last_fullsized":"2024-04-23T19:03:43.388390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391315+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391315+0000","last_peered":"2024-04-23T19:03:43.391315+0000","last_clean":"2024-04-23T19:03:43.391315+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391315+0000","last_undegraded":"2024-04-23T19:03:43.391315+0000","last_fullsized":"2024-04-23T19:03:43.391315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"97'28","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114624+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:44.114624+0000","last_peered":"2024-04-23T19:03:44.114624+0000","last_clean":"2024-04-23T19:03:44.114624+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:44.114624+0000","last_undegraded":"2024-04-23T19:03:44.114624+0000","last_fullsized":"2024-04-23T19:03:44.114624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708231+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:03:43.708231+0000","last_peered":"2024-04-23T19:03:43.708231+0000","last_clean":"2024-04-23T19:03:43.708231+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:03:43.708231+0000","last_undegraded":"2024-04-23T19:03:43.708231+0000","last_fullsized":"2024-04-23T19:03:43.708231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113187+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:03:44.113187+0000","last_peered":"2024-04-23T19:03:44.113187+0000","last_clean":"2024-04-23T19:03:44.113187+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:03:44.113187+0000","last_undegraded":"2024-04-23T19:03:44.113187+0000","last_fullsized":"2024-04-23T19:03:44.113187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113407+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:03:44.113407+0000","last_peered":"2024-04-23T19:03:44.113407+0000","last_clean":"2024-04-23T19:03:44.113407+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:03:44.113407+0000","last_undegraded":"2024-04-23T19:03:44.113407+0000","last_fullsized":"2024-04-23T19:03:44.113407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710040+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:03:43.710040+0000","last_peered":"2024-04-23T19:03:43.710040+0000","last_clean":"2024-04-23T19:03:43.710040+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:03:43.710040+0000","last_undegraded":"2024-04-23T19:03:43.710040+0000","last_fullsized":"2024-04-23T19:03:43.710040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"96'20","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391502+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:43.391502+0000","last_peered":"2024-04-23T19:03:43.391502+0000","last_clean":"2024-04-23T19:03:43.391502+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:43.391502+0000","last_undegraded":"2024-04-23T19:03:43.391502+0000","last_fullsized":"2024-04-23T19:03:43.391502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113935+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:03:44.113935+0000","last_peered":"2024-04-23T19:03:44.113935+0000","last_clean":"2024-04-23T19:03:44.113935+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:03:44.113935+0000","last_undegraded":"2024-04-23T19:03:44.113935+0000","last_fullsized":"2024-04-23T19:03:44.113935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'29","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114486+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:44.114486+0000","last_peered":"2024-04-23T19:03:44.114486+0000","last_clean":"2024-04-23T19:03:44.114486+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:44.114486+0000","last_undegraded":"2024-04-23T19:03:44.114486+0000","last_fullsized":"2024-04-23T19:03:44.114486+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:28.797026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388731+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:03:43.388731+0000","last_peered":"2024-04-23T19:03:43.388731+0000","last_clean":"2024-04-23T19:03:43.388731+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:03:43.388731+0000","last_undegraded":"2024-04-23T19:03:43.388731+0000","last_fullsized":"2024-04-23T19:03:43.388731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391467+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391467+0000","last_peered":"2024-04-23T19:03:43.391467+0000","last_clean":"2024-04-23T19:03:43.391467+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391467+0000","last_undegraded":"2024-04-23T19:03:43.391467+0000","last_fullsized":"2024-04-23T19:03:43.391467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114062+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:03:44.114062+0000","last_peered":"2024-04-23T19:03:44.114062+0000","last_clean":"2024-04-23T19:03:44.114062+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:03:44.114062+0000","last_undegraded":"2024-04-23T19:03:44.114062+0000","last_fullsized":"2024-04-23T19:03:44.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"97'30","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113127+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:03:44.113127+0000","last_peered":"2024-04-23T19:03:44.113127+0000","last_clean":"2024-04-23T19:03:44.113127+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:03:44.113127+0000","last_undegraded":"2024-04-23T19:03:44.113127+0000","last_fullsized":"2024-04-23T19:03:44.113127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709898+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:03:43.709898+0000","last_peered":"2024-04-23T19:03:43.709898+0000","last_clean":"2024-04-23T19:03:43.709898+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:03:43.709898+0000","last_undegraded":"2024-04-23T19:03:43.709898+0000","last_fullsized":"2024-04-23T19:03:43.709898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114003+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:03:44.114003+0000","last_peered":"2024-04-23T19:03:44.114003+0000","last_clean":"2024-04-23T19:03:44.114003+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:03:44.114003+0000","last_undegraded":"2024-04-23T19:03:44.114003+0000","last_fullsized":"2024-04-23T19:03:44.114003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114574+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:03:44.114574+0000","last_peered":"2024-04-23T19:03:44.114574+0000","last_clean":"2024-04-23T19:03:44.114574+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:03:44.114574+0000","last_undegraded":"2024-04-23T19:03:44.114574+0000","last_fullsized":"2024-04-23T19:03:44.114574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707993+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.707993+0000","last_peered":"2024-04-23T19:03:43.707993+0000","last_clean":"2024-04-23T19:03:43.707993+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.707993+0000","last_undegraded":"2024-04-23T19:03:43.707993+0000","last_fullsized":"2024-04-23T19:03:43.707993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392596+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:03:43.392596+0000","last_peered":"2024-04-23T19:03:43.392596+0000","last_clean":"2024-04-23T19:03:43.392596+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:03:43.392596+0000","last_undegraded":"2024-04-23T19:03:43.392596+0000","last_fullsized":"2024-04-23T19:03:43.392596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911521+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:43.911521+0000","last_peered":"2024-04-23T19:03:43.911521+0000","last_clean":"2024-04-23T19:03:43.911521+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:43.911521+0000","last_undegraded":"2024-04-23T19:03:43.911521+0000","last_fullsized":"2024-04-23T19:03:43.911521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.912128+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:03:43.912128+0000","last_peered":"2024-04-23T19:03:43.912128+0000","last_clean":"2024-04-23T19:03:43.912128+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:03:43.912128+0000","last_undegraded":"2024-04-23T19:03:43.912128+0000","last_fullsized":"2024-04-23T19:03:43.912128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393457+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:03:43.393457+0000","last_peered":"2024-04-23T19:03:43.393457+0000","last_clean":"2024-04-23T19:03:43.393457+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:03:43.393457+0000","last_undegraded":"2024-04-23T19:03:43.393457+0000","last_fullsized":"2024-04-23T19:03:43.393457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114358+0000","last_change":"2024-04-23T19:03:32.295881+0000","last_active":"2024-04-23T19:03:44.114358+0000","last_peered":"2024-04-23T19:03:44.114358+0000","last_clean":"2024-04-23T19:03:44.114358+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:03:44.114358+0000","last_undegraded":"2024-04-23T19:03:44.114358+0000","last_fullsized":"2024-04-23T19:03:44.114358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:09.028190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388000+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388000+0000","last_peered":"2024-04-23T19:03:43.388000+0000","last_clean":"2024-04-23T19:03:43.388000+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388000+0000","last_undegraded":"2024-04-23T19:03:43.388000+0000","last_fullsized":"2024-04-23T19:03:43.388000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394414+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:03:43.394414+0000","last_peered":"2024-04-23T19:03:43.394414+0000","last_clean":"2024-04-23T19:03:43.394414+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:03:43.394414+0000","last_undegraded":"2024-04-23T19:03:43.394414+0000","last_fullsized":"2024-04-23T19:03:43.394414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"97'20","reported_seq":147,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112321+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:44.112321+0000","last_peered":"2024-04-23T19:03:44.112321+0000","last_clean":"2024-04-23T19:03:44.112321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:44.112321+0000","last_undegraded":"2024-04-23T19:03:44.112321+0000","last_fullsized":"2024-04-23T19:03:44.112321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114840+0000","last_change":"2024-04-23T19:03:32.293970+0000","last_active":"2024-04-23T19:03:44.114840+0000","last_peered":"2024-04-23T19:03:44.114840+0000","last_clean":"2024-04-23T19:03:44.114840+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:03:44.114840+0000","last_undegraded":"2024-04-23T19:03:44.114840+0000","last_fullsized":"2024-04-23T19:03:44.114840+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:29.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910798+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:03:43.910798+0000","last_peered":"2024-04-23T19:03:43.910798+0000","last_clean":"2024-04-23T19:03:43.910798+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:03:43.910798+0000","last_undegraded":"2024-04-23T19:03:43.910798+0000","last_fullsized":"2024-04-23T19:03:43.910798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'135","reported_seq":389,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557527+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:03:44.557527+0000","last_peered":"2024-04-23T19:03:44.557527+0000","last_clean":"2024-04-23T19:03:44.557527+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:03:44.557527+0000","last_undegraded":"2024-04-23T19:03:44.557527+0000","last_fullsized":"2024-04-23T19:03:44.557527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112611+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112611+0000","last_peered":"2024-04-23T19:03:44.112611+0000","last_clean":"2024-04-23T19:03:44.112611+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112611+0000","last_undegraded":"2024-04-23T19:03:44.112611+0000","last_fullsized":"2024-04-23T19:03:44.112611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909534+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:03:43.909534+0000","last_peered":"2024-04-23T19:03:43.909534+0000","last_clean":"2024-04-23T19:03:43.909534+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:03:43.909534+0000","last_undegraded":"2024-04-23T19:03:43.909534+0000","last_fullsized":"2024-04-23T19:03:43.909534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389562+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:03:43.389562+0000","last_peered":"2024-04-23T19:03:43.389562+0000","last_clean":"2024-04-23T19:03:43.389562+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:03:43.389562+0000","last_undegraded":"2024-04-23T19:03:43.389562+0000","last_fullsized":"2024-04-23T19:03:43.389562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113265+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:03:44.113265+0000","last_peered":"2024-04-23T19:03:44.113265+0000","last_clean":"2024-04-23T19:03:44.113265+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:03:44.113265+0000","last_undegraded":"2024-04-23T19:03:44.113265+0000","last_fullsized":"2024-04-23T19:03:44.113265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'23","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388295+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:03:43.388295+0000","last_peered":"2024-04-23T19:03:43.388295+0000","last_clean":"2024-04-23T19:03:43.388295+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:03:43.388295+0000","last_undegraded":"2024-04-23T19:03:43.388295+0000","last_fullsized":"2024-04-23T19:03:43.388295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111946+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:03:44.111946+0000","last_peered":"2024-04-23T19:03:44.111946+0000","last_clean":"2024-04-23T19:03:44.111946+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:03:44.111946+0000","last_undegraded":"2024-04-23T19:03:44.111946+0000","last_fullsized":"2024-04-23T19:03:44.111946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115183+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115183+0000","last_peered":"2024-04-23T19:03:44.115183+0000","last_clean":"2024-04-23T19:03:44.115183+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115183+0000","last_undegraded":"2024-04-23T19:03:44.115183+0000","last_fullsized":"2024-04-23T19:03:44.115183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910717+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:03:43.910717+0000","last_peered":"2024-04-23T19:03:43.910717+0000","last_clean":"2024-04-23T19:03:43.910717+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:03:43.910717+0000","last_undegraded":"2024-04-23T19:03:43.910717+0000","last_fullsized":"2024-04-23T19:03:43.910717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"97'26","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393664+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:03:43.393664+0000","last_peered":"2024-04-23T19:03:43.393664+0000","last_clean":"2024-04-23T19:03:43.393664+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:03:43.393664+0000","last_undegraded":"2024-04-23T19:03:43.393664+0000","last_fullsized":"2024-04-23T19:03:43.393664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388902+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:03:43.388902+0000","last_peered":"2024-04-23T19:03:43.388902+0000","last_clean":"2024-04-23T19:03:43.388902+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:03:43.388902+0000","last_undegraded":"2024-04-23T19:03:43.388902+0000","last_fullsized":"2024-04-23T19:03:43.388902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111823+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:44.111823+0000","last_peered":"2024-04-23T19:03:44.111823+0000","last_clean":"2024-04-23T19:03:44.111823+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:44.111823+0000","last_undegraded":"2024-04-23T19:03:44.111823+0000","last_fullsized":"2024-04-23T19:03:44.111823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707890+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:03:43.707890+0000","last_peered":"2024-04-23T19:03:43.707890+0000","last_clean":"2024-04-23T19:03:43.707890+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:03:43.707890+0000","last_undegraded":"2024-04-23T19:03:43.707890+0000","last_fullsized":"2024-04-23T19:03:43.707890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392918+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392918+0000","last_peered":"2024-04-23T19:03:43.392918+0000","last_clean":"2024-04-23T19:03:43.392918+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392918+0000","last_undegraded":"2024-04-23T19:03:43.392918+0000","last_fullsized":"2024-04-23T19:03:43.392918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390352+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:03:43.390352+0000","last_peered":"2024-04-23T19:03:43.390352+0000","last_clean":"2024-04-23T19:03:43.390352+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:03:43.390352+0000","last_undegraded":"2024-04-23T19:03:43.390352+0000","last_fullsized":"2024-04-23T19:03:43.390352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393209+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:03:43.393209+0000","last_peered":"2024-04-23T19:03:43.393209+0000","last_clean":"2024-04-23T19:03:43.393209+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:03:43.393209+0000","last_undegraded":"2024-04-23T19:03:43.393209+0000","last_fullsized":"2024-04-23T19:03:43.393209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908804+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908804+0000","last_peered":"2024-04-23T19:03:43.908804+0000","last_clean":"2024-04-23T19:03:43.908804+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908804+0000","last_undegraded":"2024-04-23T19:03:43.908804+0000","last_fullsized":"2024-04-23T19:03:43.908804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392822+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:43.392822+0000","last_peered":"2024-04-23T19:03:43.392822+0000","last_clean":"2024-04-23T19:03:43.392822+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:43.392822+0000","last_undegraded":"2024-04-23T19:03:43.392822+0000","last_fullsized":"2024-04-23T19:03:43.392822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909207+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909207+0000","last_peered":"2024-04-23T19:03:43.909207+0000","last_clean":"2024-04-23T19:03:43.909207+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909207+0000","last_undegraded":"2024-04-23T19:03:43.909207+0000","last_fullsized":"2024-04-23T19:03:43.909207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114601+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114601+0000","last_peered":"2024-04-23T19:03:44.114601+0000","last_clean":"2024-04-23T19:03:44.114601+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114601+0000","last_undegraded":"2024-04-23T19:03:44.114601+0000","last_fullsized":"2024-04-23T19:03:44.114601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909065+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:03:43.909065+0000","last_peered":"2024-04-23T19:03:43.909065+0000","last_clean":"2024-04-23T19:03:43.909065+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:03:43.909065+0000","last_undegraded":"2024-04-23T19:03:43.909065+0000","last_fullsized":"2024-04-23T19:03:43.909065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"97'25","reported_seq":151,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114439+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:44.114439+0000","last_peered":"2024-04-23T19:03:44.114439+0000","last_clean":"2024-04-23T19:03:44.114439+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:44.114439+0000","last_undegraded":"2024-04-23T19:03:44.114439+0000","last_fullsized":"2024-04-23T19:03:44.114439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113085+0000","last_change":"2024-04-23T19:03:32.303428+0000","last_active":"2024-04-23T19:03:44.113085+0000","last_peered":"2024-04-23T19:03:44.113085+0000","last_clean":"2024-04-23T19:03:44.113085+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:03:44.113085+0000","last_undegraded":"2024-04-23T19:03:44.113085+0000","last_fullsized":"2024-04-23T19:03:44.113085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:39.837391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909644+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:03:43.909644+0000","last_peered":"2024-04-23T19:03:43.909644+0000","last_clean":"2024-04-23T19:03:43.909644+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:03:43.909644+0000","last_undegraded":"2024-04-23T19:03:43.909644+0000","last_fullsized":"2024-04-23T19:03:43.909644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113318+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:03:44.113318+0000","last_peered":"2024-04-23T19:03:44.113318+0000","last_clean":"2024-04-23T19:03:44.113318+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:03:44.113318+0000","last_undegraded":"2024-04-23T19:03:44.113318+0000","last_fullsized":"2024-04-23T19:03:44.113318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909653+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.909653+0000","last_peered":"2024-04-23T19:03:43.909653+0000","last_clean":"2024-04-23T19:03:43.909653+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.909653+0000","last_undegraded":"2024-04-23T19:03:43.909653+0000","last_fullsized":"2024-04-23T19:03:43.909653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115632+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115632+0000","last_peered":"2024-04-23T19:03:44.115632+0000","last_clean":"2024-04-23T19:03:44.115632+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115632+0000","last_undegraded":"2024-04-23T19:03:44.115632+0000","last_fullsized":"2024-04-23T19:03:44.115632+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:01.164433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"97'29","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707924+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:43.707924+0000","last_peered":"2024-04-23T19:03:43.707924+0000","last_clean":"2024-04-23T19:03:43.707924+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:43.707924+0000","last_undegraded":"2024-04-23T19:03:43.707924+0000","last_fullsized":"2024-04-23T19:03:43.707924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115428+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115428+0000","last_peered":"2024-04-23T19:03:44.115428+0000","last_clean":"2024-04-23T19:03:44.115428+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115428+0000","last_undegraded":"2024-04-23T19:03:44.115428+0000","last_fullsized":"2024-04-23T19:03:44.115428+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:38.798295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388809+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:03:43.388809+0000","last_peered":"2024-04-23T19:03:43.388809+0000","last_clean":"2024-04-23T19:03:43.388809+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:03:43.388809+0000","last_undegraded":"2024-04-23T19:03:43.388809+0000","last_fullsized":"2024-04-23T19:03:43.388809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389504+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:03:43.389504+0000","last_peered":"2024-04-23T19:03:43.389504+0000","last_clean":"2024-04-23T19:03:43.389504+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:03:43.389504+0000","last_undegraded":"2024-04-23T19:03:43.389504+0000","last_fullsized":"2024-04-23T19:03:43.389504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"97'17","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389148+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:43.389148+0000","last_peered":"2024-04-23T19:03:43.389148+0000","last_clean":"2024-04-23T19:03:43.389148+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:43.389148+0000","last_undegraded":"2024-04-23T19:03:43.389148+0000","last_fullsized":"2024-04-23T19:03:43.389148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114071+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:03:44.114071+0000","last_peered":"2024-04-23T19:03:44.114071+0000","last_clean":"2024-04-23T19:03:44.114071+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:03:44.114071+0000","last_undegraded":"2024-04-23T19:03:44.114071+0000","last_fullsized":"2024-04-23T19:03:44.114071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"97'21","reported_seq":150,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113268+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:44.113268+0000","last_peered":"2024-04-23T19:03:44.113268+0000","last_clean":"2024-04-23T19:03:44.113268+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:44.113268+0000","last_undegraded":"2024-04-23T19:03:44.113268+0000","last_fullsized":"2024-04-23T19:03:44.113268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392559+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392559+0000","last_peered":"2024-04-23T19:03:43.392559+0000","last_clean":"2024-04-23T19:03:43.392559+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392559+0000","last_undegraded":"2024-04-23T19:03:43.392559+0000","last_fullsized":"2024-04-23T19:03:43.392559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391726+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:43.391726+0000","last_peered":"2024-04-23T19:03:43.391726+0000","last_clean":"2024-04-23T19:03:43.391726+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:43.391726+0000","last_undegraded":"2024-04-23T19:03:43.391726+0000","last_fullsized":"2024-04-23T19:03:43.391726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911075+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:03:43.911075+0000","last_peered":"2024-04-23T19:03:43.911075+0000","last_clean":"2024-04-23T19:03:43.911075+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:03:43.911075+0000","last_undegraded":"2024-04-23T19:03:43.911075+0000","last_fullsized":"2024-04-23T19:03:43.911075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"97'34","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115162+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:44.115162+0000","last_peered":"2024-04-23T19:03:44.115162+0000","last_clean":"2024-04-23T19:03:44.115162+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:44.115162+0000","last_undegraded":"2024-04-23T19:03:44.115162+0000","last_fullsized":"2024-04-23T19:03:44.115162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:41.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389646+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:03:43.389646+0000","last_peered":"2024-04-23T19:03:43.389646+0000","last_clean":"2024-04-23T19:03:43.389646+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:03:43.389646+0000","last_undegraded":"2024-04-23T19:03:43.389646+0000","last_fullsized":"2024-04-23T19:03:43.389646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"97'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709559+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:03:43.709559+0000","last_peered":"2024-04-23T19:03:43.709559+0000","last_clean":"2024-04-23T19:03:43.709559+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:03:43.709559+0000","last_undegraded":"2024-04-23T19:03:43.709559+0000","last_fullsized":"2024-04-23T19:03:43.709559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707915+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:03:43.707915+0000","last_peered":"2024-04-23T19:03:43.707915+0000","last_clean":"2024-04-23T19:03:43.707915+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:03:43.707915+0000","last_undegraded":"2024-04-23T19:03:43.707915+0000","last_fullsized":"2024-04-23T19:03:43.707915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"96'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393204+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:43.393204+0000","last_peered":"2024-04-23T19:03:43.393204+0000","last_clean":"2024-04-23T19:03:43.393204+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:43.393204+0000","last_undegraded":"2024-04-23T19:03:43.393204+0000","last_fullsized":"2024-04-23T19:03:43.393204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114590+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:03:44.114590+0000","last_peered":"2024-04-23T19:03:44.114590+0000","last_clean":"2024-04-23T19:03:44.114590+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:03:44.114590+0000","last_undegraded":"2024-04-23T19:03:44.114590+0000","last_fullsized":"2024-04-23T19:03:44.114590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"97'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389442+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:43.389442+0000","last_peered":"2024-04-23T19:03:43.389442+0000","last_clean":"2024-04-23T19:03:43.389442+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:43.389442+0000","last_undegraded":"2024-04-23T19:03:43.389442+0000","last_fullsized":"2024-04-23T19:03:43.389442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":72,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911047+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911047+0000","last_peered":"2024-04-23T19:03:43.911047+0000","last_clean":"2024-04-23T19:03:43.911047+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911047+0000","last_undegraded":"2024-04-23T19:03:43.911047+0000","last_fullsized":"2024-04-23T19:03:43.911047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"97'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390537+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:43.390537+0000","last_peered":"2024-04-23T19:03:43.390537+0000","last_clean":"2024-04-23T19:03:43.390537+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:43.390537+0000","last_undegraded":"2024-04-23T19:03:43.390537+0000","last_fullsized":"2024-04-23T19:03:43.390537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394043+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:03:43.394043+0000","last_peered":"2024-04-23T19:03:43.394043+0000","last_clean":"2024-04-23T19:03:43.394043+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:03:43.394043+0000","last_undegraded":"2024-04-23T19:03:43.394043+0000","last_fullsized":"2024-04-23T19:03:43.394043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"97'31","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388801+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:03:43.388801+0000","last_peered":"2024-04-23T19:03:43.388801+0000","last_clean":"2024-04-23T19:03:43.388801+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:03:43.388801+0000","last_undegraded":"2024-04-23T19:03:43.388801+0000","last_fullsized":"2024-04-23T19:03:43.388801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911790+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:03:43.911790+0000","last_peered":"2024-04-23T19:03:43.911790+0000","last_clean":"2024-04-23T19:03:43.911790+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:03:43.911790+0000","last_undegraded":"2024-04-23T19:03:43.911790+0000","last_fullsized":"2024-04-23T19:03:43.911790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"97'21","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113663+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:44.113663+0000","last_peered":"2024-04-23T19:03:44.113663+0000","last_clean":"2024-04-23T19:03:44.113663+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:44.113663+0000","last_undegraded":"2024-04-23T19:03:44.113663+0000","last_fullsized":"2024-04-23T19:03:44.113663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113841+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113841+0000","last_peered":"2024-04-23T19:03:44.113841+0000","last_clean":"2024-04-23T19:03:44.113841+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113841+0000","last_undegraded":"2024-04-23T19:03:44.113841+0000","last_fullsized":"2024-04-23T19:03:44.113841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708932+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:03:43.708932+0000","last_peered":"2024-04-23T19:03:43.708932+0000","last_clean":"2024-04-23T19:03:43.708932+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:03:43.708932+0000","last_undegraded":"2024-04-23T19:03:43.708932+0000","last_fullsized":"2024-04-23T19:03:43.708932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112309+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:03:44.112309+0000","last_peered":"2024-04-23T19:03:44.112309+0000","last_clean":"2024-04-23T19:03:44.112309+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:03:44.112309+0000","last_undegraded":"2024-04-23T19:03:44.112309+0000","last_fullsized":"2024-04-23T19:03:44.112309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115562+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:03:44.115562+0000","last_peered":"2024-04-23T19:03:44.115562+0000","last_clean":"2024-04-23T19:03:44.115562+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:03:44.115562+0000","last_undegraded":"2024-04-23T19:03:44.115562+0000","last_fullsized":"2024-04-23T19:03:44.115562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389396+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:03:43.389396+0000","last_peered":"2024-04-23T19:03:43.389396+0000","last_clean":"2024-04-23T19:03:43.389396+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:03:43.389396+0000","last_undegraded":"2024-04-23T19:03:43.389396+0000","last_fullsized":"2024-04-23T19:03:43.389396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"97'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394522+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:03:43.394522+0000","last_peered":"2024-04-23T19:03:43.394522+0000","last_clean":"2024-04-23T19:03:43.394522+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:03:43.394522+0000","last_undegraded":"2024-04-23T19:03:43.394522+0000","last_fullsized":"2024-04-23T19:03:43.394522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113173+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:03:44.113173+0000","last_peered":"2024-04-23T19:03:44.113173+0000","last_clean":"2024-04-23T19:03:44.113173+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:03:44.113173+0000","last_undegraded":"2024-04-23T19:03:44.113173+0000","last_fullsized":"2024-04-23T19:03:44.113173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"97'28","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393916+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:03:43.393916+0000","last_peered":"2024-04-23T19:03:43.393916+0000","last_clean":"2024-04-23T19:03:43.393916+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:03:43.393916+0000","last_undegraded":"2024-04-23T19:03:43.393916+0000","last_fullsized":"2024-04-23T19:03:43.393916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388784+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:43.388784+0000","last_peered":"2024-04-23T19:03:43.388784+0000","last_clean":"2024-04-23T19:03:43.388784+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:43.388784+0000","last_undegraded":"2024-04-23T19:03:43.388784+0000","last_fullsized":"2024-04-23T19:03:43.388784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114539+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:03:44.114539+0000","last_peered":"2024-04-23T19:03:44.114539+0000","last_clean":"2024-04-23T19:03:44.114539+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:03:44.114539+0000","last_undegraded":"2024-04-23T19:03:44.114539+0000","last_fullsized":"2024-04-23T19:03:44.114539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"97'28","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112893+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:44.112893+0000","last_peered":"2024-04-23T19:03:44.112893+0000","last_clean":"2024-04-23T19:03:44.112893+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:44.112893+0000","last_undegraded":"2024-04-23T19:03:44.112893+0000","last_fullsized":"2024-04-23T19:03:44.112893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:40.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390065+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:03:43.390065+0000","last_peered":"2024-04-23T19:03:43.390065+0000","last_clean":"2024-04-23T19:03:43.390065+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:03:43.390065+0000","last_undegraded":"2024-04-23T19:03:43.390065+0000","last_fullsized":"2024-04-23T19:03:43.390065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1080,"ondisk_log_size":1080,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386917,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":610,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1804696,"kb_used_data":1773520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92567144,"statfs":{"total":96636764160,"available":94788755456,"internally_reserved":0,"allocated":1816084480,"data_stored":1815444539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1197876,"kb_used_data":1166700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93173964,"statfs":{"total":96636764160,"available":95410139136,"internally_reserved":0,"allocated":1194700800,"data_stored":1194095951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693888,"kb_used_data":1658552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677952,"statfs":{"total":96636764160,"available":94902222848,"internally_reserved":0,"allocated":1698357248,"data_stored":1697703170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898284,"kb_used_data":1867096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473556,"statfs":{"total":96636764160,"available":94692921344,"internally_reserved":0,"allocated":1911906304,"data_stored":1911319884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1998844,"kb_used_data":1967668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92372996,"statfs":{"total":96636764160,"available":94589947904,"internally_reserved":0,"allocated":2014892032,"data_stored":2014257594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072988,"kb_used_data":1041812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93298852,"statfs":{"total":96636764160,"available":95538024448,"internally_reserved":0,"allocated":1066815488,"data_stored":1066225345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105972,"kb_used_data":1070636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93265868,"statfs":{"total":96636764160,"available":95504248832,"internally_reserved":0,"allocated":1096331264,"data_stored":1095704135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806796,"kb_used_data":1771448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92565044,"statfs":{"total":96636764160,"available":94786605056,"internally_reserved":0,"allocated":1813962752,"data_stored":1813346224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1811939328,"data_stored":1811939328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1094713344,"data_stored":1094713344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1065353216,"data_stored":1065353216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2013265920,"data_stored":2013265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1193279488,"data_stored":1193279488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814036480,"data_stored":1814036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":175817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":177182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":292907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:03:57.141 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T19:03:57.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:03:57.509 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:57.515 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:03:57.527 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-23T19:03:56.006641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300823909,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3286,"num_read_kb":2969,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3900,"ondisk_log_size":3900,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12579344,"kb_used_data":12317432,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":742395376,"statfs":{"total":773094113280,"available":760212865024,"internally_reserved":0,"allocated":12613050368,"data_stored":12608096842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.041558"},"pg_stats":[{"pgid":"3.3f","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114847+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:03:44.114847+0000","last_peered":"2024-04-23T19:03:44.114847+0000","last_clean":"2024-04-23T19:03:44.114847+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:03:44.114847+0000","last_undegraded":"2024-04-23T19:03:44.114847+0000","last_fullsized":"2024-04-23T19:03:44.114847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387932+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:03:43.387932+0000","last_peered":"2024-04-23T19:03:43.387932+0000","last_clean":"2024-04-23T19:03:43.387932+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:03:43.387932+0000","last_undegraded":"2024-04-23T19:03:43.387932+0000","last_fullsized":"2024-04-23T19:03:43.387932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"97'24","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115512+0000","last_change":"2024-04-23T19:03:32.293577+0000","last_active":"2024-04-23T19:03:44.115512+0000","last_peered":"2024-04-23T19:03:44.115512+0000","last_clean":"2024-04-23T19:03:44.115512+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:03:44.115512+0000","last_undegraded":"2024-04-23T19:03:44.115512+0000","last_fullsized":"2024-04-23T19:03:44.115512+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:33.579201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113300+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:03:44.113300+0000","last_peered":"2024-04-23T19:03:44.113300+0000","last_clean":"2024-04-23T19:03:44.113300+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:03:44.113300+0000","last_undegraded":"2024-04-23T19:03:44.113300+0000","last_fullsized":"2024-04-23T19:03:44.113300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'29","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114019+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:44.114019+0000","last_peered":"2024-04-23T19:03:44.114019+0000","last_clean":"2024-04-23T19:03:44.114019+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:44.114019+0000","last_undegraded":"2024-04-23T19:03:44.114019+0000","last_fullsized":"2024-04-23T19:03:44.114019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910402+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:03:43.910402+0000","last_peered":"2024-04-23T19:03:43.910402+0000","last_clean":"2024-04-23T19:03:43.910402+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:03:43.910402+0000","last_undegraded":"2024-04-23T19:03:43.910402+0000","last_fullsized":"2024-04-23T19:03:43.910402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:46.363004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389189+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:03:43.389189+0000","last_peered":"2024-04-23T19:03:43.389189+0000","last_clean":"2024-04-23T19:03:43.389189+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:03:43.389189+0000","last_undegraded":"2024-04-23T19:03:43.389189+0000","last_fullsized":"2024-04-23T19:03:43.389189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113499+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113499+0000","last_peered":"2024-04-23T19:03:44.113499+0000","last_clean":"2024-04-23T19:03:44.113499+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113499+0000","last_undegraded":"2024-04-23T19:03:44.113499+0000","last_fullsized":"2024-04-23T19:03:44.113499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114187+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:44.114187+0000","last_peered":"2024-04-23T19:03:44.114187+0000","last_clean":"2024-04-23T19:03:44.114187+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:44.114187+0000","last_undegraded":"2024-04-23T19:03:44.114187+0000","last_fullsized":"2024-04-23T19:03:44.114187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708709+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:03:43.708709+0000","last_peered":"2024-04-23T19:03:43.708709+0000","last_clean":"2024-04-23T19:03:43.708709+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:03:43.708709+0000","last_undegraded":"2024-04-23T19:03:43.708709+0000","last_fullsized":"2024-04-23T19:03:43.708709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"97'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388451+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:03:43.388451+0000","last_peered":"2024-04-23T19:03:43.388451+0000","last_clean":"2024-04-23T19:03:43.388451+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:03:43.388451+0000","last_undegraded":"2024-04-23T19:03:43.388451+0000","last_fullsized":"2024-04-23T19:03:43.388451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910574+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:03:43.910574+0000","last_peered":"2024-04-23T19:03:43.910574+0000","last_clean":"2024-04-23T19:03:43.910574+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:03:43.910574+0000","last_undegraded":"2024-04-23T19:03:43.910574+0000","last_fullsized":"2024-04-23T19:03:43.910574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"97'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113605+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:44.113605+0000","last_peered":"2024-04-23T19:03:44.113605+0000","last_clean":"2024-04-23T19:03:44.113605+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:44.113605+0000","last_undegraded":"2024-04-23T19:03:44.113605+0000","last_fullsized":"2024-04-23T19:03:44.113605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389716+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:03:43.389716+0000","last_peered":"2024-04-23T19:03:43.389716+0000","last_clean":"2024-04-23T19:03:43.389716+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:03:43.389716+0000","last_undegraded":"2024-04-23T19:03:43.389716+0000","last_fullsized":"2024-04-23T19:03:43.389716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391449+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:43.391449+0000","last_peered":"2024-04-23T19:03:43.391449+0000","last_clean":"2024-04-23T19:03:43.391449+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:43.391449+0000","last_undegraded":"2024-04-23T19:03:43.391449+0000","last_fullsized":"2024-04-23T19:03:43.391449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394333+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:03:43.394333+0000","last_peered":"2024-04-23T19:03:43.394333+0000","last_clean":"2024-04-23T19:03:43.394333+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:03:43.394333+0000","last_undegraded":"2024-04-23T19:03:43.394333+0000","last_fullsized":"2024-04-23T19:03:43.394333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:54.741739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909061+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909061+0000","last_peered":"2024-04-23T19:03:43.909061+0000","last_clean":"2024-04-23T19:03:43.909061+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909061+0000","last_undegraded":"2024-04-23T19:03:43.909061+0000","last_fullsized":"2024-04-23T19:03:43.909061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"96'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114901+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:03:44.114901+0000","last_peered":"2024-04-23T19:03:44.114901+0000","last_clean":"2024-04-23T19:03:44.114901+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:03:44.114901+0000","last_undegraded":"2024-04-23T19:03:44.114901+0000","last_fullsized":"2024-04-23T19:03:44.114901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113766+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:03:44.113766+0000","last_peered":"2024-04-23T19:03:44.113766+0000","last_clean":"2024-04-23T19:03:44.113766+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:03:44.113766+0000","last_undegraded":"2024-04-23T19:03:44.113766+0000","last_fullsized":"2024-04-23T19:03:44.113766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709366+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:03:43.709366+0000","last_peered":"2024-04-23T19:03:43.709366+0000","last_clean":"2024-04-23T19:03:43.709366+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:03:43.709366+0000","last_undegraded":"2024-04-23T19:03:43.709366+0000","last_fullsized":"2024-04-23T19:03:43.709366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388767+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:03:43.388767+0000","last_peered":"2024-04-23T19:03:43.388767+0000","last_clean":"2024-04-23T19:03:43.388767+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:03:43.388767+0000","last_undegraded":"2024-04-23T19:03:43.388767+0000","last_fullsized":"2024-04-23T19:03:43.388767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709535+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:03:43.709535+0000","last_peered":"2024-04-23T19:03:43.709535+0000","last_clean":"2024-04-23T19:03:43.709535+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:03:43.709535+0000","last_undegraded":"2024-04-23T19:03:43.709535+0000","last_fullsized":"2024-04-23T19:03:43.709535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394020+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:03:43.394020+0000","last_peered":"2024-04-23T19:03:43.394020+0000","last_clean":"2024-04-23T19:03:43.394020+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:03:43.394020+0000","last_undegraded":"2024-04-23T19:03:43.394020+0000","last_fullsized":"2024-04-23T19:03:43.394020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:04.794115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"97'16","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910749+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:43.910749+0000","last_peered":"2024-04-23T19:03:43.910749+0000","last_clean":"2024-04-23T19:03:43.910749+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:43.910749+0000","last_undegraded":"2024-04-23T19:03:43.910749+0000","last_fullsized":"2024-04-23T19:03:43.910749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:03.218743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393743+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:03:43.393743+0000","last_peered":"2024-04-23T19:03:43.393743+0000","last_clean":"2024-04-23T19:03:43.393743+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:03:43.393743+0000","last_undegraded":"2024-04-23T19:03:43.393743+0000","last_fullsized":"2024-04-23T19:03:43.393743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:00.835533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"97'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392095+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:43.392095+0000","last_peered":"2024-04-23T19:03:43.392095+0000","last_clean":"2024-04-23T19:03:43.392095+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:43.392095+0000","last_undegraded":"2024-04-23T19:03:43.392095+0000","last_fullsized":"2024-04-23T19:03:43.392095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910786+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:03:43.910786+0000","last_peered":"2024-04-23T19:03:43.910786+0000","last_clean":"2024-04-23T19:03:43.910786+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:03:43.910786+0000","last_undegraded":"2024-04-23T19:03:43.910786+0000","last_fullsized":"2024-04-23T19:03:43.910786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"97'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112591+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:44.112591+0000","last_peered":"2024-04-23T19:03:44.112591+0000","last_clean":"2024-04-23T19:03:44.112591+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:44.112591+0000","last_undegraded":"2024-04-23T19:03:44.112591+0000","last_fullsized":"2024-04-23T19:03:44.112591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908784+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908784+0000","last_peered":"2024-04-23T19:03:43.908784+0000","last_clean":"2024-04-23T19:03:43.908784+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908784+0000","last_undegraded":"2024-04-23T19:03:43.908784+0000","last_fullsized":"2024-04-23T19:03:43.908784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391510+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:03:43.391510+0000","last_peered":"2024-04-23T19:03:43.391510+0000","last_clean":"2024-04-23T19:03:43.391510+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:03:43.391510+0000","last_undegraded":"2024-04-23T19:03:43.391510+0000","last_fullsized":"2024-04-23T19:03:43.391510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'24","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393870+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:03:43.393870+0000","last_peered":"2024-04-23T19:03:43.393870+0000","last_clean":"2024-04-23T19:03:43.393870+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:03:43.393870+0000","last_undegraded":"2024-04-23T19:03:43.393870+0000","last_fullsized":"2024-04-23T19:03:43.393870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:38.238503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389567+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:03:43.389567+0000","last_peered":"2024-04-23T19:03:43.389567+0000","last_clean":"2024-04-23T19:03:43.389567+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:03:43.389567+0000","last_undegraded":"2024-04-23T19:03:43.389567+0000","last_fullsized":"2024-04-23T19:03:43.389567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'19","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113502+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:44.113502+0000","last_peered":"2024-04-23T19:03:44.113502+0000","last_clean":"2024-04-23T19:03:44.113502+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:44.113502+0000","last_undegraded":"2024-04-23T19:03:44.113502+0000","last_fullsized":"2024-04-23T19:03:44.113502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:08.296647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114445+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114445+0000","last_peered":"2024-04-23T19:03:44.114445+0000","last_clean":"2024-04-23T19:03:44.114445+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114445+0000","last_undegraded":"2024-04-23T19:03:44.114445+0000","last_fullsized":"2024-04-23T19:03:44.114445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387854+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.387854+0000","last_peered":"2024-04-23T19:03:43.387854+0000","last_clean":"2024-04-23T19:03:43.387854+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.387854+0000","last_undegraded":"2024-04-23T19:03:43.387854+0000","last_fullsized":"2024-04-23T19:03:43.387854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390204+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:03:43.390204+0000","last_peered":"2024-04-23T19:03:43.390204+0000","last_clean":"2024-04-23T19:03:43.390204+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:03:43.390204+0000","last_undegraded":"2024-04-23T19:03:43.390204+0000","last_fullsized":"2024-04-23T19:03:43.390204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"97'31","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112702+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:44.112702+0000","last_peered":"2024-04-23T19:03:44.112702+0000","last_clean":"2024-04-23T19:03:44.112702+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:44.112702+0000","last_undegraded":"2024-04-23T19:03:44.112702+0000","last_fullsized":"2024-04-23T19:03:44.112702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391268+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391268+0000","last_peered":"2024-04-23T19:03:43.391268+0000","last_clean":"2024-04-23T19:03:43.391268+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391268+0000","last_undegraded":"2024-04-23T19:03:43.391268+0000","last_fullsized":"2024-04-23T19:03:43.391268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911442+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:03:43.911442+0000","last_peered":"2024-04-23T19:03:43.911442+0000","last_clean":"2024-04-23T19:03:43.911442+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:03:43.911442+0000","last_undegraded":"2024-04-23T19:03:43.911442+0000","last_fullsized":"2024-04-23T19:03:43.911442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910291+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910291+0000","last_peered":"2024-04-23T19:03:43.910291+0000","last_clean":"2024-04-23T19:03:43.910291+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910291+0000","last_undegraded":"2024-04-23T19:03:43.910291+0000","last_fullsized":"2024-04-23T19:03:43.910291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112392+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:03:44.112392+0000","last_peered":"2024-04-23T19:03:44.112392+0000","last_clean":"2024-04-23T19:03:44.112392+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:03:44.112392+0000","last_undegraded":"2024-04-23T19:03:44.112392+0000","last_fullsized":"2024-04-23T19:03:44.112392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114249+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:03:44.114249+0000","last_peered":"2024-04-23T19:03:44.114249+0000","last_clean":"2024-04-23T19:03:44.114249+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:03:44.114249+0000","last_undegraded":"2024-04-23T19:03:44.114249+0000","last_fullsized":"2024-04-23T19:03:44.114249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113863+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:44.113863+0000","last_peered":"2024-04-23T19:03:44.113863+0000","last_clean":"2024-04-23T19:03:44.113863+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:44.113863+0000","last_undegraded":"2024-04-23T19:03:44.113863+0000","last_fullsized":"2024-04-23T19:03:44.113863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393525+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:03:43.393525+0000","last_peered":"2024-04-23T19:03:43.393525+0000","last_clean":"2024-04-23T19:03:43.393525+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:03:43.393525+0000","last_undegraded":"2024-04-23T19:03:43.393525+0000","last_fullsized":"2024-04-23T19:03:43.393525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393562+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:03:43.393562+0000","last_peered":"2024-04-23T19:03:43.393562+0000","last_clean":"2024-04-23T19:03:43.393562+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:03:43.393562+0000","last_undegraded":"2024-04-23T19:03:43.393562+0000","last_fullsized":"2024-04-23T19:03:43.393562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:11.163990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'135","reported_seq":359,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558126+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:44.558126+0000","last_peered":"2024-04-23T19:03:44.558126+0000","last_clean":"2024-04-23T19:03:44.558126+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:44.558126+0000","last_undegraded":"2024-04-23T19:03:44.558126+0000","last_fullsized":"2024-04-23T19:03:44.558126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909665+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909665+0000","last_peered":"2024-04-23T19:03:43.909665+0000","last_clean":"2024-04-23T19:03:43.909665+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909665+0000","last_undegraded":"2024-04-23T19:03:43.909665+0000","last_fullsized":"2024-04-23T19:03:43.909665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:43.537167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393124+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:03:43.393124+0000","last_peered":"2024-04-23T19:03:43.393124+0000","last_clean":"2024-04-23T19:03:43.393124+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:03:43.393124+0000","last_undegraded":"2024-04-23T19:03:43.393124+0000","last_fullsized":"2024-04-23T19:03:43.393124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"97'24","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708227+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:03:43.708227+0000","last_peered":"2024-04-23T19:03:43.708227+0000","last_clean":"2024-04-23T19:03:43.708227+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:03:43.708227+0000","last_undegraded":"2024-04-23T19:03:43.708227+0000","last_fullsized":"2024-04-23T19:03:43.708227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389457+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:03:43.389457+0000","last_peered":"2024-04-23T19:03:43.389457+0000","last_clean":"2024-04-23T19:03:43.389457+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:03:43.389457+0000","last_undegraded":"2024-04-23T19:03:43.389457+0000","last_fullsized":"2024-04-23T19:03:43.389457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114533+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:03:44.114533+0000","last_peered":"2024-04-23T19:03:44.114533+0000","last_clean":"2024-04-23T19:03:44.114533+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:03:44.114533+0000","last_undegraded":"2024-04-23T19:03:44.114533+0000","last_fullsized":"2024-04-23T19:03:44.114533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557946+0000","last_change":"2024-04-23T19:00:23.340688+0000","last_active":"2024-04-23T19:03:44.557946+0000","last_peered":"2024-04-23T19:03:44.557946+0000","last_clean":"2024-04-23T19:03:44.557946+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:03:44.557946+0000","last_undegraded":"2024-04-23T19:03:44.557946+0000","last_fullsized":"2024-04-23T19:03:44.557946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:10.802904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388486+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:03:43.388486+0000","last_peered":"2024-04-23T19:03:43.388486+0000","last_clean":"2024-04-23T19:03:43.388486+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:03:43.388486+0000","last_undegraded":"2024-04-23T19:03:43.388486+0000","last_fullsized":"2024-04-23T19:03:43.388486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"97'29","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115034+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:03:44.115034+0000","last_peered":"2024-04-23T19:03:44.115034+0000","last_clean":"2024-04-23T19:03:44.115034+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:03:44.115034+0000","last_undegraded":"2024-04-23T19:03:44.115034+0000","last_fullsized":"2024-04-23T19:03:44.115034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":281,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112930+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:03:44.112930+0000","last_peered":"2024-04-23T19:03:44.112930+0000","last_clean":"2024-04-23T19:03:44.112930+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:03:44.112930+0000","last_undegraded":"2024-04-23T19:03:44.112930+0000","last_fullsized":"2024-04-23T19:03:44.112930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388052+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:03:43.388052+0000","last_peered":"2024-04-23T19:03:43.388052+0000","last_clean":"2024-04-23T19:03:43.388052+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:03:43.388052+0000","last_undegraded":"2024-04-23T19:03:43.388052+0000","last_fullsized":"2024-04-23T19:03:43.388052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113425+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:03:44.113425+0000","last_peered":"2024-04-23T19:03:44.113425+0000","last_clean":"2024-04-23T19:03:44.113425+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:03:44.113425+0000","last_undegraded":"2024-04-23T19:03:44.113425+0000","last_fullsized":"2024-04-23T19:03:44.113425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:23.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388724+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388724+0000","last_peered":"2024-04-23T19:03:43.388724+0000","last_clean":"2024-04-23T19:03:43.388724+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388724+0000","last_undegraded":"2024-04-23T19:03:43.388724+0000","last_fullsized":"2024-04-23T19:03:43.388724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:57.851992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909389+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909389+0000","last_peered":"2024-04-23T19:03:43.909389+0000","last_clean":"2024-04-23T19:03:43.909389+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909389+0000","last_undegraded":"2024-04-23T19:03:43.909389+0000","last_fullsized":"2024-04-23T19:03:43.909389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:14.238509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'31","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115277+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:44.115277+0000","last_peered":"2024-04-23T19:03:44.115277+0000","last_clean":"2024-04-23T19:03:44.115277+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:44.115277+0000","last_undegraded":"2024-04-23T19:03:44.115277+0000","last_fullsized":"2024-04-23T19:03:44.115277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388320+0000","last_change":"2024-04-23T19:00:19.302370+0000","last_active":"2024-04-23T19:03:43.388320+0000","last_peered":"2024-04-23T19:03:43.388320+0000","last_clean":"2024-04-23T19:03:43.388320+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:03:43.388320+0000","last_undegraded":"2024-04-23T19:03:43.388320+0000","last_fullsized":"2024-04-23T19:03:43.388320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:12.531802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392626+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:03:43.392626+0000","last_peered":"2024-04-23T19:03:43.392626+0000","last_clean":"2024-04-23T19:03:43.392626+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:03:43.392626+0000","last_undegraded":"2024-04-23T19:03:43.392626+0000","last_fullsized":"2024-04-23T19:03:43.392626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390803+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:03:43.390803+0000","last_peered":"2024-04-23T19:03:43.390803+0000","last_clean":"2024-04-23T19:03:43.390803+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:03:43.390803+0000","last_undegraded":"2024-04-23T19:03:43.390803+0000","last_fullsized":"2024-04-23T19:03:43.390803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:38.745639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708652+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708652+0000","last_peered":"2024-04-23T19:03:43.708652+0000","last_clean":"2024-04-23T19:03:43.708652+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708652+0000","last_undegraded":"2024-04-23T19:03:43.708652+0000","last_fullsized":"2024-04-23T19:03:43.708652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708882+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:03:43.708882+0000","last_peered":"2024-04-23T19:03:43.708882+0000","last_clean":"2024-04-23T19:03:43.708882+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:03:43.708882+0000","last_undegraded":"2024-04-23T19:03:43.708882+0000","last_fullsized":"2024-04-23T19:03:43.708882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"97'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115464+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:03:44.115464+0000","last_peered":"2024-04-23T19:03:44.115464+0000","last_clean":"2024-04-23T19:03:44.115464+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:03:44.115464+0000","last_undegraded":"2024-04-23T19:03:44.115464+0000","last_fullsized":"2024-04-23T19:03:44.115464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394271+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:03:43.394271+0000","last_peered":"2024-04-23T19:03:43.394271+0000","last_clean":"2024-04-23T19:03:43.394271+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:03:43.394271+0000","last_undegraded":"2024-04-23T19:03:43.394271+0000","last_fullsized":"2024-04-23T19:03:43.394271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:35.253180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'23","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113515+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:03:44.113515+0000","last_peered":"2024-04-23T19:03:44.113515+0000","last_clean":"2024-04-23T19:03:44.113515+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:03:44.113515+0000","last_undegraded":"2024-04-23T19:03:44.113515+0000","last_fullsized":"2024-04-23T19:03:44.113515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557648+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:03:44.557648+0000","last_peered":"2024-04-23T19:03:44.557648+0000","last_clean":"2024-04-23T19:03:44.557648+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:03:44.557648+0000","last_undegraded":"2024-04-23T19:03:44.557648+0000","last_fullsized":"2024-04-23T19:03:44.557648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113763+0000","last_change":"2024-04-23T19:00:25.323706+0000","last_active":"2024-04-23T19:03:44.113763+0000","last_peered":"2024-04-23T19:03:44.113763+0000","last_clean":"2024-04-23T19:03:44.113763+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:44.113763+0000","last_undegraded":"2024-04-23T19:03:44.113763+0000","last_fullsized":"2024-04-23T19:03:44.113763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:33.965599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113964+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.113964+0000","last_peered":"2024-04-23T19:03:44.113964+0000","last_clean":"2024-04-23T19:03:44.113964+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.113964+0000","last_undegraded":"2024-04-23T19:03:44.113964+0000","last_fullsized":"2024-04-23T19:03:44.113964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389851+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:43.389851+0000","last_peered":"2024-04-23T19:03:43.389851+0000","last_clean":"2024-04-23T19:03:43.389851+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:43.389851+0000","last_undegraded":"2024-04-23T19:03:43.389851+0000","last_fullsized":"2024-04-23T19:03:43.389851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393360+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:03:43.393360+0000","last_peered":"2024-04-23T19:03:43.393360+0000","last_clean":"2024-04-23T19:03:43.393360+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:03:43.393360+0000","last_undegraded":"2024-04-23T19:03:43.393360+0000","last_fullsized":"2024-04-23T19:03:43.393360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:09.250080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'30","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112891+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:03:44.112891+0000","last_peered":"2024-04-23T19:03:44.112891+0000","last_clean":"2024-04-23T19:03:44.112891+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:03:44.112891+0000","last_undegraded":"2024-04-23T19:03:44.112891+0000","last_fullsized":"2024-04-23T19:03:44.112891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:21.259443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389128+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:03:43.389128+0000","last_peered":"2024-04-23T19:03:43.389128+0000","last_clean":"2024-04-23T19:03:43.389128+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:03:43.389128+0000","last_undegraded":"2024-04-23T19:03:43.389128+0000","last_fullsized":"2024-04-23T19:03:43.389128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:07.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'8","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115520+0000","last_change":"2024-04-23T19:03:32.295412+0000","last_active":"2024-04-23T19:03:44.115520+0000","last_peered":"2024-04-23T19:03:44.115520+0000","last_clean":"2024-04-23T19:03:44.115520+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:03:44.115520+0000","last_undegraded":"2024-04-23T19:03:44.115520+0000","last_fullsized":"2024-04-23T19:03:44.115520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:38.660742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911690+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:03:43.911690+0000","last_peered":"2024-04-23T19:03:43.911690+0000","last_clean":"2024-04-23T19:03:43.911690+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:03:43.911690+0000","last_undegraded":"2024-04-23T19:03:43.911690+0000","last_fullsized":"2024-04-23T19:03:43.911690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391669+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:43.391669+0000","last_peered":"2024-04-23T19:03:43.391669+0000","last_clean":"2024-04-23T19:03:43.391669+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:43.391669+0000","last_undegraded":"2024-04-23T19:03:43.391669+0000","last_fullsized":"2024-04-23T19:03:43.391669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393878+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:03:43.393878+0000","last_peered":"2024-04-23T19:03:43.393878+0000","last_clean":"2024-04-23T19:03:43.393878+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:03:43.393878+0000","last_undegraded":"2024-04-23T19:03:43.393878+0000","last_fullsized":"2024-04-23T19:03:43.393878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:06.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910655+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:03:43.910655+0000","last_peered":"2024-04-23T19:03:43.910655+0000","last_clean":"2024-04-23T19:03:43.910655+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:03:43.910655+0000","last_undegraded":"2024-04-23T19:03:43.910655+0000","last_fullsized":"2024-04-23T19:03:43.910655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114514+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114514+0000","last_peered":"2024-04-23T19:03:44.114514+0000","last_clean":"2024-04-23T19:03:44.114514+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114514+0000","last_undegraded":"2024-04-23T19:03:44.114514+0000","last_fullsized":"2024-04-23T19:03:44.114514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:17.516953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388173+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388173+0000","last_peered":"2024-04-23T19:03:43.388173+0000","last_clean":"2024-04-23T19:03:43.388173+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388173+0000","last_undegraded":"2024-04-23T19:03:43.388173+0000","last_fullsized":"2024-04-23T19:03:43.388173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911045+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:03:43.911045+0000","last_peered":"2024-04-23T19:03:43.911045+0000","last_clean":"2024-04-23T19:03:43.911045+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:03:43.911045+0000","last_undegraded":"2024-04-23T19:03:43.911045+0000","last_fullsized":"2024-04-23T19:03:43.911045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709068+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:03:43.709068+0000","last_peered":"2024-04-23T19:03:43.709068+0000","last_clean":"2024-04-23T19:03:43.709068+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:03:43.709068+0000","last_undegraded":"2024-04-23T19:03:43.709068+0000","last_fullsized":"2024-04-23T19:03:43.709068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113707+0000","last_change":"2024-04-23T19:03:32.296246+0000","last_active":"2024-04-23T19:03:44.113707+0000","last_peered":"2024-04-23T19:03:44.113707+0000","last_clean":"2024-04-23T19:03:44.113707+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:03:44.113707+0000","last_undegraded":"2024-04-23T19:03:44.113707+0000","last_fullsized":"2024-04-23T19:03:44.113707+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:48.818498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394174+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:03:43.394174+0000","last_peered":"2024-04-23T19:03:43.394174+0000","last_clean":"2024-04-23T19:03:43.394174+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:03:43.394174+0000","last_undegraded":"2024-04-23T19:03:43.394174+0000","last_fullsized":"2024-04-23T19:03:43.394174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:50.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'135","reported_seq":376,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558589+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:03:44.558589+0000","last_peered":"2024-04-23T19:03:44.558589+0000","last_clean":"2024-04-23T19:03:44.558589+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:03:44.558589+0000","last_undegraded":"2024-04-23T19:03:44.558589+0000","last_fullsized":"2024-04-23T19:03:44.558589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:30.172733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":154,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112679+0000","last_change":"2024-04-23T19:03:32.290672+0000","last_active":"2024-04-23T19:03:44.112679+0000","last_peered":"2024-04-23T19:03:44.112679+0000","last_clean":"2024-04-23T19:03:44.112679+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:03:44.112679+0000","last_undegraded":"2024-04-23T19:03:44.112679+0000","last_fullsized":"2024-04-23T19:03:44.112679+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:19.410020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911686+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:03:43.911686+0000","last_peered":"2024-04-23T19:03:43.911686+0000","last_clean":"2024-04-23T19:03:43.911686+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:03:43.911686+0000","last_undegraded":"2024-04-23T19:03:43.911686+0000","last_fullsized":"2024-04-23T19:03:43.911686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"97'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910029+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:43.910029+0000","last_peered":"2024-04-23T19:03:43.910029+0000","last_clean":"2024-04-23T19:03:43.910029+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:43.910029+0000","last_undegraded":"2024-04-23T19:03:43.910029+0000","last_fullsized":"2024-04-23T19:03:43.910029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:12.542294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390002+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:03:43.390002+0000","last_peered":"2024-04-23T19:03:43.390002+0000","last_clean":"2024-04-23T19:03:43.390002+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:03:43.390002+0000","last_undegraded":"2024-04-23T19:03:43.390002+0000","last_fullsized":"2024-04-23T19:03:43.390002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:19.251928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"98'12","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390965+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:03:43.390965+0000","last_peered":"2024-04-23T19:03:43.390965+0000","last_clean":"2024-04-23T19:03:43.390965+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:03:43.390965+0000","last_undegraded":"2024-04-23T19:03:43.390965+0000","last_fullsized":"2024-04-23T19:03:43.390965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:10.505485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'135","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557251+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:03:44.557251+0000","last_peered":"2024-04-23T19:03:44.557251+0000","last_clean":"2024-04-23T19:03:44.557251+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:03:44.557251+0000","last_undegraded":"2024-04-23T19:03:44.557251+0000","last_fullsized":"2024-04-23T19:03:44.557251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910131+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910131+0000","last_peered":"2024-04-23T19:03:43.910131+0000","last_clean":"2024-04-23T19:03:43.910131+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910131+0000","last_undegraded":"2024-04-23T19:03:43.910131+0000","last_fullsized":"2024-04-23T19:03:43.910131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115660+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:03:44.115660+0000","last_peered":"2024-04-23T19:03:44.115660+0000","last_clean":"2024-04-23T19:03:44.115660+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:03:44.115660+0000","last_undegraded":"2024-04-23T19:03:44.115660+0000","last_fullsized":"2024-04-23T19:03:44.115660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"96'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391592+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:43.391592+0000","last_peered":"2024-04-23T19:03:43.391592+0000","last_clean":"2024-04-23T19:03:43.391592+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:43.391592+0000","last_undegraded":"2024-04-23T19:03:43.391592+0000","last_fullsized":"2024-04-23T19:03:43.391592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910950+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:03:43.910950+0000","last_peered":"2024-04-23T19:03:43.910950+0000","last_clean":"2024-04-23T19:03:43.910950+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:03:43.910950+0000","last_undegraded":"2024-04-23T19:03:43.910950+0000","last_fullsized":"2024-04-23T19:03:43.910950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:21.331628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'26","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389169+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:43.389169+0000","last_peered":"2024-04-23T19:03:43.389169+0000","last_clean":"2024-04-23T19:03:43.389169+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:43.389169+0000","last_undegraded":"2024-04-23T19:03:43.389169+0000","last_fullsized":"2024-04-23T19:03:43.389169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708197+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:03:43.708197+0000","last_peered":"2024-04-23T19:03:43.708197+0000","last_clean":"2024-04-23T19:03:43.708197+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:03:43.708197+0000","last_undegraded":"2024-04-23T19:03:43.708197+0000","last_fullsized":"2024-04-23T19:03:43.708197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113320+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113320+0000","last_peered":"2024-04-23T19:03:44.113320+0000","last_clean":"2024-04-23T19:03:44.113320+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113320+0000","last_undegraded":"2024-04-23T19:03:44.113320+0000","last_fullsized":"2024-04-23T19:03:44.113320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:09.210430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709271+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:03:43.709271+0000","last_peered":"2024-04-23T19:03:43.709271+0000","last_clean":"2024-04-23T19:03:43.709271+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:03:43.709271+0000","last_undegraded":"2024-04-23T19:03:43.709271+0000","last_fullsized":"2024-04-23T19:03:43.709271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113725+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:03:44.113725+0000","last_peered":"2024-04-23T19:03:44.113725+0000","last_clean":"2024-04-23T19:03:44.113725+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:03:44.113725+0000","last_undegraded":"2024-04-23T19:03:44.113725+0000","last_fullsized":"2024-04-23T19:03:44.113725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389218+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:03:43.389218+0000","last_peered":"2024-04-23T19:03:43.389218+0000","last_clean":"2024-04-23T19:03:43.389218+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:03:43.389218+0000","last_undegraded":"2024-04-23T19:03:43.389218+0000","last_fullsized":"2024-04-23T19:03:43.389218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:08.385773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391341+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:43.391341+0000","last_peered":"2024-04-23T19:03:43.391341+0000","last_clean":"2024-04-23T19:03:43.391341+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:43.391341+0000","last_undegraded":"2024-04-23T19:03:43.391341+0000","last_fullsized":"2024-04-23T19:03:43.391341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114228+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:03:44.114228+0000","last_peered":"2024-04-23T19:03:44.114228+0000","last_clean":"2024-04-23T19:03:44.114228+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:03:44.114228+0000","last_undegraded":"2024-04-23T19:03:44.114228+0000","last_fullsized":"2024-04-23T19:03:44.114228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'39","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390341+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:03:43.390341+0000","last_peered":"2024-04-23T19:03:43.390341+0000","last_clean":"2024-04-23T19:03:43.390341+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:03:43.390341+0000","last_undegraded":"2024-04-23T19:03:43.390341+0000","last_fullsized":"2024-04-23T19:03:43.390341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113854+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:03:44.113854+0000","last_peered":"2024-04-23T19:03:44.113854+0000","last_clean":"2024-04-23T19:03:44.113854+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:03:44.113854+0000","last_undegraded":"2024-04-23T19:03:44.113854+0000","last_fullsized":"2024-04-23T19:03:44.113854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:35.324621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707656+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707656+0000","last_peered":"2024-04-23T19:03:43.707656+0000","last_clean":"2024-04-23T19:03:43.707656+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707656+0000","last_undegraded":"2024-04-23T19:03:43.707656+0000","last_fullsized":"2024-04-23T19:03:43.707656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114161+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:03:44.114161+0000","last_peered":"2024-04-23T19:03:44.114161+0000","last_clean":"2024-04-23T19:03:44.114161+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:03:44.114161+0000","last_undegraded":"2024-04-23T19:03:44.114161+0000","last_fullsized":"2024-04-23T19:03:44.114161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113340+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:03:44.113340+0000","last_peered":"2024-04-23T19:03:44.113340+0000","last_clean":"2024-04-23T19:03:44.113340+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:03:44.113340+0000","last_undegraded":"2024-04-23T19:03:44.113340+0000","last_fullsized":"2024-04-23T19:03:44.113340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112983+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:44.112983+0000","last_peered":"2024-04-23T19:03:44.112983+0000","last_clean":"2024-04-23T19:03:44.112983+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:44.112983+0000","last_undegraded":"2024-04-23T19:03:44.112983+0000","last_fullsized":"2024-04-23T19:03:44.112983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:43.106478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390688+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:03:43.390688+0000","last_peered":"2024-04-23T19:03:43.390688+0000","last_clean":"2024-04-23T19:03:43.390688+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:03:43.390688+0000","last_undegraded":"2024-04-23T19:03:43.390688+0000","last_fullsized":"2024-04-23T19:03:43.390688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:12.316155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'137","reported_seq":429,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.558590+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:03:44.558590+0000","last_peered":"2024-04-23T19:03:44.558590+0000","last_clean":"2024-04-23T19:03:44.558590+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:03:44.558590+0000","last_undegraded":"2024-04-23T19:03:44.558590+0000","last_fullsized":"2024-04-23T19:03:44.558590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:07.635425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114354+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114354+0000","last_peered":"2024-04-23T19:03:44.114354+0000","last_clean":"2024-04-23T19:03:44.114354+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114354+0000","last_undegraded":"2024-04-23T19:03:44.114354+0000","last_fullsized":"2024-04-23T19:03:44.114354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112303+0000","last_change":"2024-04-23T19:03:32.286556+0000","last_active":"2024-04-23T19:03:44.112303+0000","last_peered":"2024-04-23T19:03:44.112303+0000","last_clean":"2024-04-23T19:03:44.112303+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:03:44.112303+0000","last_undegraded":"2024-04-23T19:03:44.112303+0000","last_fullsized":"2024-04-23T19:03:44.112303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:18.008985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115727+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:03:44.115727+0000","last_peered":"2024-04-23T19:03:44.115727+0000","last_clean":"2024-04-23T19:03:44.115727+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:03:44.115727+0000","last_undegraded":"2024-04-23T19:03:44.115727+0000","last_fullsized":"2024-04-23T19:03:44.115727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389027+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:03:43.389027+0000","last_peered":"2024-04-23T19:03:43.389027+0000","last_clean":"2024-04-23T19:03:43.389027+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:03:43.389027+0000","last_undegraded":"2024-04-23T19:03:43.389027+0000","last_fullsized":"2024-04-23T19:03:43.389027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:40.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"96'14","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112139+0000","last_change":"2024-04-23T19:03:32.290315+0000","last_active":"2024-04-23T19:03:44.112139+0000","last_peered":"2024-04-23T19:03:44.112139+0000","last_clean":"2024-04-23T19:03:44.112139+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:03:44.112139+0000","last_undegraded":"2024-04-23T19:03:44.112139+0000","last_fullsized":"2024-04-23T19:03:44.112139+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:50.252138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393921+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:03:43.393921+0000","last_peered":"2024-04-23T19:03:43.393921+0000","last_clean":"2024-04-23T19:03:43.393921+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:03:43.393921+0000","last_undegraded":"2024-04-23T19:03:43.393921+0000","last_fullsized":"2024-04-23T19:03:43.393921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:14.424062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113413+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:03:44.113413+0000","last_peered":"2024-04-23T19:03:44.113413+0000","last_clean":"2024-04-23T19:03:44.113413+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:03:44.113413+0000","last_undegraded":"2024-04-23T19:03:44.113413+0000","last_fullsized":"2024-04-23T19:03:44.113413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392383+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392383+0000","last_peered":"2024-04-23T19:03:43.392383+0000","last_clean":"2024-04-23T19:03:43.392383+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392383+0000","last_undegraded":"2024-04-23T19:03:43.392383+0000","last_fullsized":"2024-04-23T19:03:43.392383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:18.109770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113895+0000","last_change":"2024-04-23T19:03:32.300198+0000","last_active":"2024-04-23T19:03:44.113895+0000","last_peered":"2024-04-23T19:03:44.113895+0000","last_clean":"2024-04-23T19:03:44.113895+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:03:44.113895+0000","last_undegraded":"2024-04-23T19:03:44.113895+0000","last_fullsized":"2024-04-23T19:03:44.113895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:55:20.076349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389317+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:03:43.389317+0000","last_peered":"2024-04-23T19:03:43.389317+0000","last_clean":"2024-04-23T19:03:43.389317+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:03:43.389317+0000","last_undegraded":"2024-04-23T19:03:43.389317+0000","last_fullsized":"2024-04-23T19:03:43.389317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:27.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911323+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:43.911323+0000","last_peered":"2024-04-23T19:03:43.911323+0000","last_clean":"2024-04-23T19:03:43.911323+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:43.911323+0000","last_undegraded":"2024-04-23T19:03:43.911323+0000","last_fullsized":"2024-04-23T19:03:43.911323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:21.312809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":280,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113800+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:03:44.113800+0000","last_peered":"2024-04-23T19:03:44.113800+0000","last_clean":"2024-04-23T19:03:44.113800+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:03:44.113800+0000","last_undegraded":"2024-04-23T19:03:44.113800+0000","last_fullsized":"2024-04-23T19:03:44.113800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393082+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393082+0000","last_peered":"2024-04-23T19:03:43.393082+0000","last_clean":"2024-04-23T19:03:43.393082+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393082+0000","last_undegraded":"2024-04-23T19:03:43.393082+0000","last_fullsized":"2024-04-23T19:03:43.393082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709817+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709817+0000","last_peered":"2024-04-23T19:03:43.709817+0000","last_clean":"2024-04-23T19:03:43.709817+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709817+0000","last_undegraded":"2024-04-23T19:03:43.709817+0000","last_fullsized":"2024-04-23T19:03:43.709817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387614+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387614+0000","last_peered":"2024-04-23T19:03:43.387614+0000","last_clean":"2024-04-23T19:03:43.387614+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387614+0000","last_undegraded":"2024-04-23T19:03:43.387614+0000","last_fullsized":"2024-04-23T19:03:43.387614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113459+0000","last_change":"2024-04-23T19:03:32.295129+0000","last_active":"2024-04-23T19:03:44.113459+0000","last_peered":"2024-04-23T19:03:44.113459+0000","last_clean":"2024-04-23T19:03:44.113459+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:03:44.113459+0000","last_undegraded":"2024-04-23T19:03:44.113459+0000","last_fullsized":"2024-04-23T19:03:44.113459+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:35:11.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390260+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:43.390260+0000","last_peered":"2024-04-23T19:03:43.390260+0000","last_clean":"2024-04-23T19:03:43.390260+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:43.390260+0000","last_undegraded":"2024-04-23T19:03:43.390260+0000","last_fullsized":"2024-04-23T19:03:43.390260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114156+0000","last_change":"2024-04-23T19:03:32.293904+0000","last_active":"2024-04-23T19:03:44.114156+0000","last_peered":"2024-04-23T19:03:44.114156+0000","last_clean":"2024-04-23T19:03:44.114156+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:03:44.114156+0000","last_undegraded":"2024-04-23T19:03:44.114156+0000","last_fullsized":"2024-04-23T19:03:44.114156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:21.520365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113604+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:03:44.113604+0000","last_peered":"2024-04-23T19:03:44.113604+0000","last_clean":"2024-04-23T19:03:44.113604+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:03:44.113604+0000","last_undegraded":"2024-04-23T19:03:44.113604+0000","last_fullsized":"2024-04-23T19:03:44.113604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:00.280044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'34","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112855+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:03:44.112855+0000","last_peered":"2024-04-23T19:03:44.112855+0000","last_clean":"2024-04-23T19:03:44.112855+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:03:44.112855+0000","last_undegraded":"2024-04-23T19:03:44.112855+0000","last_fullsized":"2024-04-23T19:03:44.112855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908951+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.908951+0000","last_peered":"2024-04-23T19:03:43.908951+0000","last_clean":"2024-04-23T19:03:43.908951+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.908951+0000","last_undegraded":"2024-04-23T19:03:43.908951+0000","last_fullsized":"2024-04-23T19:03:43.908951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113600+0000","last_change":"2024-04-23T19:00:25.328948+0000","last_active":"2024-04-23T19:03:44.113600+0000","last_peered":"2024-04-23T19:03:44.113600+0000","last_clean":"2024-04-23T19:03:44.113600+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:03:44.113600+0000","last_undegraded":"2024-04-23T19:03:44.113600+0000","last_fullsized":"2024-04-23T19:03:44.113600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:21.870770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113874+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:03:44.113874+0000","last_peered":"2024-04-23T19:03:44.113874+0000","last_clean":"2024-04-23T19:03:44.113874+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:03:44.113874+0000","last_undegraded":"2024-04-23T19:03:44.113874+0000","last_fullsized":"2024-04-23T19:03:44.113874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"97'22","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113983+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:44.113983+0000","last_peered":"2024-04-23T19:03:44.113983+0000","last_clean":"2024-04-23T19:03:44.113983+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:44.113983+0000","last_undegraded":"2024-04-23T19:03:44.113983+0000","last_fullsized":"2024-04-23T19:03:44.113983+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.348240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115650+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:03:44.115650+0000","last_peered":"2024-04-23T19:03:44.115650+0000","last_clean":"2024-04-23T19:03:44.115650+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:03:44.115650+0000","last_undegraded":"2024-04-23T19:03:44.115650+0000","last_fullsized":"2024-04-23T19:03:44.115650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708440+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:03:43.708440+0000","last_peered":"2024-04-23T19:03:43.708440+0000","last_clean":"2024-04-23T19:03:43.708440+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:03:43.708440+0000","last_undegraded":"2024-04-23T19:03:43.708440+0000","last_fullsized":"2024-04-23T19:03:43.708440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112369+0000","last_change":"2024-04-23T19:03:32.300841+0000","last_active":"2024-04-23T19:03:44.112369+0000","last_peered":"2024-04-23T19:03:44.112369+0000","last_clean":"2024-04-23T19:03:44.112369+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:03:44.112369+0000","last_undegraded":"2024-04-23T19:03:44.112369+0000","last_fullsized":"2024-04-23T19:03:44.112369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:36.411296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'135","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393276+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393276+0000","last_peered":"2024-04-23T19:03:43.393276+0000","last_clean":"2024-04-23T19:03:43.393276+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393276+0000","last_undegraded":"2024-04-23T19:03:43.393276+0000","last_fullsized":"2024-04-23T19:03:43.393276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:09.982810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391087+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:03:43.391087+0000","last_peered":"2024-04-23T19:03:43.391087+0000","last_clean":"2024-04-23T19:03:43.391087+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:03:43.391087+0000","last_undegraded":"2024-04-23T19:03:43.391087+0000","last_fullsized":"2024-04-23T19:03:43.391087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"97'20","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392954+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:43.392954+0000","last_peered":"2024-04-23T19:03:43.392954+0000","last_clean":"2024-04-23T19:03:43.392954+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:43.392954+0000","last_undegraded":"2024-04-23T19:03:43.392954+0000","last_fullsized":"2024-04-23T19:03:43.392954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115534+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115534+0000","last_peered":"2024-04-23T19:03:44.115534+0000","last_clean":"2024-04-23T19:03:44.115534+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115534+0000","last_undegraded":"2024-04-23T19:03:44.115534+0000","last_fullsized":"2024-04-23T19:03:44.115534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:41.115956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909201+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:03:43.909201+0000","last_peered":"2024-04-23T19:03:43.909201+0000","last_clean":"2024-04-23T19:03:43.909201+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:03:43.909201+0000","last_undegraded":"2024-04-23T19:03:43.909201+0000","last_fullsized":"2024-04-23T19:03:43.909201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910617+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:03:43.910617+0000","last_peered":"2024-04-23T19:03:43.910617+0000","last_clean":"2024-04-23T19:03:43.910617+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:03:43.910617+0000","last_undegraded":"2024-04-23T19:03:43.910617+0000","last_fullsized":"2024-04-23T19:03:43.910617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'135","reported_seq":439,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557152+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:03:44.557152+0000","last_peered":"2024-04-23T19:03:44.557152+0000","last_clean":"2024-04-23T19:03:44.557152+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:03:44.557152+0000","last_undegraded":"2024-04-23T19:03:44.557152+0000","last_fullsized":"2024-04-23T19:03:44.557152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:41.524089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113500+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:44.113500+0000","last_peered":"2024-04-23T19:03:44.113500+0000","last_clean":"2024-04-23T19:03:44.113500+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:44.113500+0000","last_undegraded":"2024-04-23T19:03:44.113500+0000","last_fullsized":"2024-04-23T19:03:44.113500+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:28.633021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909395+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909395+0000","last_peered":"2024-04-23T19:03:43.909395+0000","last_clean":"2024-04-23T19:03:43.909395+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909395+0000","last_undegraded":"2024-04-23T19:03:43.909395+0000","last_fullsized":"2024-04-23T19:03:43.909395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"97'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114287+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:44.114287+0000","last_peered":"2024-04-23T19:03:44.114287+0000","last_clean":"2024-04-23T19:03:44.114287+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:44.114287+0000","last_undegraded":"2024-04-23T19:03:44.114287+0000","last_fullsized":"2024-04-23T19:03:44.114287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710129+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:03:43.710129+0000","last_peered":"2024-04-23T19:03:43.710129+0000","last_clean":"2024-04-23T19:03:43.710129+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:03:43.710129+0000","last_undegraded":"2024-04-23T19:03:43.710129+0000","last_fullsized":"2024-04-23T19:03:43.710129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390843+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:03:43.390843+0000","last_peered":"2024-04-23T19:03:43.390843+0000","last_clean":"2024-04-23T19:03:43.390843+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:03:43.390843+0000","last_undegraded":"2024-04-23T19:03:43.390843+0000","last_fullsized":"2024-04-23T19:03:43.390843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:05.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390945+0000","last_change":"2024-04-23T19:00:23.318947+0000","last_active":"2024-04-23T19:03:43.390945+0000","last_peered":"2024-04-23T19:03:43.390945+0000","last_clean":"2024-04-23T19:03:43.390945+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:03:43.390945+0000","last_undegraded":"2024-04-23T19:03:43.390945+0000","last_fullsized":"2024-04-23T19:03:43.390945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:16.435953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388873+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.388873+0000","last_peered":"2024-04-23T19:03:43.388873+0000","last_clean":"2024-04-23T19:03:43.388873+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.388873+0000","last_undegraded":"2024-04-23T19:03:43.388873+0000","last_fullsized":"2024-04-23T19:03:43.388873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:33.079333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114432+0000","last_change":"2024-04-23T19:00:25.316494+0000","last_active":"2024-04-23T19:03:44.114432+0000","last_peered":"2024-04-23T19:03:44.114432+0000","last_clean":"2024-04-23T19:03:44.114432+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:03:44.114432+0000","last_undegraded":"2024-04-23T19:03:44.114432+0000","last_fullsized":"2024-04-23T19:03:44.114432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:02.206731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909827+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:03:43.909827+0000","last_peered":"2024-04-23T19:03:43.909827+0000","last_clean":"2024-04-23T19:03:43.909827+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:03:43.909827+0000","last_undegraded":"2024-04-23T19:03:43.909827+0000","last_fullsized":"2024-04-23T19:03:43.909827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:07.353478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910450+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:43.910450+0000","last_peered":"2024-04-23T19:03:43.910450+0000","last_clean":"2024-04-23T19:03:43.910450+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:43.910450+0000","last_undegraded":"2024-04-23T19:03:43.910450+0000","last_fullsized":"2024-04-23T19:03:43.910450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:22.792890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113537+0000","last_change":"2024-04-23T19:03:32.294993+0000","last_active":"2024-04-23T19:03:44.113537+0000","last_peered":"2024-04-23T19:03:44.113537+0000","last_clean":"2024-04-23T19:03:44.113537+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:03:44.113537+0000","last_undegraded":"2024-04-23T19:03:44.113537+0000","last_fullsized":"2024-04-23T19:03:44.113537+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:50.832778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'19","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388829+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:03:43.388829+0000","last_peered":"2024-04-23T19:03:43.388829+0000","last_clean":"2024-04-23T19:03:43.388829+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:03:43.388829+0000","last_undegraded":"2024-04-23T19:03:43.388829+0000","last_fullsized":"2024-04-23T19:03:43.388829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388406+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:03:43.388406+0000","last_peered":"2024-04-23T19:03:43.388406+0000","last_clean":"2024-04-23T19:03:43.388406+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:03:43.388406+0000","last_undegraded":"2024-04-23T19:03:43.388406+0000","last_fullsized":"2024-04-23T19:03:43.388406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:14.309341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392779+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:03:43.392779+0000","last_peered":"2024-04-23T19:03:43.392779+0000","last_clean":"2024-04-23T19:03:43.392779+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:03:43.392779+0000","last_undegraded":"2024-04-23T19:03:43.392779+0000","last_fullsized":"2024-04-23T19:03:43.392779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.016180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113434+0000","last_change":"2024-04-23T19:03:32.300516+0000","last_active":"2024-04-23T19:03:44.113434+0000","last_peered":"2024-04-23T19:03:44.113434+0000","last_clean":"2024-04-23T19:03:44.113434+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:03:44.113434+0000","last_undegraded":"2024-04-23T19:03:44.113434+0000","last_fullsized":"2024-04-23T19:03:44.113434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:02.485036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"97'33","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115124+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:44.115124+0000","last_peered":"2024-04-23T19:03:44.115124+0000","last_clean":"2024-04-23T19:03:44.115124+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:44.115124+0000","last_undegraded":"2024-04-23T19:03:44.115124+0000","last_fullsized":"2024-04-23T19:03:44.115124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392243+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:03:43.392243+0000","last_peered":"2024-04-23T19:03:43.392243+0000","last_clean":"2024-04-23T19:03:43.392243+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:03:43.392243+0000","last_undegraded":"2024-04-23T19:03:43.392243+0000","last_fullsized":"2024-04-23T19:03:43.392243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"100'10","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112763+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:03:44.112763+0000","last_peered":"2024-04-23T19:03:44.112763+0000","last_clean":"2024-04-23T19:03:44.112763+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:03:44.112763+0000","last_undegraded":"2024-04-23T19:03:44.112763+0000","last_fullsized":"2024-04-23T19:03:44.112763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113317+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:03:44.113317+0000","last_peered":"2024-04-23T19:03:44.113317+0000","last_clean":"2024-04-23T19:03:44.113317+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:03:44.113317+0000","last_undegraded":"2024-04-23T19:03:44.113317+0000","last_fullsized":"2024-04-23T19:03:44.113317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113692+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:44.113692+0000","last_peered":"2024-04-23T19:03:44.113692+0000","last_clean":"2024-04-23T19:03:44.113692+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:44.113692+0000","last_undegraded":"2024-04-23T19:03:44.113692+0000","last_fullsized":"2024-04-23T19:03:44.113692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:36.711068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389971+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:03:43.389971+0000","last_peered":"2024-04-23T19:03:43.389971+0000","last_clean":"2024-04-23T19:03:43.389971+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:03:43.389971+0000","last_undegraded":"2024-04-23T19:03:43.389971+0000","last_fullsized":"2024-04-23T19:03:43.389971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"97'24","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390374+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:03:43.390374+0000","last_peered":"2024-04-23T19:03:43.390374+0000","last_clean":"2024-04-23T19:03:43.390374+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:03:43.390374+0000","last_undegraded":"2024-04-23T19:03:43.390374+0000","last_fullsized":"2024-04-23T19:03:43.390374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112637+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:03:44.112637+0000","last_peered":"2024-04-23T19:03:44.112637+0000","last_clean":"2024-04-23T19:03:44.112637+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:03:44.112637+0000","last_undegraded":"2024-04-23T19:03:44.112637+0000","last_fullsized":"2024-04-23T19:03:44.112637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391944+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:03:43.391944+0000","last_peered":"2024-04-23T19:03:43.391944+0000","last_clean":"2024-04-23T19:03:43.391944+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:03:43.391944+0000","last_undegraded":"2024-04-23T19:03:43.391944+0000","last_fullsized":"2024-04-23T19:03:43.391944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:36.527992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708373+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:03:43.708373+0000","last_peered":"2024-04-23T19:03:43.708373+0000","last_clean":"2024-04-23T19:03:43.708373+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:03:43.708373+0000","last_undegraded":"2024-04-23T19:03:43.708373+0000","last_fullsized":"2024-04-23T19:03:43.708373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388390+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388390+0000","last_peered":"2024-04-23T19:03:43.388390+0000","last_clean":"2024-04-23T19:03:43.388390+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388390+0000","last_undegraded":"2024-04-23T19:03:43.388390+0000","last_fullsized":"2024-04-23T19:03:43.388390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:30.899523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391315+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391315+0000","last_peered":"2024-04-23T19:03:43.391315+0000","last_clean":"2024-04-23T19:03:43.391315+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391315+0000","last_undegraded":"2024-04-23T19:03:43.391315+0000","last_fullsized":"2024-04-23T19:03:43.391315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:29:48.117170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"97'28","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114624+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:44.114624+0000","last_peered":"2024-04-23T19:03:44.114624+0000","last_clean":"2024-04-23T19:03:44.114624+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:44.114624+0000","last_undegraded":"2024-04-23T19:03:44.114624+0000","last_fullsized":"2024-04-23T19:03:44.114624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708231+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:03:43.708231+0000","last_peered":"2024-04-23T19:03:43.708231+0000","last_clean":"2024-04-23T19:03:43.708231+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:03:43.708231+0000","last_undegraded":"2024-04-23T19:03:43.708231+0000","last_fullsized":"2024-04-23T19:03:43.708231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113187+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:03:44.113187+0000","last_peered":"2024-04-23T19:03:44.113187+0000","last_clean":"2024-04-23T19:03:44.113187+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:03:44.113187+0000","last_undegraded":"2024-04-23T19:03:44.113187+0000","last_fullsized":"2024-04-23T19:03:44.113187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113407+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:03:44.113407+0000","last_peered":"2024-04-23T19:03:44.113407+0000","last_clean":"2024-04-23T19:03:44.113407+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:03:44.113407+0000","last_undegraded":"2024-04-23T19:03:44.113407+0000","last_fullsized":"2024-04-23T19:03:44.113407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710040+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:03:43.710040+0000","last_peered":"2024-04-23T19:03:43.710040+0000","last_clean":"2024-04-23T19:03:43.710040+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:03:43.710040+0000","last_undegraded":"2024-04-23T19:03:43.710040+0000","last_fullsized":"2024-04-23T19:03:43.710040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"96'20","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391502+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:43.391502+0000","last_peered":"2024-04-23T19:03:43.391502+0000","last_clean":"2024-04-23T19:03:43.391502+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:43.391502+0000","last_undegraded":"2024-04-23T19:03:43.391502+0000","last_fullsized":"2024-04-23T19:03:43.391502+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:57.774849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113935+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:03:44.113935+0000","last_peered":"2024-04-23T19:03:44.113935+0000","last_clean":"2024-04-23T19:03:44.113935+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:03:44.113935+0000","last_undegraded":"2024-04-23T19:03:44.113935+0000","last_fullsized":"2024-04-23T19:03:44.113935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'29","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114486+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:44.114486+0000","last_peered":"2024-04-23T19:03:44.114486+0000","last_clean":"2024-04-23T19:03:44.114486+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:44.114486+0000","last_undegraded":"2024-04-23T19:03:44.114486+0000","last_fullsized":"2024-04-23T19:03:44.114486+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:28.797026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62355,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388731+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:03:43.388731+0000","last_peered":"2024-04-23T19:03:43.388731+0000","last_clean":"2024-04-23T19:03:43.388731+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:03:43.388731+0000","last_undegraded":"2024-04-23T19:03:43.388731+0000","last_fullsized":"2024-04-23T19:03:43.388731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391467+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391467+0000","last_peered":"2024-04-23T19:03:43.391467+0000","last_clean":"2024-04-23T19:03:43.391467+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391467+0000","last_undegraded":"2024-04-23T19:03:43.391467+0000","last_fullsized":"2024-04-23T19:03:43.391467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:22.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114062+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:03:44.114062+0000","last_peered":"2024-04-23T19:03:44.114062+0000","last_clean":"2024-04-23T19:03:44.114062+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:03:44.114062+0000","last_undegraded":"2024-04-23T19:03:44.114062+0000","last_fullsized":"2024-04-23T19:03:44.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"97'30","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113127+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:03:44.113127+0000","last_peered":"2024-04-23T19:03:44.113127+0000","last_clean":"2024-04-23T19:03:44.113127+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:03:44.113127+0000","last_undegraded":"2024-04-23T19:03:44.113127+0000","last_fullsized":"2024-04-23T19:03:44.113127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709898+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:03:43.709898+0000","last_peered":"2024-04-23T19:03:43.709898+0000","last_clean":"2024-04-23T19:03:43.709898+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:03:43.709898+0000","last_undegraded":"2024-04-23T19:03:43.709898+0000","last_fullsized":"2024-04-23T19:03:43.709898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114003+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:03:44.114003+0000","last_peered":"2024-04-23T19:03:44.114003+0000","last_clean":"2024-04-23T19:03:44.114003+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:03:44.114003+0000","last_undegraded":"2024-04-23T19:03:44.114003+0000","last_fullsized":"2024-04-23T19:03:44.114003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114574+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:03:44.114574+0000","last_peered":"2024-04-23T19:03:44.114574+0000","last_clean":"2024-04-23T19:03:44.114574+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:03:44.114574+0000","last_undegraded":"2024-04-23T19:03:44.114574+0000","last_fullsized":"2024-04-23T19:03:44.114574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:08.394863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707993+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.707993+0000","last_peered":"2024-04-23T19:03:43.707993+0000","last_clean":"2024-04-23T19:03:43.707993+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.707993+0000","last_undegraded":"2024-04-23T19:03:43.707993+0000","last_fullsized":"2024-04-23T19:03:43.707993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392596+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:03:43.392596+0000","last_peered":"2024-04-23T19:03:43.392596+0000","last_clean":"2024-04-23T19:03:43.392596+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:03:43.392596+0000","last_undegraded":"2024-04-23T19:03:43.392596+0000","last_fullsized":"2024-04-23T19:03:43.392596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:55.236347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"97'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911521+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:43.911521+0000","last_peered":"2024-04-23T19:03:43.911521+0000","last_clean":"2024-04-23T19:03:43.911521+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:43.911521+0000","last_undegraded":"2024-04-23T19:03:43.911521+0000","last_fullsized":"2024-04-23T19:03:43.911521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.912128+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:03:43.912128+0000","last_peered":"2024-04-23T19:03:43.912128+0000","last_clean":"2024-04-23T19:03:43.912128+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:03:43.912128+0000","last_undegraded":"2024-04-23T19:03:43.912128+0000","last_fullsized":"2024-04-23T19:03:43.912128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:47.392971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393457+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:03:43.393457+0000","last_peered":"2024-04-23T19:03:43.393457+0000","last_clean":"2024-04-23T19:03:43.393457+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:03:43.393457+0000","last_undegraded":"2024-04-23T19:03:43.393457+0000","last_fullsized":"2024-04-23T19:03:43.393457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:27.629864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114358+0000","last_change":"2024-04-23T19:03:32.295881+0000","last_active":"2024-04-23T19:03:44.114358+0000","last_peered":"2024-04-23T19:03:44.114358+0000","last_clean":"2024-04-23T19:03:44.114358+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:03:44.114358+0000","last_undegraded":"2024-04-23T19:03:44.114358+0000","last_fullsized":"2024-04-23T19:03:44.114358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:09.028190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388000+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388000+0000","last_peered":"2024-04-23T19:03:43.388000+0000","last_clean":"2024-04-23T19:03:43.388000+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388000+0000","last_undegraded":"2024-04-23T19:03:43.388000+0000","last_fullsized":"2024-04-23T19:03:43.388000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:38.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394414+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:03:43.394414+0000","last_peered":"2024-04-23T19:03:43.394414+0000","last_clean":"2024-04-23T19:03:43.394414+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:03:43.394414+0000","last_undegraded":"2024-04-23T19:03:43.394414+0000","last_fullsized":"2024-04-23T19:03:43.394414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:33.760409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"97'20","reported_seq":147,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112321+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:44.112321+0000","last_peered":"2024-04-23T19:03:44.112321+0000","last_clean":"2024-04-23T19:03:44.112321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:44.112321+0000","last_undegraded":"2024-04-23T19:03:44.112321+0000","last_fullsized":"2024-04-23T19:03:44.112321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:33.220608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":160,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114840+0000","last_change":"2024-04-23T19:03:32.293970+0000","last_active":"2024-04-23T19:03:44.114840+0000","last_peered":"2024-04-23T19:03:44.114840+0000","last_clean":"2024-04-23T19:03:44.114840+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:03:44.114840+0000","last_undegraded":"2024-04-23T19:03:44.114840+0000","last_fullsized":"2024-04-23T19:03:44.114840+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:29.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910798+0000","last_change":"2024-04-23T19:00:21.307950+0000","last_active":"2024-04-23T19:03:43.910798+0000","last_peered":"2024-04-23T19:03:43.910798+0000","last_clean":"2024-04-23T19:03:43.910798+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:03:43.910798+0000","last_undegraded":"2024-04-23T19:03:43.910798+0000","last_fullsized":"2024-04-23T19:03:43.910798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:30.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'135","reported_seq":389,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557527+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:03:44.557527+0000","last_peered":"2024-04-23T19:03:44.557527+0000","last_clean":"2024-04-23T19:03:44.557527+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:03:44.557527+0000","last_undegraded":"2024-04-23T19:03:44.557527+0000","last_fullsized":"2024-04-23T19:03:44.557527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112611+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112611+0000","last_peered":"2024-04-23T19:03:44.112611+0000","last_clean":"2024-04-23T19:03:44.112611+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112611+0000","last_undegraded":"2024-04-23T19:03:44.112611+0000","last_fullsized":"2024-04-23T19:03:44.112611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909534+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:03:43.909534+0000","last_peered":"2024-04-23T19:03:43.909534+0000","last_clean":"2024-04-23T19:03:43.909534+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:03:43.909534+0000","last_undegraded":"2024-04-23T19:03:43.909534+0000","last_fullsized":"2024-04-23T19:03:43.909534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"97'21","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389562+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:03:43.389562+0000","last_peered":"2024-04-23T19:03:43.389562+0000","last_clean":"2024-04-23T19:03:43.389562+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:03:43.389562+0000","last_undegraded":"2024-04-23T19:03:43.389562+0000","last_fullsized":"2024-04-23T19:03:43.389562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113265+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:03:44.113265+0000","last_peered":"2024-04-23T19:03:44.113265+0000","last_clean":"2024-04-23T19:03:44.113265+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:03:44.113265+0000","last_undegraded":"2024-04-23T19:03:44.113265+0000","last_fullsized":"2024-04-23T19:03:44.113265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'23","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388295+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:03:43.388295+0000","last_peered":"2024-04-23T19:03:43.388295+0000","last_clean":"2024-04-23T19:03:43.388295+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:03:43.388295+0000","last_undegraded":"2024-04-23T19:03:43.388295+0000","last_fullsized":"2024-04-23T19:03:43.388295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111946+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:03:44.111946+0000","last_peered":"2024-04-23T19:03:44.111946+0000","last_clean":"2024-04-23T19:03:44.111946+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:03:44.111946+0000","last_undegraded":"2024-04-23T19:03:44.111946+0000","last_fullsized":"2024-04-23T19:03:44.111946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:39.926153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115183+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115183+0000","last_peered":"2024-04-23T19:03:44.115183+0000","last_clean":"2024-04-23T19:03:44.115183+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115183+0000","last_undegraded":"2024-04-23T19:03:44.115183+0000","last_fullsized":"2024-04-23T19:03:44.115183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910717+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:03:43.910717+0000","last_peered":"2024-04-23T19:03:43.910717+0000","last_clean":"2024-04-23T19:03:43.910717+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:03:43.910717+0000","last_undegraded":"2024-04-23T19:03:43.910717+0000","last_fullsized":"2024-04-23T19:03:43.910717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"97'26","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393664+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:03:43.393664+0000","last_peered":"2024-04-23T19:03:43.393664+0000","last_clean":"2024-04-23T19:03:43.393664+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:03:43.393664+0000","last_undegraded":"2024-04-23T19:03:43.393664+0000","last_fullsized":"2024-04-23T19:03:43.393664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:08.345384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388902+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:03:43.388902+0000","last_peered":"2024-04-23T19:03:43.388902+0000","last_clean":"2024-04-23T19:03:43.388902+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:03:43.388902+0000","last_undegraded":"2024-04-23T19:03:43.388902+0000","last_fullsized":"2024-04-23T19:03:43.388902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:42.284331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":134,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111823+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:44.111823+0000","last_peered":"2024-04-23T19:03:44.111823+0000","last_clean":"2024-04-23T19:03:44.111823+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:44.111823+0000","last_undegraded":"2024-04-23T19:03:44.111823+0000","last_fullsized":"2024-04-23T19:03:44.111823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:48.060369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707890+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:03:43.707890+0000","last_peered":"2024-04-23T19:03:43.707890+0000","last_clean":"2024-04-23T19:03:43.707890+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:03:43.707890+0000","last_undegraded":"2024-04-23T19:03:43.707890+0000","last_fullsized":"2024-04-23T19:03:43.707890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392918+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392918+0000","last_peered":"2024-04-23T19:03:43.392918+0000","last_clean":"2024-04-23T19:03:43.392918+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392918+0000","last_undegraded":"2024-04-23T19:03:43.392918+0000","last_fullsized":"2024-04-23T19:03:43.392918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:48.321777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390352+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:03:43.390352+0000","last_peered":"2024-04-23T19:03:43.390352+0000","last_clean":"2024-04-23T19:03:43.390352+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:03:43.390352+0000","last_undegraded":"2024-04-23T19:03:43.390352+0000","last_fullsized":"2024-04-23T19:03:43.390352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:08.593559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393209+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:03:43.393209+0000","last_peered":"2024-04-23T19:03:43.393209+0000","last_clean":"2024-04-23T19:03:43.393209+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:03:43.393209+0000","last_undegraded":"2024-04-23T19:03:43.393209+0000","last_fullsized":"2024-04-23T19:03:43.393209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908804+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908804+0000","last_peered":"2024-04-23T19:03:43.908804+0000","last_clean":"2024-04-23T19:03:43.908804+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908804+0000","last_undegraded":"2024-04-23T19:03:43.908804+0000","last_fullsized":"2024-04-23T19:03:43.908804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:12.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392822+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:43.392822+0000","last_peered":"2024-04-23T19:03:43.392822+0000","last_clean":"2024-04-23T19:03:43.392822+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:43.392822+0000","last_undegraded":"2024-04-23T19:03:43.392822+0000","last_fullsized":"2024-04-23T19:03:43.392822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:00.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909207+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909207+0000","last_peered":"2024-04-23T19:03:43.909207+0000","last_clean":"2024-04-23T19:03:43.909207+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909207+0000","last_undegraded":"2024-04-23T19:03:43.909207+0000","last_fullsized":"2024-04-23T19:03:43.909207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114601+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114601+0000","last_peered":"2024-04-23T19:03:44.114601+0000","last_clean":"2024-04-23T19:03:44.114601+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114601+0000","last_undegraded":"2024-04-23T19:03:44.114601+0000","last_fullsized":"2024-04-23T19:03:44.114601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909065+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:03:43.909065+0000","last_peered":"2024-04-23T19:03:43.909065+0000","last_clean":"2024-04-23T19:03:43.909065+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:03:43.909065+0000","last_undegraded":"2024-04-23T19:03:43.909065+0000","last_fullsized":"2024-04-23T19:03:43.909065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:58.266098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"97'25","reported_seq":151,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114439+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:44.114439+0000","last_peered":"2024-04-23T19:03:44.114439+0000","last_clean":"2024-04-23T19:03:44.114439+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:44.114439+0000","last_undegraded":"2024-04-23T19:03:44.114439+0000","last_fullsized":"2024-04-23T19:03:44.114439+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:08.849931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113085+0000","last_change":"2024-04-23T19:03:32.303428+0000","last_active":"2024-04-23T19:03:44.113085+0000","last_peered":"2024-04-23T19:03:44.113085+0000","last_clean":"2024-04-23T19:03:44.113085+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:03:44.113085+0000","last_undegraded":"2024-04-23T19:03:44.113085+0000","last_fullsized":"2024-04-23T19:03:44.113085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:39.837391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909644+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:03:43.909644+0000","last_peered":"2024-04-23T19:03:43.909644+0000","last_clean":"2024-04-23T19:03:43.909644+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:03:43.909644+0000","last_undegraded":"2024-04-23T19:03:43.909644+0000","last_fullsized":"2024-04-23T19:03:43.909644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113318+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:03:44.113318+0000","last_peered":"2024-04-23T19:03:44.113318+0000","last_clean":"2024-04-23T19:03:44.113318+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:03:44.113318+0000","last_undegraded":"2024-04-23T19:03:44.113318+0000","last_fullsized":"2024-04-23T19:03:44.113318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909653+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.909653+0000","last_peered":"2024-04-23T19:03:43.909653+0000","last_clean":"2024-04-23T19:03:43.909653+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.909653+0000","last_undegraded":"2024-04-23T19:03:43.909653+0000","last_fullsized":"2024-04-23T19:03:43.909653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:12.815982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115632+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115632+0000","last_peered":"2024-04-23T19:03:44.115632+0000","last_clean":"2024-04-23T19:03:44.115632+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115632+0000","last_undegraded":"2024-04-23T19:03:44.115632+0000","last_fullsized":"2024-04-23T19:03:44.115632+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:01.164433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"97'29","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707924+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:43.707924+0000","last_peered":"2024-04-23T19:03:43.707924+0000","last_clean":"2024-04-23T19:03:43.707924+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:43.707924+0000","last_undegraded":"2024-04-23T19:03:43.707924+0000","last_fullsized":"2024-04-23T19:03:43.707924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115428+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115428+0000","last_peered":"2024-04-23T19:03:44.115428+0000","last_clean":"2024-04-23T19:03:44.115428+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115428+0000","last_undegraded":"2024-04-23T19:03:44.115428+0000","last_fullsized":"2024-04-23T19:03:44.115428+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:38.798295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388809+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:03:43.388809+0000","last_peered":"2024-04-23T19:03:43.388809+0000","last_clean":"2024-04-23T19:03:43.388809+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:03:43.388809+0000","last_undegraded":"2024-04-23T19:03:43.388809+0000","last_fullsized":"2024-04-23T19:03:43.388809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:32.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389504+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:03:43.389504+0000","last_peered":"2024-04-23T19:03:43.389504+0000","last_clean":"2024-04-23T19:03:43.389504+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:03:43.389504+0000","last_undegraded":"2024-04-23T19:03:43.389504+0000","last_fullsized":"2024-04-23T19:03:43.389504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:13.143560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"97'17","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389148+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:43.389148+0000","last_peered":"2024-04-23T19:03:43.389148+0000","last_clean":"2024-04-23T19:03:43.389148+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:43.389148+0000","last_undegraded":"2024-04-23T19:03:43.389148+0000","last_fullsized":"2024-04-23T19:03:43.389148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114071+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:03:44.114071+0000","last_peered":"2024-04-23T19:03:44.114071+0000","last_clean":"2024-04-23T19:03:44.114071+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:03:44.114071+0000","last_undegraded":"2024-04-23T19:03:44.114071+0000","last_fullsized":"2024-04-23T19:03:44.114071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"97'21","reported_seq":150,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113268+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:44.113268+0000","last_peered":"2024-04-23T19:03:44.113268+0000","last_clean":"2024-04-23T19:03:44.113268+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:44.113268+0000","last_undegraded":"2024-04-23T19:03:44.113268+0000","last_fullsized":"2024-04-23T19:03:44.113268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:00.196994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392559+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392559+0000","last_peered":"2024-04-23T19:03:43.392559+0000","last_clean":"2024-04-23T19:03:43.392559+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392559+0000","last_undegraded":"2024-04-23T19:03:43.392559+0000","last_fullsized":"2024-04-23T19:03:43.392559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"97'23","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391726+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:43.391726+0000","last_peered":"2024-04-23T19:03:43.391726+0000","last_clean":"2024-04-23T19:03:43.391726+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:43.391726+0000","last_undegraded":"2024-04-23T19:03:43.391726+0000","last_fullsized":"2024-04-23T19:03:43.391726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911075+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:03:43.911075+0000","last_peered":"2024-04-23T19:03:43.911075+0000","last_clean":"2024-04-23T19:03:43.911075+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:03:43.911075+0000","last_undegraded":"2024-04-23T19:03:43.911075+0000","last_fullsized":"2024-04-23T19:03:43.911075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"97'34","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115162+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:44.115162+0000","last_peered":"2024-04-23T19:03:44.115162+0000","last_clean":"2024-04-23T19:03:44.115162+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:44.115162+0000","last_undegraded":"2024-04-23T19:03:44.115162+0000","last_fullsized":"2024-04-23T19:03:44.115162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:41.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389646+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:03:43.389646+0000","last_peered":"2024-04-23T19:03:43.389646+0000","last_clean":"2024-04-23T19:03:43.389646+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:03:43.389646+0000","last_undegraded":"2024-04-23T19:03:43.389646+0000","last_fullsized":"2024-04-23T19:03:43.389646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"97'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709559+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:03:43.709559+0000","last_peered":"2024-04-23T19:03:43.709559+0000","last_clean":"2024-04-23T19:03:43.709559+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:03:43.709559+0000","last_undegraded":"2024-04-23T19:03:43.709559+0000","last_fullsized":"2024-04-23T19:03:43.709559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707915+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:03:43.707915+0000","last_peered":"2024-04-23T19:03:43.707915+0000","last_clean":"2024-04-23T19:03:43.707915+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:03:43.707915+0000","last_undegraded":"2024-04-23T19:03:43.707915+0000","last_fullsized":"2024-04-23T19:03:43.707915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"96'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393204+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:43.393204+0000","last_peered":"2024-04-23T19:03:43.393204+0000","last_clean":"2024-04-23T19:03:43.393204+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:43.393204+0000","last_undegraded":"2024-04-23T19:03:43.393204+0000","last_fullsized":"2024-04-23T19:03:43.393204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114590+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:03:44.114590+0000","last_peered":"2024-04-23T19:03:44.114590+0000","last_clean":"2024-04-23T19:03:44.114590+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:03:44.114590+0000","last_undegraded":"2024-04-23T19:03:44.114590+0000","last_fullsized":"2024-04-23T19:03:44.114590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:07.142529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"97'32","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389442+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:43.389442+0000","last_peered":"2024-04-23T19:03:43.389442+0000","last_clean":"2024-04-23T19:03:43.389442+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:43.389442+0000","last_undegraded":"2024-04-23T19:03:43.389442+0000","last_fullsized":"2024-04-23T19:03:43.389442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:29:53.202472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":72,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911047+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911047+0000","last_peered":"2024-04-23T19:03:43.911047+0000","last_clean":"2024-04-23T19:03:43.911047+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911047+0000","last_undegraded":"2024-04-23T19:03:43.911047+0000","last_fullsized":"2024-04-23T19:03:43.911047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"97'29","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390537+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:43.390537+0000","last_peered":"2024-04-23T19:03:43.390537+0000","last_clean":"2024-04-23T19:03:43.390537+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:43.390537+0000","last_undegraded":"2024-04-23T19:03:43.390537+0000","last_fullsized":"2024-04-23T19:03:43.390537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394043+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:03:43.394043+0000","last_peered":"2024-04-23T19:03:43.394043+0000","last_clean":"2024-04-23T19:03:43.394043+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:03:43.394043+0000","last_undegraded":"2024-04-23T19:03:43.394043+0000","last_fullsized":"2024-04-23T19:03:43.394043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:57.801351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"97'31","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388801+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:03:43.388801+0000","last_peered":"2024-04-23T19:03:43.388801+0000","last_clean":"2024-04-23T19:03:43.388801+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:03:43.388801+0000","last_undegraded":"2024-04-23T19:03:43.388801+0000","last_fullsized":"2024-04-23T19:03:43.388801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911790+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:03:43.911790+0000","last_peered":"2024-04-23T19:03:43.911790+0000","last_clean":"2024-04-23T19:03:43.911790+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:03:43.911790+0000","last_undegraded":"2024-04-23T19:03:43.911790+0000","last_fullsized":"2024-04-23T19:03:43.911790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:48.340652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"97'21","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113663+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:44.113663+0000","last_peered":"2024-04-23T19:03:44.113663+0000","last_clean":"2024-04-23T19:03:44.113663+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:44.113663+0000","last_undegraded":"2024-04-23T19:03:44.113663+0000","last_fullsized":"2024-04-23T19:03:44.113663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113841+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113841+0000","last_peered":"2024-04-23T19:03:44.113841+0000","last_clean":"2024-04-23T19:03:44.113841+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113841+0000","last_undegraded":"2024-04-23T19:03:44.113841+0000","last_fullsized":"2024-04-23T19:03:44.113841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"97'23","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708932+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:03:43.708932+0000","last_peered":"2024-04-23T19:03:43.708932+0000","last_clean":"2024-04-23T19:03:43.708932+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:03:43.708932+0000","last_undegraded":"2024-04-23T19:03:43.708932+0000","last_fullsized":"2024-04-23T19:03:43.708932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112309+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:03:44.112309+0000","last_peered":"2024-04-23T19:03:44.112309+0000","last_clean":"2024-04-23T19:03:44.112309+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:03:44.112309+0000","last_undegraded":"2024-04-23T19:03:44.112309+0000","last_fullsized":"2024-04-23T19:03:44.112309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:46.842278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"97'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115562+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:03:44.115562+0000","last_peered":"2024-04-23T19:03:44.115562+0000","last_clean":"2024-04-23T19:03:44.115562+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:03:44.115562+0000","last_undegraded":"2024-04-23T19:03:44.115562+0000","last_fullsized":"2024-04-23T19:03:44.115562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389396+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:03:43.389396+0000","last_peered":"2024-04-23T19:03:43.389396+0000","last_clean":"2024-04-23T19:03:43.389396+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:03:43.389396+0000","last_undegraded":"2024-04-23T19:03:43.389396+0000","last_fullsized":"2024-04-23T19:03:43.389396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:43.665545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"97'18","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394522+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:03:43.394522+0000","last_peered":"2024-04-23T19:03:43.394522+0000","last_clean":"2024-04-23T19:03:43.394522+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:03:43.394522+0000","last_undegraded":"2024-04-23T19:03:43.394522+0000","last_fullsized":"2024-04-23T19:03:43.394522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:31.010789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113173+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:03:44.113173+0000","last_peered":"2024-04-23T19:03:44.113173+0000","last_clean":"2024-04-23T19:03:44.113173+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:03:44.113173+0000","last_undegraded":"2024-04-23T19:03:44.113173+0000","last_fullsized":"2024-04-23T19:03:44.113173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"97'28","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393916+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:03:43.393916+0000","last_peered":"2024-04-23T19:03:43.393916+0000","last_clean":"2024-04-23T19:03:43.393916+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:03:43.393916+0000","last_undegraded":"2024-04-23T19:03:43.393916+0000","last_fullsized":"2024-04-23T19:03:43.393916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:01.582081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"97'22","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388784+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:43.388784+0000","last_peered":"2024-04-23T19:03:43.388784+0000","last_clean":"2024-04-23T19:03:43.388784+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:43.388784+0000","last_undegraded":"2024-04-23T19:03:43.388784+0000","last_fullsized":"2024-04-23T19:03:43.388784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:47.840761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114539+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:03:44.114539+0000","last_peered":"2024-04-23T19:03:44.114539+0000","last_clean":"2024-04-23T19:03:44.114539+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:03:44.114539+0000","last_undegraded":"2024-04-23T19:03:44.114539+0000","last_fullsized":"2024-04-23T19:03:44.114539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:24.210488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"97'28","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112893+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:44.112893+0000","last_peered":"2024-04-23T19:03:44.112893+0000","last_clean":"2024-04-23T19:03:44.112893+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:44.112893+0000","last_undegraded":"2024-04-23T19:03:44.112893+0000","last_fullsized":"2024-04-23T19:03:44.112893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:40.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390065+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:03:43.390065+0000","last_peered":"2024-04-23T19:03:43.390065+0000","last_clean":"2024-04-23T19:03:43.390065+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:03:43.390065+0000","last_undegraded":"2024-04-23T19:03:43.390065+0000","last_fullsized":"2024-04-23T19:03:43.390065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.480293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1080,"ondisk_log_size":1080,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":386917,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":610,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":710058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1804696,"kb_used_data":1773520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92567144,"statfs":{"total":96636764160,"available":94788755456,"internally_reserved":0,"allocated":1816084480,"data_stored":1815444539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1197876,"kb_used_data":1166700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93173964,"statfs":{"total":96636764160,"available":95410139136,"internally_reserved":0,"allocated":1194700800,"data_stored":1194095951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693888,"kb_used_data":1658552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677952,"statfs":{"total":96636764160,"available":94902222848,"internally_reserved":0,"allocated":1698357248,"data_stored":1697703170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898284,"kb_used_data":1867096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473556,"statfs":{"total":96636764160,"available":94692921344,"internally_reserved":0,"allocated":1911906304,"data_stored":1911319884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1998844,"kb_used_data":1967668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92372996,"statfs":{"total":96636764160,"available":94589947904,"internally_reserved":0,"allocated":2014892032,"data_stored":2014257594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072988,"kb_used_data":1041812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93298852,"statfs":{"total":96636764160,"available":95538024448,"internally_reserved":0,"allocated":1066815488,"data_stored":1066225345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105972,"kb_used_data":1070636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93265868,"statfs":{"total":96636764160,"available":95504248832,"internally_reserved":0,"allocated":1096331264,"data_stored":1095704135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1806796,"kb_used_data":1771448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92565044,"statfs":{"total":96636764160,"available":94786605056,"internally_reserved":0,"allocated":1813962752,"data_stored":1813346224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1811939328,"data_stored":1811939328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1094713344,"data_stored":1094713344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1065353216,"data_stored":1065353216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2013265920,"data_stored":2013265920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1193279488,"data_stored":1193279488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1814036480,"data_stored":1814036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":175817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":57983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":177182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":292907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:03:57.571 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T19:03:57.858 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:03:57.859 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":116,"fsid":"4bb45736-c8eb-4572-abb0-38f9ff40b613","created":"2024-04-23T18:59:49.133644+0000","modified":"2024-04-23T19:03:43.375141+0000","last_up_change":"2024-04-23T19:00:00.934154+0000","last_in_change":"2024-04-23T18:59:52.236751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T19:00:01.944184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T19:00:08.051772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-23T19:00:13.945613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-23T19:00:15.582491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-23T19:00:17.526522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-23T19:00:19.440782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-23T19:00:21.330605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-23T19:00:23.465890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19702f2e-d87b-4f04-91b1-933211c92efc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6809","nonce":2480149234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6811","nonce":2480149234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6815","nonce":2480149234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2480149234},{"type":"v1","addr":"172.21.15.169:6813","nonce":2480149234}]},"public_addr":"172.21.15.169:6809/2480149234","cluster_addr":"172.21.15.169:6811/2480149234","heartbeat_back_addr":"172.21.15.169:6815/2480149234","heartbeat_front_addr":"172.21.15.169:6813/2480149234","state":["exists","up"]},{"osd":1,"uuid":"6f9fa56c-0fcb-4f45-9440-e60fe043be19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6818","nonce":2143529353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6823","nonce":2143529353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6831","nonce":2143529353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6825","nonce":2143529353},{"type":"v1","addr":"172.21.15.169:6828","nonce":2143529353}]},"public_addr":"172.21.15.169:6818/2143529353","cluster_addr":"172.21.15.169:6823/2143529353","heartbeat_back_addr":"172.21.15.169:6831/2143529353","heartbeat_front_addr":"172.21.15.169:6828/2143529353","state":["exists","up"]},{"osd":2,"uuid":"a45daf8f-561c-4931-954a-ae4cda4e9383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6819","nonce":2796580003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6822","nonce":2796580003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6827","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6829","nonce":2796580003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":2796580003},{"type":"v1","addr":"172.21.15.169:6826","nonce":2796580003}]},"public_addr":"172.21.15.169:6819/2796580003","cluster_addr":"172.21.15.169:6822/2796580003","heartbeat_back_addr":"172.21.15.169:6829/2796580003","heartbeat_front_addr":"172.21.15.169:6826/2796580003","state":["exists","up"]},{"osd":3,"uuid":"9ae3c352-4546-4115-8a2e-07ccb88ea066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6801","nonce":3764305788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6803","nonce":3764305788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6807","nonce":3764305788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3764305788},{"type":"v1","addr":"172.21.15.169:6805","nonce":3764305788}]},"public_addr":"172.21.15.169:6801/3764305788","cluster_addr":"172.21.15.169:6803/3764305788","heartbeat_back_addr":"172.21.15.169:6807/3764305788","heartbeat_front_addr":"172.21.15.169:6805/3764305788","state":["exists","up"]},{"osd":4,"uuid":"feff8989-ac80-433d-8d4d-61c64acbb0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6801","nonce":519231085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6803","nonce":519231085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6812","nonce":519231085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6805","nonce":519231085},{"type":"v1","addr":"172.21.15.193:6807","nonce":519231085}]},"public_addr":"172.21.15.193:6801/519231085","cluster_addr":"172.21.15.193:6803/519231085","heartbeat_back_addr":"172.21.15.193:6812/519231085","heartbeat_front_addr":"172.21.15.193:6807/519231085","state":["exists","up"]},{"osd":5,"uuid":"3ceb25a3-bc75-4611-8353-9a4ab397b27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6818","nonce":3321647745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6821","nonce":3321647745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6825","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6827","nonce":3321647745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":3321647745},{"type":"v1","addr":"172.21.15.193:6824","nonce":3321647745}]},"public_addr":"172.21.15.193:6818/3321647745","cluster_addr":"172.21.15.193:6821/3321647745","heartbeat_back_addr":"172.21.15.193:6827/3321647745","heartbeat_front_addr":"172.21.15.193:6824/3321647745","state":["exists","up"]},{"osd":6,"uuid":"b958ec69-6670-4132-a39d-30ba2027eaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6806","nonce":46529429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6809","nonce":46529429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6815","nonce":46529429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6811","nonce":46529429},{"type":"v1","addr":"172.21.15.193:6813","nonce":46529429}]},"public_addr":"172.21.15.193:6806/46529429","cluster_addr":"172.21.15.193:6809/46529429","heartbeat_back_addr":"172.21.15.193:6815/46529429","heartbeat_front_addr":"172.21.15.193:6813/46529429","state":["exists","up"]},{"osd":7,"uuid":"ab2626db-9460-443c-aa97-6f6c38f8b72c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6817","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6820","nonce":1901200038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6823","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6826","nonce":1901200038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6831","nonce":1901200038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":1901200038},{"type":"v1","addr":"172.21.15.193:6829","nonce":1901200038}]},"public_addr":"172.21.15.193:6820/1901200038","cluster_addr":"172.21.15.193:6826/1901200038","heartbeat_back_addr":"172.21.15.193:6831/1901200038","heartbeat_front_addr":"172.21.15.193:6829/1901200038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.665743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.556828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.555318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.632689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.791617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.811905+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:59:57.825013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T19:03:58.877 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T19:03:58.877 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:03:59.034 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:59.034 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:03:59.034 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:59.049 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T19:03:59.322 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T19:03:59.340 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T19:03:59.341 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:03:59.477 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:59.478 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:03:59.478 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:59.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T19:03:59.784 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T19:03:59.804 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T19:03:59.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:03:59.945 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:03:59.945 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:03:59.945 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:03:59.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T19:04:00.238 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T19:04:00.256 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T19:04:00.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:04:00.394 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:04:00.395 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:04:00.395 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:04:00.409 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T19:04:00.692 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T19:04:00.711 INFO:tasks.ceph:Scrubbing osd.4 2024-04-23T19:04:00.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:04:00.864 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:04:00.864 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:04:00.864 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:04:00.880 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-23T19:04:01.162 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 4 to deep-scrub 2024-04-23T19:04:01.182 INFO:tasks.ceph:Scrubbing osd.5 2024-04-23T19:04:01.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:04:01.332 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:04:01.332 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:04:01.332 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:04:01.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-23T19:04:01.626 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 5 to deep-scrub 2024-04-23T19:04:01.645 INFO:tasks.ceph:Scrubbing osd.6 2024-04-23T19:04:01.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:04:01.792 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:04:01.792 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:04:01.792 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:04:01.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-23T19:04:02.092 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 6 to deep-scrub 2024-04-23T19:04:02.112 INFO:tasks.ceph:Scrubbing osd.7 2024-04-23T19:04:02.113 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-23T19:04:02.259 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-04-23T19:04:02.259 INFO:teuthology.orchestra.run.smithi169.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T19:04:02.259 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-04-23T19:04:02.275 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-23T19:04:02.549 INFO:teuthology.orchestra.run.smithi169.stderr:instructed osd(s) 7 to deep-scrub 2024-04-23T19:04:02.568 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:04:02.909 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:04:02.915 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:04:02.926 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-23T19:04:02.009560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5019,"num_read_kb":3922,"num_write":4431,"num_write_kb":6187922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5539,"ondisk_log_size":5539,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":287044,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754687676,"statfs":{"total":773094113280,"available":772800180224,"internally_reserved":0,"allocated":12607488,"data_stored":7704972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195935,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1733,"num_read_kb":953,"num_write":1584,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005628"},"pg_stats":[{"pgid":"3.3f","version":"116'56","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.196681+0000","last_change":"2024-04-23T19:00:15.287256+0000","last_active":"2024-04-23T19:03:56.196681+0000","last_peered":"2024-04-23T19:03:56.196681+0000","last_clean":"2024-04-23T19:03:56.196681+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:03:56.196681+0000","last_undegraded":"2024-04-23T19:03:56.196681+0000","last_fullsized":"2024-04-23T19:03:56.196681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:10.378234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388061+0000","last_change":"2024-04-23T19:00:17.293441+0000","last_active":"2024-04-23T19:03:43.388061+0000","last_peered":"2024-04-23T19:03:43.388061+0000","last_clean":"2024-04-23T19:03:43.388061+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:03:43.388061+0000","last_undegraded":"2024-04-23T19:03:43.388061+0000","last_fullsized":"2024-04-23T19:03:43.388061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.250540+0000","last_change":"2024-04-23T19:03:32.293577+0000","last_active":"2024-04-23T19:03:56.250540+0000","last_peered":"2024-04-23T19:03:56.250540+0000","last_clean":"2024-04-23T19:03:56.250540+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:03:56.250540+0000","last_undegraded":"2024-04-23T19:03:56.250540+0000","last_fullsized":"2024-04-23T19:03:56.250540+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113300+0000","last_change":"2024-04-23T19:00:17.298141+0000","last_active":"2024-04-23T19:03:44.113300+0000","last_peered":"2024-04-23T19:03:44.113300+0000","last_clean":"2024-04-23T19:03:44.113300+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:03:44.113300+0000","last_undegraded":"2024-04-23T19:03:44.113300+0000","last_fullsized":"2024-04-23T19:03:44.113300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:14:24.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.193053+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:56.193053+0000","last_peered":"2024-04-23T19:03:56.193053+0000","last_clean":"2024-04-23T19:03:56.193053+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:56.193053+0000","last_undegraded":"2024-04-23T19:03:56.193053+0000","last_fullsized":"2024-04-23T19:03:56.193053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910546+0000","last_change":"2024-04-23T19:00:17.306400+0000","last_active":"2024-04-23T19:03:43.910546+0000","last_peered":"2024-04-23T19:03:43.910546+0000","last_clean":"2024-04-23T19:03:43.910546+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:03:43.910546+0000","last_undegraded":"2024-04-23T19:03:43.910546+0000","last_fullsized":"2024-04-23T19:03:43.910546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'52","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.238739+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:03:56.238739+0000","last_peered":"2024-04-23T19:03:56.238739+0000","last_clean":"2024-04-23T19:03:56.238739+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:03:56.238739+0000","last_undegraded":"2024-04-23T19:03:56.238739+0000","last_fullsized":"2024-04-23T19:03:56.238739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113550+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113550+0000","last_peered":"2024-04-23T19:03:44.113550+0000","last_clean":"2024-04-23T19:03:44.113550+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113550+0000","last_undegraded":"2024-04-23T19:03:44.113550+0000","last_fullsized":"2024-04-23T19:03:44.113550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'44","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.178940+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:56.178940+0000","last_peered":"2024-04-23T19:03:56.178940+0000","last_clean":"2024-04-23T19:03:56.178940+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:56.178940+0000","last_undegraded":"2024-04-23T19:03:56.178940+0000","last_fullsized":"2024-04-23T19:03:56.178940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:05.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708709+0000","last_change":"2024-04-23T19:00:17.320090+0000","last_active":"2024-04-23T19:03:43.708709+0000","last_peered":"2024-04-23T19:03:43.708709+0000","last_clean":"2024-04-23T19:03:43.708709+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:03:43.708709+0000","last_undegraded":"2024-04-23T19:03:43.708709+0000","last_fullsized":"2024-04-23T19:03:43.708709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:33.239234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'38","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.198206+0000","last_change":"2024-04-23T19:00:15.279314+0000","last_active":"2024-04-23T19:03:56.198206+0000","last_peered":"2024-04-23T19:03:56.198206+0000","last_clean":"2024-04-23T19:03:56.198206+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:03:56.198206+0000","last_undegraded":"2024-04-23T19:03:56.198206+0000","last_fullsized":"2024-04-23T19:03:56.198206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910702+0000","last_change":"2024-04-23T19:00:17.314496+0000","last_active":"2024-04-23T19:03:43.910702+0000","last_peered":"2024-04-23T19:03:43.910702+0000","last_clean":"2024-04-23T19:03:43.910702+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:03:43.910702+0000","last_undegraded":"2024-04-23T19:03:43.910702+0000","last_fullsized":"2024-04-23T19:03:43.910702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.091989+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:56.091989+0000","last_peered":"2024-04-23T19:03:56.091989+0000","last_clean":"2024-04-23T19:03:56.091989+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:56.091989+0000","last_undegraded":"2024-04-23T19:03:56.091989+0000","last_fullsized":"2024-04-23T19:03:56.091989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:29.923444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389842+0000","last_change":"2024-04-23T19:00:17.298991+0000","last_active":"2024-04-23T19:03:43.389842+0000","last_peered":"2024-04-23T19:03:43.389842+0000","last_clean":"2024-04-23T19:03:43.389842+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:03:43.389842+0000","last_undegraded":"2024-04-23T19:03:43.389842+0000","last_fullsized":"2024-04-23T19:03:43.389842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.245139+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:56.245139+0000","last_peered":"2024-04-23T19:03:56.245139+0000","last_clean":"2024-04-23T19:03:56.245139+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:56.245139+0000","last_undegraded":"2024-04-23T19:03:56.245139+0000","last_fullsized":"2024-04-23T19:03:56.245139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394390+0000","last_change":"2024-04-23T19:00:17.294779+0000","last_active":"2024-04-23T19:03:43.394390+0000","last_peered":"2024-04-23T19:03:43.394390+0000","last_clean":"2024-04-23T19:03:43.394390+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:03:43.394390+0000","last_undegraded":"2024-04-23T19:03:43.394390+0000","last_fullsized":"2024-04-23T19:03:43.394390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909226+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909226+0000","last_peered":"2024-04-23T19:03:43.909226+0000","last_clean":"2024-04-23T19:03:43.909226+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909226+0000","last_undegraded":"2024-04-23T19:03:43.909226+0000","last_fullsized":"2024-04-23T19:03:43.909226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'42","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.161999+0000","last_change":"2024-04-23T19:00:15.293347+0000","last_active":"2024-04-23T19:03:56.161999+0000","last_peered":"2024-04-23T19:03:56.161999+0000","last_clean":"2024-04-23T19:03:56.161999+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:03:56.161999+0000","last_undegraded":"2024-04-23T19:03:56.161999+0000","last_fullsized":"2024-04-23T19:03:56.161999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:44.331122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113766+0000","last_change":"2024-04-23T19:00:17.300820+0000","last_active":"2024-04-23T19:03:44.113766+0000","last_peered":"2024-04-23T19:03:44.113766+0000","last_clean":"2024-04-23T19:03:44.113766+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:03:44.113766+0000","last_undegraded":"2024-04-23T19:03:44.113766+0000","last_fullsized":"2024-04-23T19:03:44.113766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:46.663201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.104573+0000","last_change":"2024-04-23T19:00:15.279235+0000","last_active":"2024-04-23T19:03:56.104573+0000","last_peered":"2024-04-23T19:03:56.104573+0000","last_clean":"2024-04-23T19:03:56.104573+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:03:56.104573+0000","last_undegraded":"2024-04-23T19:03:56.104573+0000","last_fullsized":"2024-04-23T19:03:56.104573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:02.762233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388921+0000","last_change":"2024-04-23T19:00:17.318872+0000","last_active":"2024-04-23T19:03:43.388921+0000","last_peered":"2024-04-23T19:03:43.388921+0000","last_clean":"2024-04-23T19:03:43.388921+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:03:43.388921+0000","last_undegraded":"2024-04-23T19:03:43.388921+0000","last_fullsized":"2024-04-23T19:03:43.388921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'58","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.208155+0000","last_change":"2024-04-23T19:00:15.278728+0000","last_active":"2024-04-23T19:03:56.208155+0000","last_peered":"2024-04-23T19:03:56.208155+0000","last_clean":"2024-04-23T19:03:56.208155+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:03:56.208155+0000","last_undegraded":"2024-04-23T19:03:56.208155+0000","last_fullsized":"2024-04-23T19:03:56.208155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:55.769469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394149+0000","last_change":"2024-04-23T19:00:17.292033+0000","last_active":"2024-04-23T19:03:43.394149+0000","last_peered":"2024-04-23T19:03:43.394149+0000","last_clean":"2024-04-23T19:03:43.394149+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:03:43.394149+0000","last_undegraded":"2024-04-23T19:03:43.394149+0000","last_fullsized":"2024-04-23T19:03:43.394149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'32","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.269390+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:56.269390+0000","last_peered":"2024-04-23T19:03:56.269390+0000","last_clean":"2024-04-23T19:03:56.269390+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:56.269390+0000","last_undegraded":"2024-04-23T19:03:56.269390+0000","last_fullsized":"2024-04-23T19:03:56.269390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393805+0000","last_change":"2024-04-23T19:00:17.304929+0000","last_active":"2024-04-23T19:03:43.393805+0000","last_peered":"2024-04-23T19:03:43.393805+0000","last_clean":"2024-04-23T19:03:43.393805+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:03:43.393805+0000","last_undegraded":"2024-04-23T19:03:43.393805+0000","last_fullsized":"2024-04-23T19:03:43.393805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'54","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.167632+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:56.167632+0000","last_peered":"2024-04-23T19:03:56.167632+0000","last_clean":"2024-04-23T19:03:56.167632+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:56.167632+0000","last_undegraded":"2024-04-23T19:03:56.167632+0000","last_fullsized":"2024-04-23T19:03:56.167632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910939+0000","last_change":"2024-04-23T19:00:17.326327+0000","last_active":"2024-04-23T19:03:43.910939+0000","last_peered":"2024-04-23T19:03:43.910939+0000","last_clean":"2024-04-23T19:03:43.910939+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:03:43.910939+0000","last_undegraded":"2024-04-23T19:03:43.910939+0000","last_fullsized":"2024-04-23T19:03:43.910939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'38","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.214165+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:56.214165+0000","last_peered":"2024-04-23T19:03:56.214165+0000","last_clean":"2024-04-23T19:03:56.214165+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:56.214165+0000","last_undegraded":"2024-04-23T19:03:56.214165+0000","last_fullsized":"2024-04-23T19:03:56.214165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908899+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908899+0000","last_peered":"2024-04-23T19:03:43.908899+0000","last_clean":"2024-04-23T19:03:43.908899+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908899+0000","last_undegraded":"2024-04-23T19:03:43.908899+0000","last_fullsized":"2024-04-23T19:03:43.908899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391555+0000","last_change":"2024-04-23T19:00:17.297911+0000","last_active":"2024-04-23T19:03:43.391555+0000","last_peered":"2024-04-23T19:03:43.391555+0000","last_clean":"2024-04-23T19:03:43.391555+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:03:43.391555+0000","last_undegraded":"2024-04-23T19:03:43.391555+0000","last_fullsized":"2024-04-23T19:03:43.391555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'48","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.216507+0000","last_change":"2024-04-23T19:00:55.483107+0000","last_active":"2024-04-23T19:03:56.216507+0000","last_peered":"2024-04-23T19:03:56.216507+0000","last_clean":"2024-04-23T19:03:56.216507+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:03:56.216507+0000","last_undegraded":"2024-04-23T19:03:56.216507+0000","last_fullsized":"2024-04-23T19:03:56.216507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389854+0000","last_change":"2024-04-23T19:00:19.296673+0000","last_active":"2024-04-23T19:03:43.389854+0000","last_peered":"2024-04-23T19:03:43.389854+0000","last_clean":"2024-04-23T19:03:43.389854+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:03:43.389854+0000","last_undegraded":"2024-04-23T19:03:43.389854+0000","last_fullsized":"2024-04-23T19:03:43.389854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'22","reported_seq":142,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.339534+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:55.339534+0000","last_peered":"2024-04-23T19:03:55.339534+0000","last_clean":"2024-04-23T19:03:55.339534+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:55.339534+0000","last_undegraded":"2024-04-23T19:03:55.339534+0000","last_fullsized":"2024-04-23T19:03:55.339534+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114445+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114445+0000","last_peered":"2024-04-23T19:03:44.114445+0000","last_clean":"2024-04-23T19:03:44.114445+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114445+0000","last_undegraded":"2024-04-23T19:03:44.114445+0000","last_fullsized":"2024-04-23T19:03:44.114445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:37.529548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388011+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.388011+0000","last_peered":"2024-04-23T19:03:43.388011+0000","last_clean":"2024-04-23T19:03:43.388011+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.388011+0000","last_undegraded":"2024-04-23T19:03:43.388011+0000","last_fullsized":"2024-04-23T19:03:43.388011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390344+0000","last_change":"2024-04-23T19:00:17.317551+0000","last_active":"2024-04-23T19:03:43.390344+0000","last_peered":"2024-04-23T19:03:43.390344+0000","last_clean":"2024-04-23T19:03:43.390344+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:03:43.390344+0000","last_undegraded":"2024-04-23T19:03:43.390344+0000","last_fullsized":"2024-04-23T19:03:43.390344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'62","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.236094+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:56.236094+0000","last_peered":"2024-04-23T19:03:56.236094+0000","last_clean":"2024-04-23T19:03:56.236094+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:56.236094+0000","last_undegraded":"2024-04-23T19:03:56.236094+0000","last_fullsized":"2024-04-23T19:03:56.236094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391321+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391321+0000","last_peered":"2024-04-23T19:03:43.391321+0000","last_clean":"2024-04-23T19:03:43.391321+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391321+0000","last_undegraded":"2024-04-23T19:03:43.391321+0000","last_fullsized":"2024-04-23T19:03:43.391321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911576+0000","last_change":"2024-04-23T19:00:21.301048+0000","last_active":"2024-04-23T19:03:43.911576+0000","last_peered":"2024-04-23T19:03:43.911576+0000","last_clean":"2024-04-23T19:03:43.911576+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:03:43.911576+0000","last_undegraded":"2024-04-23T19:03:43.911576+0000","last_fullsized":"2024-04-23T19:03:43.911576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910408+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910408+0000","last_peered":"2024-04-23T19:03:43.910408+0000","last_clean":"2024-04-23T19:03:43.910408+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910408+0000","last_undegraded":"2024-04-23T19:03:43.910408+0000","last_fullsized":"2024-04-23T19:03:43.910408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112437+0000","last_change":"2024-04-23T19:00:25.341816+0000","last_active":"2024-04-23T19:03:44.112437+0000","last_peered":"2024-04-23T19:03:44.112437+0000","last_clean":"2024-04-23T19:03:44.112437+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:03:44.112437+0000","last_undegraded":"2024-04-23T19:03:44.112437+0000","last_fullsized":"2024-04-23T19:03:44.112437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114288+0000","last_change":"2024-04-23T19:00:17.302942+0000","last_active":"2024-04-23T19:03:44.114288+0000","last_peered":"2024-04-23T19:03:44.114288+0000","last_clean":"2024-04-23T19:03:44.114288+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:03:44.114288+0000","last_undegraded":"2024-04-23T19:03:44.114288+0000","last_fullsized":"2024-04-23T19:03:44.114288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'44","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.116481+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:56.116481+0000","last_peered":"2024-04-23T19:03:56.116481+0000","last_clean":"2024-04-23T19:03:56.116481+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:56.116481+0000","last_undegraded":"2024-04-23T19:03:56.116481+0000","last_fullsized":"2024-04-23T19:03:56.116481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:49.221504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393580+0000","last_change":"2024-04-23T19:00:19.300752+0000","last_active":"2024-04-23T19:03:43.393580+0000","last_peered":"2024-04-23T19:03:43.393580+0000","last_clean":"2024-04-23T19:03:43.393580+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:03:43.393580+0000","last_undegraded":"2024-04-23T19:03:43.393580+0000","last_fullsized":"2024-04-23T19:03:43.393580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393636+0000","last_change":"2024-04-23T19:00:21.309464+0000","last_active":"2024-04-23T19:03:43.393636+0000","last_peered":"2024-04-23T19:03:43.393636+0000","last_clean":"2024-04-23T19:03:43.393636+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:03:43.393636+0000","last_undegraded":"2024-04-23T19:03:43.393636+0000","last_fullsized":"2024-04-23T19:03:43.393636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'138","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.188513+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:55.188513+0000","last_peered":"2024-04-23T19:03:55.188513+0000","last_clean":"2024-04-23T19:03:55.188513+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:55.188513+0000","last_undegraded":"2024-04-23T19:03:55.188513+0000","last_fullsized":"2024-04-23T19:03:55.188513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:04.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909813+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909813+0000","last_peered":"2024-04-23T19:03:43.909813+0000","last_clean":"2024-04-23T19:03:43.909813+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909813+0000","last_undegraded":"2024-04-23T19:03:43.909813+0000","last_fullsized":"2024-04-23T19:03:43.909813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393202+0000","last_change":"2024-04-23T19:00:17.304587+0000","last_active":"2024-04-23T19:03:43.393202+0000","last_peered":"2024-04-23T19:03:43.393202+0000","last_clean":"2024-04-23T19:03:43.393202+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:03:43.393202+0000","last_undegraded":"2024-04-23T19:03:43.393202+0000","last_fullsized":"2024-04-23T19:03:43.393202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'48","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.241951+0000","last_change":"2024-04-23T19:00:15.261591+0000","last_active":"2024-04-23T19:03:56.241951+0000","last_peered":"2024-04-23T19:03:56.241951+0000","last_clean":"2024-04-23T19:03:56.241951+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:03:56.241951+0000","last_undegraded":"2024-04-23T19:03:56.241951+0000","last_fullsized":"2024-04-23T19:03:56.241951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:59.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389572+0000","last_change":"2024-04-23T19:00:19.287616+0000","last_active":"2024-04-23T19:03:43.389572+0000","last_peered":"2024-04-23T19:03:43.389572+0000","last_clean":"2024-04-23T19:03:43.389572+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:03:43.389572+0000","last_undegraded":"2024-04-23T19:03:43.389572+0000","last_fullsized":"2024-04-23T19:03:43.389572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'20","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.304090+0000","last_change":"2024-04-23T19:00:21.307509+0000","last_active":"2024-04-23T19:03:55.304090+0000","last_peered":"2024-04-23T19:03:55.304090+0000","last_clean":"2024-04-23T19:03:55.304090+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:03:55.304090+0000","last_undegraded":"2024-04-23T19:03:55.304090+0000","last_fullsized":"2024-04-23T19:03:55.304090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:02.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'138","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.848142+0000","last_change":"2024-04-23T19:04:01.848166+0000","last_active":"2024-04-23T19:04:01.848142+0000","last_peered":"2024-04-23T19:04:01.848142+0000","last_clean":"2024-04-23T19:04:01.848142+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:04:01.848142+0000","last_undegraded":"2024-04-23T19:04:01.848142+0000","last_fullsized":"2024-04-23T19:04:01.848142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.848048+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:05.290229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388612+0000","last_change":"2024-04-23T19:00:17.314814+0000","last_active":"2024-04-23T19:03:43.388612+0000","last_peered":"2024-04-23T19:03:43.388612+0000","last_clean":"2024-04-23T19:03:43.388612+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:03:43.388612+0000","last_undegraded":"2024-04-23T19:03:43.388612+0000","last_fullsized":"2024-04-23T19:03:43.388612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'58","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.232296+0000","last_change":"2024-04-23T19:00:15.288380+0000","last_active":"2024-04-23T19:03:56.232296+0000","last_peered":"2024-04-23T19:03:56.232296+0000","last_clean":"2024-04-23T19:03:56.232296+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:03:56.232296+0000","last_undegraded":"2024-04-23T19:03:56.232296+0000","last_fullsized":"2024-04-23T19:03:56.232296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:22.178606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"25'1","reported_seq":283,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.140745+0000","last_change":"2024-04-23T19:00:19.309369+0000","last_active":"2024-04-23T19:03:55.140745+0000","last_peered":"2024-04-23T19:03:55.140745+0000","last_clean":"2024-04-23T19:03:55.140745+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:03:55.140745+0000","last_undegraded":"2024-04-23T19:03:55.140745+0000","last_fullsized":"2024-04-23T19:03:55.140745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:21.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'30","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.943352+0000","last_change":"2024-04-23T19:00:21.320860+0000","last_active":"2024-04-23T19:03:55.943352+0000","last_peered":"2024-04-23T19:03:55.943352+0000","last_clean":"2024-04-23T19:03:55.943352+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:03:55.943352+0000","last_undegraded":"2024-04-23T19:03:55.943352+0000","last_fullsized":"2024-04-23T19:03:55.943352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113465+0000","last_change":"2024-04-23T19:00:23.322843+0000","last_active":"2024-04-23T19:03:44.113465+0000","last_peered":"2024-04-23T19:03:44.113465+0000","last_clean":"2024-04-23T19:03:44.113465+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:03:44.113465+0000","last_undegraded":"2024-04-23T19:03:44.113465+0000","last_fullsized":"2024-04-23T19:03:44.113465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388884+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388884+0000","last_peered":"2024-04-23T19:03:43.388884+0000","last_clean":"2024-04-23T19:03:43.388884+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388884+0000","last_undegraded":"2024-04-23T19:03:43.388884+0000","last_fullsized":"2024-04-23T19:03:43.388884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909583+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909583+0000","last_peered":"2024-04-23T19:03:43.909583+0000","last_clean":"2024-04-23T19:03:43.909583+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909583+0000","last_undegraded":"2024-04-23T19:03:43.909583+0000","last_fullsized":"2024-04-23T19:03:43.909583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'62","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.174017+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:56.174017+0000","last_peered":"2024-04-23T19:03:56.174017+0000","last_clean":"2024-04-23T19:03:56.174017+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:56.174017+0000","last_undegraded":"2024-04-23T19:03:56.174017+0000","last_fullsized":"2024-04-23T19:03:56.174017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:12.206627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.996260+0000","last_change":"2024-04-23T19:04:00.996299+0000","last_active":"2024-04-23T19:04:00.996260+0000","last_peered":"2024-04-23T19:04:00.996260+0000","last_clean":"2024-04-23T19:04:00.996260+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:04:00.996260+0000","last_undegraded":"2024-04-23T19:04:00.996260+0000","last_fullsized":"2024-04-23T19:04:00.996260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.996139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.783439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'20","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.286067+0000","last_change":"2024-04-23T19:00:21.305055+0000","last_active":"2024-04-23T19:03:56.286067+0000","last_peered":"2024-04-23T19:03:56.286067+0000","last_clean":"2024-04-23T19:03:56.286067+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:03:56.286067+0000","last_undegraded":"2024-04-23T19:03:56.286067+0000","last_fullsized":"2024-04-23T19:03:56.286067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390864+0000","last_change":"2024-04-23T19:00:23.340898+0000","last_active":"2024-04-23T19:03:43.390864+0000","last_peered":"2024-04-23T19:03:43.390864+0000","last_clean":"2024-04-23T19:03:43.390864+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:03:43.390864+0000","last_undegraded":"2024-04-23T19:03:43.390864+0000","last_fullsized":"2024-04-23T19:03:43.390864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708652+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708652+0000","last_peered":"2024-04-23T19:03:43.708652+0000","last_clean":"2024-04-23T19:03:43.708652+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708652+0000","last_undegraded":"2024-04-23T19:03:43.708652+0000","last_fullsized":"2024-04-23T19:03:43.708652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:25.279271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708882+0000","last_change":"2024-04-23T19:00:17.320269+0000","last_active":"2024-04-23T19:03:43.708882+0000","last_peered":"2024-04-23T19:03:43.708882+0000","last_clean":"2024-04-23T19:03:43.708882+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:03:43.708882+0000","last_undegraded":"2024-04-23T19:03:43.708882+0000","last_fullsized":"2024-04-23T19:03:43.708882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:10.517856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'28","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.241801+0000","last_change":"2024-04-23T19:00:15.293575+0000","last_active":"2024-04-23T19:03:56.241801+0000","last_peered":"2024-04-23T19:03:56.241801+0000","last_clean":"2024-04-23T19:03:56.241801+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:03:56.241801+0000","last_undegraded":"2024-04-23T19:03:56.241801+0000","last_fullsized":"2024-04-23T19:03:56.241801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:31.207351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394324+0000","last_change":"2024-04-23T19:00:19.300609+0000","last_active":"2024-04-23T19:03:43.394324+0000","last_peered":"2024-04-23T19:03:43.394324+0000","last_clean":"2024-04-23T19:03:43.394324+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:03:43.394324+0000","last_undegraded":"2024-04-23T19:03:43.394324+0000","last_fullsized":"2024-04-23T19:03:43.394324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'26","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.949138+0000","last_change":"2024-04-23T19:00:21.306404+0000","last_active":"2024-04-23T19:03:55.949138+0000","last_peered":"2024-04-23T19:03:55.949138+0000","last_clean":"2024-04-23T19:03:55.949138+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:03:55.949138+0000","last_undegraded":"2024-04-23T19:03:55.949138+0000","last_fullsized":"2024-04-23T19:03:55.949138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:15.525713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'138","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.328494+0000","last_change":"2024-04-23T19:00:23.327235+0000","last_active":"2024-04-23T19:03:56.328494+0000","last_peered":"2024-04-23T19:03:56.328494+0000","last_clean":"2024-04-23T19:03:56.328494+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:03:56.328494+0000","last_undegraded":"2024-04-23T19:03:56.328494+0000","last_fullsized":"2024-04-23T19:03:56.328494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.400773+0000","last_change":"2024-04-23T19:03:59.400805+0000","last_active":"2024-04-23T19:03:59.400773+0000","last_peered":"2024-04-23T19:03:59.400773+0000","last_clean":"2024-04-23T19:03:59.400773+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:59.400773+0000","last_undegraded":"2024-04-23T19:03:59.400773+0000","last_fullsized":"2024-04-23T19:03:59.400773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_clean_scrub_stamp":"2024-04-23T19:03:59.400658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:02.291518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114010+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.114010+0000","last_peered":"2024-04-23T19:03:44.114010+0000","last_clean":"2024-04-23T19:03:44.114010+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.114010+0000","last_undegraded":"2024-04-23T19:03:44.114010+0000","last_fullsized":"2024-04-23T19:03:44.114010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'36","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.241117+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:56.241117+0000","last_peered":"2024-04-23T19:03:56.241117+0000","last_clean":"2024-04-23T19:03:56.241117+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:56.241117+0000","last_undegraded":"2024-04-23T19:03:56.241117+0000","last_fullsized":"2024-04-23T19:03:56.241117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393427+0000","last_change":"2024-04-23T19:00:19.303457+0000","last_active":"2024-04-23T19:03:43.393427+0000","last_peered":"2024-04-23T19:03:43.393427+0000","last_clean":"2024-04-23T19:03:43.393427+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:03:43.393427+0000","last_undegraded":"2024-04-23T19:03:43.393427+0000","last_fullsized":"2024-04-23T19:03:43.393427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'37","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.300695+0000","last_change":"2024-04-23T19:00:21.324087+0000","last_active":"2024-04-23T19:03:56.300695+0000","last_peered":"2024-04-23T19:03:56.300695+0000","last_clean":"2024-04-23T19:03:56.300695+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:03:56.300695+0000","last_undegraded":"2024-04-23T19:03:56.300695+0000","last_fullsized":"2024-04-23T19:03:56.300695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389174+0000","last_change":"2024-04-23T19:00:23.340598+0000","last_active":"2024-04-23T19:03:43.389174+0000","last_peered":"2024-04-23T19:03:43.389174+0000","last_clean":"2024-04-23T19:03:43.389174+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:03:43.389174+0000","last_undegraded":"2024-04-23T19:03:43.389174+0000","last_fullsized":"2024-04-23T19:03:43.389174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'8","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115571+0000","last_change":"2024-04-23T19:03:32.295412+0000","last_active":"2024-04-23T19:03:44.115571+0000","last_peered":"2024-04-23T19:03:44.115571+0000","last_clean":"2024-04-23T19:03:44.115571+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:03:44.115571+0000","last_undegraded":"2024-04-23T19:03:44.115571+0000","last_fullsized":"2024-04-23T19:03:44.115571+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911837+0000","last_change":"2024-04-23T19:00:17.311316+0000","last_active":"2024-04-23T19:03:43.911837+0000","last_peered":"2024-04-23T19:03:43.911837+0000","last_clean":"2024-04-23T19:03:43.911837+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:03:43.911837+0000","last_undegraded":"2024-04-23T19:03:43.911837+0000","last_fullsized":"2024-04-23T19:03:43.911837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'42","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.234383+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:56.234383+0000","last_peered":"2024-04-23T19:03:56.234383+0000","last_clean":"2024-04-23T19:03:56.234383+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:56.234383+0000","last_undegraded":"2024-04-23T19:03:56.234383+0000","last_fullsized":"2024-04-23T19:03:56.234383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393951+0000","last_change":"2024-04-23T19:00:19.297503+0000","last_active":"2024-04-23T19:03:43.393951+0000","last_peered":"2024-04-23T19:03:43.393951+0000","last_clean":"2024-04-23T19:03:43.393951+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:03:43.393951+0000","last_undegraded":"2024-04-23T19:03:43.393951+0000","last_fullsized":"2024-04-23T19:03:43.393951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'22","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.304250+0000","last_change":"2024-04-23T19:00:21.305930+0000","last_active":"2024-04-23T19:03:56.304250+0000","last_peered":"2024-04-23T19:03:56.304250+0000","last_clean":"2024-04-23T19:03:56.304250+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:03:56.304250+0000","last_undegraded":"2024-04-23T19:03:56.304250+0000","last_fullsized":"2024-04-23T19:03:56.304250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114550+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114550+0000","last_peered":"2024-04-23T19:03:44.114550+0000","last_clean":"2024-04-23T19:03:44.114550+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114550+0000","last_undegraded":"2024-04-23T19:03:44.114550+0000","last_fullsized":"2024-04-23T19:03:44.114550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388250+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388250+0000","last_peered":"2024-04-23T19:03:43.388250+0000","last_clean":"2024-04-23T19:03:43.388250+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388250+0000","last_undegraded":"2024-04-23T19:03:43.388250+0000","last_fullsized":"2024-04-23T19:03:43.388250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911288+0000","last_change":"2024-04-23T19:00:17.310105+0000","last_active":"2024-04-23T19:03:43.911288+0000","last_peered":"2024-04-23T19:03:43.911288+0000","last_clean":"2024-04-23T19:03:43.911288+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:03:43.911288+0000","last_undegraded":"2024-04-23T19:03:43.911288+0000","last_fullsized":"2024-04-23T19:03:43.911288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'50","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.228645+0000","last_change":"2024-04-23T19:00:15.264188+0000","last_active":"2024-04-23T19:03:56.228645+0000","last_peered":"2024-04-23T19:03:56.228645+0000","last_clean":"2024-04-23T19:03:56.228645+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:03:56.228645+0000","last_undegraded":"2024-04-23T19:03:56.228645+0000","last_fullsized":"2024-04-23T19:03:56.228645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:31.728527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113744+0000","last_change":"2024-04-23T19:03:32.296246+0000","last_active":"2024-04-23T19:03:44.113744+0000","last_peered":"2024-04-23T19:03:44.113744+0000","last_clean":"2024-04-23T19:03:44.113744+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:03:44.113744+0000","last_undegraded":"2024-04-23T19:03:44.113744+0000","last_fullsized":"2024-04-23T19:03:44.113744+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'29","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.275589+0000","last_change":"2024-04-23T19:00:21.295642+0000","last_active":"2024-04-23T19:03:56.275589+0000","last_peered":"2024-04-23T19:03:56.275589+0000","last_clean":"2024-04-23T19:03:56.275589+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:03:56.275589+0000","last_undegraded":"2024-04-23T19:03:56.275589+0000","last_fullsized":"2024-04-23T19:03:56.275589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":146,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":380,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.323430+0000","last_change":"2024-04-23T19:00:23.310959+0000","last_active":"2024-04-23T19:03:56.323430+0000","last_peered":"2024-04-23T19:03:56.323430+0000","last_clean":"2024-04-23T19:03:56.323430+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:03:56.323430+0000","last_undegraded":"2024-04-23T19:03:56.323430+0000","last_fullsized":"2024-04-23T19:03:56.323430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":155,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112728+0000","last_change":"2024-04-23T19:03:32.290672+0000","last_active":"2024-04-23T19:03:44.112728+0000","last_peered":"2024-04-23T19:03:44.112728+0000","last_clean":"2024-04-23T19:03:44.112728+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:03:44.112728+0000","last_undegraded":"2024-04-23T19:03:44.112728+0000","last_fullsized":"2024-04-23T19:03:44.112728+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911824+0000","last_change":"2024-04-23T19:00:17.324287+0000","last_active":"2024-04-23T19:03:43.911824+0000","last_peered":"2024-04-23T19:03:43.911824+0000","last_clean":"2024-04-23T19:03:43.911824+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:03:43.911824+0000","last_undegraded":"2024-04-23T19:03:43.911824+0000","last_fullsized":"2024-04-23T19:03:43.911824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'56","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.247088+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:56.247088+0000","last_peered":"2024-04-23T19:03:56.247088+0000","last_clean":"2024-04-23T19:03:56.247088+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:56.247088+0000","last_undegraded":"2024-04-23T19:03:56.247088+0000","last_fullsized":"2024-04-23T19:03:56.247088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":378,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.176968+0000","last_change":"2024-04-23T19:00:19.285198+0000","last_active":"2024-04-23T19:03:55.176968+0000","last_peered":"2024-04-23T19:03:55.176968+0000","last_clean":"2024-04-23T19:03:55.176968+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:03:55.176968+0000","last_undegraded":"2024-04-23T19:03:55.176968+0000","last_fullsized":"2024-04-23T19:03:55.176968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"98'12","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391034+0000","last_change":"2024-04-23T19:00:21.310014+0000","last_active":"2024-04-23T19:03:43.391034+0000","last_peered":"2024-04-23T19:03:43.391034+0000","last_clean":"2024-04-23T19:03:43.391034+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:03:43.391034+0000","last_undegraded":"2024-04-23T19:03:43.391034+0000","last_fullsized":"2024-04-23T19:03:43.391034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":410,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.192479+0000","last_change":"2024-04-23T19:00:23.326538+0000","last_active":"2024-04-23T19:03:55.192479+0000","last_peered":"2024-04-23T19:03:55.192479+0000","last_clean":"2024-04-23T19:03:55.192479+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:03:55.192479+0000","last_undegraded":"2024-04-23T19:03:55.192479+0000","last_fullsized":"2024-04-23T19:03:55.192479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:42.784441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910253+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910253+0000","last_peered":"2024-04-23T19:03:43.910253+0000","last_clean":"2024-04-23T19:03:43.910253+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910253+0000","last_undegraded":"2024-04-23T19:03:43.910253+0000","last_fullsized":"2024-04-23T19:03:43.910253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115696+0000","last_change":"2024-04-23T19:00:17.306342+0000","last_active":"2024-04-23T19:03:44.115696+0000","last_peered":"2024-04-23T19:03:44.115696+0000","last_clean":"2024-04-23T19:03:44.115696+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:03:44.115696+0000","last_undegraded":"2024-04-23T19:03:44.115696+0000","last_fullsized":"2024-04-23T19:03:44.115696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.261061+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:56.261061+0000","last_peered":"2024-04-23T19:03:56.261061+0000","last_clean":"2024-04-23T19:03:56.261061+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:56.261061+0000","last_undegraded":"2024-04-23T19:03:56.261061+0000","last_fullsized":"2024-04-23T19:03:56.261061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911065+0000","last_change":"2024-04-23T19:00:19.295027+0000","last_active":"2024-04-23T19:03:43.911065+0000","last_peered":"2024-04-23T19:03:43.911065+0000","last_clean":"2024-04-23T19:03:43.911065+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:03:43.911065+0000","last_undegraded":"2024-04-23T19:03:43.911065+0000","last_fullsized":"2024-04-23T19:03:43.911065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'29","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.346683+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:55.346683+0000","last_peered":"2024-04-23T19:03:55.346683+0000","last_clean":"2024-04-23T19:03:55.346683+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:55.346683+0000","last_undegraded":"2024-04-23T19:03:55.346683+0000","last_fullsized":"2024-04-23T19:03:55.346683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708197+0000","last_change":"2024-04-23T19:00:23.320133+0000","last_active":"2024-04-23T19:03:43.708197+0000","last_peered":"2024-04-23T19:03:43.708197+0000","last_clean":"2024-04-23T19:03:43.708197+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:03:43.708197+0000","last_undegraded":"2024-04-23T19:03:43.708197+0000","last_fullsized":"2024-04-23T19:03:43.708197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:18.773360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":153,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709271+0000","last_change":"2024-04-23T19:00:17.315745+0000","last_active":"2024-04-23T19:03:43.709271+0000","last_peered":"2024-04-23T19:03:43.709271+0000","last_clean":"2024-04-23T19:03:43.709271+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:03:43.709271+0000","last_undegraded":"2024-04-23T19:03:43.709271+0000","last_fullsized":"2024-04-23T19:03:43.709271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.167635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113725+0000","last_change":"2024-04-23T19:00:03.635067+0000","last_active":"2024-04-23T19:03:44.113725+0000","last_peered":"2024-04-23T19:03:44.113725+0000","last_clean":"2024-04-23T19:03:44.113725+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:03:44.113725+0000","last_undegraded":"2024-04-23T19:03:44.113725+0000","last_fullsized":"2024-04-23T19:03:44.113725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:02.155506+0000","last_clean_scrub_stamp":"2024-04-23T19:00:02.155506+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:22.935030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389325+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:03:43.389325+0000","last_peered":"2024-04-23T19:03:43.389325+0000","last_clean":"2024-04-23T19:03:43.389325+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:03:43.389325+0000","last_undegraded":"2024-04-23T19:03:43.389325+0000","last_fullsized":"2024-04-23T19:03:43.389325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.260886+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:56.260886+0000","last_peered":"2024-04-23T19:03:56.260886+0000","last_clean":"2024-04-23T19:03:56.260886+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:56.260886+0000","last_undegraded":"2024-04-23T19:03:56.260886+0000","last_fullsized":"2024-04-23T19:03:56.260886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114228+0000","last_change":"2024-04-23T19:00:19.314953+0000","last_active":"2024-04-23T19:03:44.114228+0000","last_peered":"2024-04-23T19:03:44.114228+0000","last_clean":"2024-04-23T19:03:44.114228+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:03:44.114228+0000","last_undegraded":"2024-04-23T19:03:44.114228+0000","last_fullsized":"2024-04-23T19:03:44.114228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:03.301583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'49","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.126086+0000","last_change":"2024-04-23T19:00:21.317082+0000","last_active":"2024-04-23T19:03:56.126086+0000","last_peered":"2024-04-23T19:03:56.126086+0000","last_clean":"2024-04-23T19:03:56.126086+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:03:56.126086+0000","last_undegraded":"2024-04-23T19:03:56.126086+0000","last_fullsized":"2024-04-23T19:03:56.126086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113890+0000","last_change":"2024-04-23T19:00:23.335739+0000","last_active":"2024-04-23T19:03:44.113890+0000","last_peered":"2024-04-23T19:03:44.113890+0000","last_clean":"2024-04-23T19:03:44.113890+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:03:44.113890+0000","last_undegraded":"2024-04-23T19:03:44.113890+0000","last_fullsized":"2024-04-23T19:03:44.113890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707656+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707656+0000","last_peered":"2024-04-23T19:03:43.707656+0000","last_clean":"2024-04-23T19:03:43.707656+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707656+0000","last_undegraded":"2024-04-23T19:03:43.707656+0000","last_fullsized":"2024-04-23T19:03:43.707656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:27.358971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114202+0000","last_change":"2024-04-23T19:00:17.301164+0000","last_active":"2024-04-23T19:03:44.114202+0000","last_peered":"2024-04-23T19:03:44.114202+0000","last_clean":"2024-04-23T19:03:44.114202+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:03:44.114202+0000","last_undegraded":"2024-04-23T19:03:44.114202+0000","last_fullsized":"2024-04-23T19:03:44.114202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113340+0000","last_change":"2024-04-23T19:00:09.199146+0000","last_active":"2024-04-23T19:03:44.113340+0000","last_peered":"2024-04-23T19:03:44.113340+0000","last_clean":"2024-04-23T19:03:44.113340+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:03:44.113340+0000","last_undegraded":"2024-04-23T19:03:44.113340+0000","last_fullsized":"2024-04-23T19:03:44.113340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:02:26.009753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'64","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.258581+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:56.258581+0000","last_peered":"2024-04-23T19:03:56.258581+0000","last_clean":"2024-04-23T19:03:56.258581+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:56.258581+0000","last_undegraded":"2024-04-23T19:03:56.258581+0000","last_fullsized":"2024-04-23T19:03:56.258581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390746+0000","last_change":"2024-04-23T19:00:19.296547+0000","last_active":"2024-04-23T19:03:43.390746+0000","last_peered":"2024-04-23T19:03:43.390746+0000","last_clean":"2024-04-23T19:03:43.390746+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:03:43.390746+0000","last_undegraded":"2024-04-23T19:03:43.390746+0000","last_fullsized":"2024-04-23T19:03:43.390746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'149","reported_seq":455,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.317763+0000","last_change":"2024-04-23T19:00:21.322822+0000","last_active":"2024-04-23T19:03:56.317763+0000","last_peered":"2024-04-23T19:03:56.317763+0000","last_clean":"2024-04-23T19:03:56.317763+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:03:56.317763+0000","last_undegraded":"2024-04-23T19:03:56.317763+0000","last_fullsized":"2024-04-23T19:03:56.317763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114354+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114354+0000","last_peered":"2024-04-23T19:03:44.114354+0000","last_clean":"2024-04-23T19:03:44.114354+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114354+0000","last_undegraded":"2024-04-23T19:03:44.114354+0000","last_fullsized":"2024-04-23T19:03:44.114354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:44:25.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":153,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112359+0000","last_change":"2024-04-23T19:03:32.286556+0000","last_active":"2024-04-23T19:03:44.112359+0000","last_peered":"2024-04-23T19:03:44.112359+0000","last_clean":"2024-04-23T19:03:44.112359+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:03:44.112359+0000","last_undegraded":"2024-04-23T19:03:44.112359+0000","last_fullsized":"2024-04-23T19:03:44.112359+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115768+0000","last_change":"2024-04-23T19:00:17.300587+0000","last_active":"2024-04-23T19:03:44.115768+0000","last_peered":"2024-04-23T19:03:44.115768+0000","last_clean":"2024-04-23T19:03:44.115768+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:03:44.115768+0000","last_undegraded":"2024-04-23T19:03:44.115768+0000","last_fullsized":"2024-04-23T19:03:44.115768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389069+0000","last_change":"2024-04-23T19:00:09.196208+0000","last_active":"2024-04-23T19:03:43.389069+0000","last_peered":"2024-04-23T19:03:43.389069+0000","last_clean":"2024-04-23T19:03:43.389069+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:03:43.389069+0000","last_undegraded":"2024-04-23T19:03:43.389069+0000","last_fullsized":"2024-04-23T19:03:43.389069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'28","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.255892+0000","last_change":"2024-04-23T19:03:32.290315+0000","last_active":"2024-04-23T19:03:56.255892+0000","last_peered":"2024-04-23T19:03:56.255892+0000","last_clean":"2024-04-23T19:03:56.255892+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:03:56.255892+0000","last_undegraded":"2024-04-23T19:03:56.255892+0000","last_fullsized":"2024-04-23T19:03:56.255892+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393997+0000","last_change":"2024-04-23T19:00:19.302374+0000","last_active":"2024-04-23T19:03:43.393997+0000","last_peered":"2024-04-23T19:03:43.393997+0000","last_clean":"2024-04-23T19:03:43.393997+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:03:43.393997+0000","last_undegraded":"2024-04-23T19:03:43.393997+0000","last_fullsized":"2024-04-23T19:03:43.393997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.557716+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:44.557716+0000","last_peered":"2024-04-23T19:03:44.557716+0000","last_clean":"2024-04-23T19:03:44.557716+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:44.557716+0000","last_undegraded":"2024-04-23T19:03:44.557716+0000","last_fullsized":"2024-04-23T19:03:44.557716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:30:45.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113456+0000","last_change":"2024-04-23T19:00:23.329941+0000","last_active":"2024-04-23T19:03:44.113456+0000","last_peered":"2024-04-23T19:03:44.113456+0000","last_clean":"2024-04-23T19:03:44.113456+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:03:44.113456+0000","last_undegraded":"2024-04-23T19:03:44.113456+0000","last_fullsized":"2024-04-23T19:03:44.113456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392445+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392445+0000","last_peered":"2024-04-23T19:03:43.392445+0000","last_clean":"2024-04-23T19:03:43.392445+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392445+0000","last_undegraded":"2024-04-23T19:03:43.392445+0000","last_fullsized":"2024-04-23T19:03:43.392445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113936+0000","last_change":"2024-04-23T19:03:32.300198+0000","last_active":"2024-04-23T19:03:44.113936+0000","last_peered":"2024-04-23T19:03:44.113936+0000","last_clean":"2024-04-23T19:03:44.113936+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:03:44.113936+0000","last_undegraded":"2024-04-23T19:03:44.113936+0000","last_fullsized":"2024-04-23T19:03:44.113936+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389437+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:03:43.389437+0000","last_peered":"2024-04-23T19:03:43.389437+0000","last_clean":"2024-04-23T19:03:43.389437+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:03:43.389437+0000","last_undegraded":"2024-04-23T19:03:43.389437+0000","last_fullsized":"2024-04-23T19:03:43.389437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'36","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.245101+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:56.245101+0000","last_peered":"2024-04-23T19:03:56.245101+0000","last_clean":"2024-04-23T19:03:56.245101+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:56.245101+0000","last_undegraded":"2024-04-23T19:03:56.245101+0000","last_fullsized":"2024-04-23T19:03:56.245101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"25'1","reported_seq":283,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.177873+0000","last_change":"2024-04-23T19:00:19.306260+0000","last_active":"2024-04-23T19:03:55.177873+0000","last_peered":"2024-04-23T19:03:55.177873+0000","last_clean":"2024-04-23T19:03:55.177873+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:03:55.177873+0000","last_undegraded":"2024-04-23T19:03:55.177873+0000","last_fullsized":"2024-04-23T19:03:55.177873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393136+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393136+0000","last_peered":"2024-04-23T19:03:43.393136+0000","last_clean":"2024-04-23T19:03:43.393136+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393136+0000","last_undegraded":"2024-04-23T19:03:43.393136+0000","last_fullsized":"2024-04-23T19:03:43.393136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709817+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709817+0000","last_peered":"2024-04-23T19:03:43.709817+0000","last_clean":"2024-04-23T19:03:43.709817+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709817+0000","last_undegraded":"2024-04-23T19:03:43.709817+0000","last_fullsized":"2024-04-23T19:03:43.709817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:07.315848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387779+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387779+0000","last_peered":"2024-04-23T19:03:43.387779+0000","last_clean":"2024-04-23T19:03:43.387779+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387779+0000","last_undegraded":"2024-04-23T19:03:43.387779+0000","last_fullsized":"2024-04-23T19:03:43.387779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":165,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113496+0000","last_change":"2024-04-23T19:03:32.295129+0000","last_active":"2024-04-23T19:03:44.113496+0000","last_peered":"2024-04-23T19:03:44.113496+0000","last_clean":"2024-04-23T19:03:44.113496+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:03:44.113496+0000","last_undegraded":"2024-04-23T19:03:44.113496+0000","last_fullsized":"2024-04-23T19:03:44.113496+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.297757+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:56.297757+0000","last_peered":"2024-04-23T19:03:56.297757+0000","last_clean":"2024-04-23T19:03:56.297757+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:56.297757+0000","last_undegraded":"2024-04-23T19:03:56.297757+0000","last_fullsized":"2024-04-23T19:03:56.297757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.435942+0000","last_change":"2024-04-23T19:04:00.435963+0000","last_active":"2024-04-23T19:04:00.435942+0000","last_peered":"2024-04-23T19:04:00.435942+0000","last_clean":"2024-04-23T19:04:00.435942+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:04:00.435942+0000","last_undegraded":"2024-04-23T19:04:00.435942+0000","last_fullsized":"2024-04-23T19:04:00.435942+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.435859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:34.052330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113643+0000","last_change":"2024-04-23T19:00:19.304919+0000","last_active":"2024-04-23T19:03:44.113643+0000","last_peered":"2024-04-23T19:03:44.113643+0000","last_clean":"2024-04-23T19:03:44.113643+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:03:44.113643+0000","last_undegraded":"2024-04-23T19:03:44.113643+0000","last_fullsized":"2024-04-23T19:03:44.113643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'40","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.132365+0000","last_change":"2024-04-23T19:00:21.317104+0000","last_active":"2024-04-23T19:03:56.132365+0000","last_peered":"2024-04-23T19:03:56.132365+0000","last_clean":"2024-04-23T19:03:56.132365+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:03:56.132365+0000","last_undegraded":"2024-04-23T19:03:56.132365+0000","last_fullsized":"2024-04-23T19:03:56.132365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909053+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.909053+0000","last_peered":"2024-04-23T19:03:43.909053+0000","last_clean":"2024-04-23T19:03:43.909053+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.909053+0000","last_undegraded":"2024-04-23T19:03:43.909053+0000","last_fullsized":"2024-04-23T19:03:43.909053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.379144+0000","last_change":"2024-04-23T19:04:01.379184+0000","last_active":"2024-04-23T19:04:01.379144+0000","last_peered":"2024-04-23T19:04:01.379144+0000","last_clean":"2024-04-23T19:04:01.379144+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:04:01.379144+0000","last_undegraded":"2024-04-23T19:04:01.379144+0000","last_fullsized":"2024-04-23T19:04:01.379144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.379039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:04.821220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113916+0000","last_change":"2024-04-23T19:00:17.317599+0000","last_active":"2024-04-23T19:03:44.113916+0000","last_peered":"2024-04-23T19:03:44.113916+0000","last_clean":"2024-04-23T19:03:44.113916+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:03:44.113916+0000","last_undegraded":"2024-04-23T19:03:44.113916+0000","last_fullsized":"2024-04-23T19:03:44.113916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'44","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.161909+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:56.161909+0000","last_peered":"2024-04-23T19:03:56.161909+0000","last_clean":"2024-04-23T19:03:56.161909+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:56.161909+0000","last_undegraded":"2024-04-23T19:03:56.161909+0000","last_fullsized":"2024-04-23T19:03:56.161909+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115650+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:03:44.115650+0000","last_peered":"2024-04-23T19:03:44.115650+0000","last_clean":"2024-04-23T19:03:44.115650+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:03:44.115650+0000","last_undegraded":"2024-04-23T19:03:44.115650+0000","last_fullsized":"2024-04-23T19:03:44.115650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:24.965888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708440+0000","last_change":"2024-04-23T19:00:19.307974+0000","last_active":"2024-04-23T19:03:43.708440+0000","last_peered":"2024-04-23T19:03:43.708440+0000","last_clean":"2024-04-23T19:03:43.708440+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:03:43.708440+0000","last_undegraded":"2024-04-23T19:03:43.708440+0000","last_fullsized":"2024-04-23T19:03:43.708440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.679492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112419+0000","last_change":"2024-04-23T19:03:32.300841+0000","last_active":"2024-04-23T19:03:44.112419+0000","last_peered":"2024-04-23T19:03:44.112419+0000","last_clean":"2024-04-23T19:03:44.112419+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:03:44.112419+0000","last_undegraded":"2024-04-23T19:03:44.112419+0000","last_fullsized":"2024-04-23T19:03:44.112419+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'138","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.319871+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:56.319871+0000","last_peered":"2024-04-23T19:03:56.319871+0000","last_clean":"2024-04-23T19:03:56.319871+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:56.319871+0000","last_undegraded":"2024-04-23T19:03:56.319871+0000","last_fullsized":"2024-04-23T19:03:56.319871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393352+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393352+0000","last_peered":"2024-04-23T19:03:43.393352+0000","last_clean":"2024-04-23T19:03:43.393352+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393352+0000","last_undegraded":"2024-04-23T19:03:43.393352+0000","last_fullsized":"2024-04-23T19:03:43.393352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391150+0000","last_change":"2024-04-23T19:00:17.304043+0000","last_active":"2024-04-23T19:03:43.391150+0000","last_peered":"2024-04-23T19:03:43.391150+0000","last_clean":"2024-04-23T19:03:43.391150+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:03:43.391150+0000","last_undegraded":"2024-04-23T19:03:43.391150+0000","last_fullsized":"2024-04-23T19:03:43.391150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'40","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.219803+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:56.219803+0000","last_peered":"2024-04-23T19:03:56.219803+0000","last_clean":"2024-04-23T19:03:56.219803+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:56.219803+0000","last_undegraded":"2024-04-23T19:03:56.219803+0000","last_fullsized":"2024-04-23T19:03:56.219803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115572+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115572+0000","last_peered":"2024-04-23T19:03:44.115572+0000","last_clean":"2024-04-23T19:03:44.115572+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115572+0000","last_undegraded":"2024-04-23T19:03:44.115572+0000","last_fullsized":"2024-04-23T19:03:44.115572+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909271+0000","last_change":"2024-04-23T19:00:19.289666+0000","last_active":"2024-04-23T19:03:43.909271+0000","last_peered":"2024-04-23T19:03:43.909271+0000","last_clean":"2024-04-23T19:03:43.909271+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:03:43.909271+0000","last_undegraded":"2024-04-23T19:03:43.909271+0000","last_fullsized":"2024-04-23T19:03:43.909271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910740+0000","last_change":"2024-04-23T19:00:21.299974+0000","last_active":"2024-04-23T19:03:43.910740+0000","last_peered":"2024-04-23T19:03:43.910740+0000","last_clean":"2024-04-23T19:03:43.910740+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:03:43.910740+0000","last_undegraded":"2024-04-23T19:03:43.910740+0000","last_fullsized":"2024-04-23T19:03:43.910740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'138","reported_seq":443,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.325890+0000","last_change":"2024-04-23T19:00:23.311929+0000","last_active":"2024-04-23T19:03:56.325890+0000","last_peered":"2024-04-23T19:03:56.325890+0000","last_clean":"2024-04-23T19:03:56.325890+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:03:56.325890+0000","last_undegraded":"2024-04-23T19:03:56.325890+0000","last_fullsized":"2024-04-23T19:03:56.325890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":123,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.956744+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:56.956744+0000","last_peered":"2024-04-23T19:03:56.956744+0000","last_clean":"2024-04-23T19:03:56.956744+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:56.956744+0000","last_undegraded":"2024-04-23T19:03:56.956744+0000","last_fullsized":"2024-04-23T19:03:56.956744+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909543+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909543+0000","last_peered":"2024-04-23T19:03:43.909543+0000","last_clean":"2024-04-23T19:03:43.909543+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909543+0000","last_undegraded":"2024-04-23T19:03:43.909543+0000","last_fullsized":"2024-04-23T19:03:43.909543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'44","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.258728+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:56.258728+0000","last_peered":"2024-04-23T19:03:56.258728+0000","last_clean":"2024-04-23T19:03:56.258728+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:56.258728+0000","last_undegraded":"2024-04-23T19:03:56.258728+0000","last_fullsized":"2024-04-23T19:03:56.258728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710129+0000","last_change":"2024-04-23T19:00:09.200026+0000","last_active":"2024-04-23T19:03:43.710129+0000","last_peered":"2024-04-23T19:03:43.710129+0000","last_clean":"2024-04-23T19:03:43.710129+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:03:43.710129+0000","last_undegraded":"2024-04-23T19:03:43.710129+0000","last_fullsized":"2024-04-23T19:03:43.710129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:28.954348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390917+0000","last_change":"2024-04-23T19:00:19.297952+0000","last_active":"2024-04-23T19:03:43.390917+0000","last_peered":"2024-04-23T19:03:43.390917+0000","last_clean":"2024-04-23T19:03:43.390917+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:03:43.390917+0000","last_undegraded":"2024-04-23T19:03:43.390917+0000","last_fullsized":"2024-04-23T19:03:43.390917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'52","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.291540+0000","last_change":"2024-04-23T19:00:21.313684+0000","last_active":"2024-04-23T19:03:56.291540+0000","last_peered":"2024-04-23T19:03:56.291540+0000","last_clean":"2024-04-23T19:03:56.291540+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:03:56.291540+0000","last_undegraded":"2024-04-23T19:03:56.291540+0000","last_fullsized":"2024-04-23T19:03:56.291540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:02.239678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.832684+0000","last_change":"2024-04-23T19:04:00.832735+0000","last_active":"2024-04-23T19:04:00.832684+0000","last_peered":"2024-04-23T19:04:00.832684+0000","last_clean":"2024-04-23T19:04:00.832684+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:04:00.832684+0000","last_undegraded":"2024-04-23T19:04:00.832684+0000","last_fullsized":"2024-04-23T19:04:00.832684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.832522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:03.723382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389004+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.389004+0000","last_peered":"2024-04-23T19:03:43.389004+0000","last_clean":"2024-04-23T19:03:43.389004+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.389004+0000","last_undegraded":"2024-04-23T19:03:43.389004+0000","last_fullsized":"2024-04-23T19:03:43.389004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.361353+0000","last_change":"2024-04-23T19:04:00.361389+0000","last_active":"2024-04-23T19:04:00.361353+0000","last_peered":"2024-04-23T19:04:00.361353+0000","last_clean":"2024-04-23T19:04:00.361353+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:04:00.361353+0000","last_undegraded":"2024-04-23T19:04:00.361353+0000","last_fullsized":"2024-04-23T19:04:00.361353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.361115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:00.899277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909987+0000","last_change":"2024-04-23T19:00:17.324843+0000","last_active":"2024-04-23T19:03:43.909987+0000","last_peered":"2024-04-23T19:03:43.909987+0000","last_clean":"2024-04-23T19:03:43.909987+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:03:43.909987+0000","last_undegraded":"2024-04-23T19:03:43.909987+0000","last_fullsized":"2024-04-23T19:03:43.909987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'42","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.225378+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:56.225378+0000","last_peered":"2024-04-23T19:03:56.225378+0000","last_clean":"2024-04-23T19:03:56.225378+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:56.225378+0000","last_undegraded":"2024-04-23T19:03:56.225378+0000","last_fullsized":"2024-04-23T19:03:56.225378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113579+0000","last_change":"2024-04-23T19:03:32.294993+0000","last_active":"2024-04-23T19:03:44.113579+0000","last_peered":"2024-04-23T19:03:44.113579+0000","last_clean":"2024-04-23T19:03:44.113579+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:03:44.113579+0000","last_undegraded":"2024-04-23T19:03:44.113579+0000","last_fullsized":"2024-04-23T19:03:44.113579+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'22","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.946884+0000","last_change":"2024-04-23T19:00:21.318256+0000","last_active":"2024-04-23T19:03:55.946884+0000","last_peered":"2024-04-23T19:03:55.946884+0000","last_clean":"2024-04-23T19:03:55.946884+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:03:55.946884+0000","last_undegraded":"2024-04-23T19:03:55.946884+0000","last_fullsized":"2024-04-23T19:03:55.946884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390660+0000","last_change":"2024-04-23T19:00:23.312398+0000","last_active":"2024-04-23T19:03:43.390660+0000","last_peered":"2024-04-23T19:03:43.390660+0000","last_clean":"2024-04-23T19:03:43.390660+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:03:43.390660+0000","last_undegraded":"2024-04-23T19:03:43.390660+0000","last_fullsized":"2024-04-23T19:03:43.390660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392846+0000","last_change":"2024-04-23T19:00:25.334907+0000","last_active":"2024-04-23T19:03:43.392846+0000","last_peered":"2024-04-23T19:03:43.392846+0000","last_clean":"2024-04-23T19:03:43.392846+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:03:43.392846+0000","last_undegraded":"2024-04-23T19:03:43.392846+0000","last_fullsized":"2024-04-23T19:03:43.392846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":165,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113475+0000","last_change":"2024-04-23T19:03:32.300516+0000","last_active":"2024-04-23T19:03:44.113475+0000","last_peered":"2024-04-23T19:03:44.113475+0000","last_clean":"2024-04-23T19:03:44.113475+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:03:44.113475+0000","last_undegraded":"2024-04-23T19:03:44.113475+0000","last_fullsized":"2024-04-23T19:03:44.113475+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'66","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.266965+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:56.266965+0000","last_peered":"2024-04-23T19:03:56.266965+0000","last_clean":"2024-04-23T19:03:56.266965+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:56.266965+0000","last_undegraded":"2024-04-23T19:03:56.266965+0000","last_fullsized":"2024-04-23T19:03:56.266965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:51.187342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392308+0000","last_change":"2024-04-23T19:00:19.301544+0000","last_active":"2024-04-23T19:03:43.392308+0000","last_peered":"2024-04-23T19:03:43.392308+0000","last_clean":"2024-04-23T19:03:43.392308+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:03:43.392308+0000","last_undegraded":"2024-04-23T19:03:43.392308+0000","last_fullsized":"2024-04-23T19:03:43.392308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"100'10","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112806+0000","last_change":"2024-04-23T19:00:21.315513+0000","last_active":"2024-04-23T19:03:44.112806+0000","last_peered":"2024-04-23T19:03:44.112806+0000","last_clean":"2024-04-23T19:03:44.112806+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:03:44.112806+0000","last_undegraded":"2024-04-23T19:03:44.112806+0000","last_fullsized":"2024-04-23T19:03:44.112806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113317+0000","last_change":"2024-04-23T19:00:23.327884+0000","last_active":"2024-04-23T19:03:44.113317+0000","last_peered":"2024-04-23T19:03:44.113317+0000","last_clean":"2024-04-23T19:03:44.113317+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:03:44.113317+0000","last_undegraded":"2024-04-23T19:03:44.113317+0000","last_fullsized":"2024-04-23T19:03:44.113317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:29.636613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":122,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113744+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:44.113744+0000","last_peered":"2024-04-23T19:03:44.113744+0000","last_clean":"2024-04-23T19:03:44.113744+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:44.113744+0000","last_undegraded":"2024-04-23T19:03:44.113744+0000","last_fullsized":"2024-04-23T19:03:44.113744+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390061+0000","last_change":"2024-04-23T19:00:17.304182+0000","last_active":"2024-04-23T19:03:43.390061+0000","last_peered":"2024-04-23T19:03:43.390061+0000","last_clean":"2024-04-23T19:03:43.390061+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:03:43.390061+0000","last_undegraded":"2024-04-23T19:03:43.390061+0000","last_fullsized":"2024-04-23T19:03:43.390061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.224828+0000","last_change":"2024-04-23T19:00:15.272317+0000","last_active":"2024-04-23T19:03:56.224828+0000","last_peered":"2024-04-23T19:03:56.224828+0000","last_clean":"2024-04-23T19:03:56.224828+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:03:56.224828+0000","last_undegraded":"2024-04-23T19:03:56.224828+0000","last_fullsized":"2024-04-23T19:03:56.224828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112637+0000","last_change":"2024-04-23T19:00:19.309130+0000","last_active":"2024-04-23T19:03:44.112637+0000","last_peered":"2024-04-23T19:03:44.112637+0000","last_clean":"2024-04-23T19:03:44.112637+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:03:44.112637+0000","last_undegraded":"2024-04-23T19:03:44.112637+0000","last_fullsized":"2024-04-23T19:03:44.112637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:14.759095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'25","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.298760+0000","last_change":"2024-04-23T19:00:21.318264+0000","last_active":"2024-04-23T19:03:55.298760+0000","last_peered":"2024-04-23T19:03:55.298760+0000","last_clean":"2024-04-23T19:03:55.298760+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:03:55.298760+0000","last_undegraded":"2024-04-23T19:03:55.298760+0000","last_fullsized":"2024-04-23T19:03:55.298760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708373+0000","last_change":"2024-04-23T19:00:23.331913+0000","last_active":"2024-04-23T19:03:43.708373+0000","last_peered":"2024-04-23T19:03:43.708373+0000","last_clean":"2024-04-23T19:03:43.708373+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:03:43.708373+0000","last_undegraded":"2024-04-23T19:03:43.708373+0000","last_fullsized":"2024-04-23T19:03:43.708373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:43.508504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388539+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388539+0000","last_peered":"2024-04-23T19:03:43.388539+0000","last_clean":"2024-04-23T19:03:43.388539+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388539+0000","last_undegraded":"2024-04-23T19:03:43.388539+0000","last_fullsized":"2024-04-23T19:03:43.388539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391375+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391375+0000","last_peered":"2024-04-23T19:03:43.391375+0000","last_clean":"2024-04-23T19:03:43.391375+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391375+0000","last_undegraded":"2024-04-23T19:03:43.391375+0000","last_fullsized":"2024-04-23T19:03:43.391375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'56","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.248121+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:56.248121+0000","last_peered":"2024-04-23T19:03:56.248121+0000","last_clean":"2024-04-23T19:03:56.248121+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:56.248121+0000","last_undegraded":"2024-04-23T19:03:56.248121+0000","last_fullsized":"2024-04-23T19:03:56.248121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708231+0000","last_change":"2024-04-23T19:00:19.306444+0000","last_active":"2024-04-23T19:03:43.708231+0000","last_peered":"2024-04-23T19:03:43.708231+0000","last_clean":"2024-04-23T19:03:43.708231+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:03:43.708231+0000","last_undegraded":"2024-04-23T19:03:43.708231+0000","last_fullsized":"2024-04-23T19:03:43.708231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:26:48.856224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'20","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.309991+0000","last_change":"2024-04-23T19:00:21.306997+0000","last_active":"2024-04-23T19:03:56.309991+0000","last_peered":"2024-04-23T19:03:56.309991+0000","last_clean":"2024-04-23T19:03:56.309991+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:03:56.309991+0000","last_undegraded":"2024-04-23T19:03:56.309991+0000","last_fullsized":"2024-04-23T19:03:56.309991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.323670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113449+0000","last_change":"2024-04-23T19:00:23.330859+0000","last_active":"2024-04-23T19:03:44.113449+0000","last_peered":"2024-04-23T19:03:44.113449+0000","last_clean":"2024-04-23T19:03:44.113449+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:03:44.113449+0000","last_undegraded":"2024-04-23T19:03:44.113449+0000","last_fullsized":"2024-04-23T19:03:44.113449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.710040+0000","last_change":"2024-04-23T19:00:17.309566+0000","last_active":"2024-04-23T19:03:43.710040+0000","last_peered":"2024-04-23T19:03:43.710040+0000","last_clean":"2024-04-23T19:03:43.710040+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:03:43.710040+0000","last_undegraded":"2024-04-23T19:03:43.710040+0000","last_fullsized":"2024-04-23T19:03:43.710040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:12.410116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'40","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.263597+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:56.263597+0000","last_peered":"2024-04-23T19:03:56.263597+0000","last_clean":"2024-04-23T19:03:56.263597+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:56.263597+0000","last_undegraded":"2024-04-23T19:03:56.263597+0000","last_fullsized":"2024-04-23T19:03:56.263597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113970+0000","last_change":"2024-04-23T19:00:19.300873+0000","last_active":"2024-04-23T19:03:44.113970+0000","last_peered":"2024-04-23T19:03:44.113970+0000","last_clean":"2024-04-23T19:03:44.113970+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:03:44.113970+0000","last_undegraded":"2024-04-23T19:03:44.113970+0000","last_fullsized":"2024-04-23T19:03:44.113970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'36","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.308064+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:56.308064+0000","last_peered":"2024-04-23T19:03:56.308064+0000","last_clean":"2024-04-23T19:03:56.308064+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:56.308064+0000","last_undegraded":"2024-04-23T19:03:56.308064+0000","last_fullsized":"2024-04-23T19:03:56.308064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389505+0000","last_change":"2024-04-23T19:00:23.310793+0000","last_active":"2024-04-23T19:03:43.389505+0000","last_peered":"2024-04-23T19:03:43.389505+0000","last_clean":"2024-04-23T19:03:43.389505+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:03:43.389505+0000","last_undegraded":"2024-04-23T19:03:43.389505+0000","last_fullsized":"2024-04-23T19:03:43.389505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391565+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391565+0000","last_peered":"2024-04-23T19:03:43.391565+0000","last_clean":"2024-04-23T19:03:43.391565+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391565+0000","last_undegraded":"2024-04-23T19:03:43.391565+0000","last_fullsized":"2024-04-23T19:03:43.391565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114108+0000","last_change":"2024-04-23T19:00:17.304590+0000","last_active":"2024-04-23T19:03:44.114108+0000","last_peered":"2024-04-23T19:03:44.114108+0000","last_clean":"2024-04-23T19:03:44.114108+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:03:44.114108+0000","last_undegraded":"2024-04-23T19:03:44.114108+0000","last_fullsized":"2024-04-23T19:03:44.114108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'60","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.250334+0000","last_change":"2024-04-23T19:00:15.251787+0000","last_active":"2024-04-23T19:03:56.250334+0000","last_peered":"2024-04-23T19:03:56.250334+0000","last_clean":"2024-04-23T19:03:56.250334+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:03:56.250334+0000","last_undegraded":"2024-04-23T19:03:56.250334+0000","last_fullsized":"2024-04-23T19:03:56.250334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709898+0000","last_change":"2024-04-23T19:00:19.308149+0000","last_active":"2024-04-23T19:03:43.709898+0000","last_peered":"2024-04-23T19:03:43.709898+0000","last_clean":"2024-04-23T19:03:43.709898+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:03:43.709898+0000","last_undegraded":"2024-04-23T19:03:43.709898+0000","last_fullsized":"2024-04-23T19:03:43.709898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:09.367424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'27","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.313921+0000","last_change":"2024-04-23T19:00:21.317651+0000","last_active":"2024-04-23T19:03:56.313921+0000","last_peered":"2024-04-23T19:03:56.313921+0000","last_clean":"2024-04-23T19:03:56.313921+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:03:56.313921+0000","last_undegraded":"2024-04-23T19:03:56.313921+0000","last_fullsized":"2024-04-23T19:03:56.313921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:06.388114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114607+0000","last_change":"2024-04-23T19:00:23.337648+0000","last_active":"2024-04-23T19:03:44.114607+0000","last_peered":"2024-04-23T19:03:44.114607+0000","last_clean":"2024-04-23T19:03:44.114607+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:03:44.114607+0000","last_undegraded":"2024-04-23T19:03:44.114607+0000","last_fullsized":"2024-04-23T19:03:44.114607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707993+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.707993+0000","last_peered":"2024-04-23T19:03:43.707993+0000","last_clean":"2024-04-23T19:03:43.707993+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.707993+0000","last_undegraded":"2024-04-23T19:03:43.707993+0000","last_fullsized":"2024-04-23T19:03:43.707993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:53.420314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392663+0000","last_change":"2024-04-23T19:00:17.299682+0000","last_active":"2024-04-23T19:03:43.392663+0000","last_peered":"2024-04-23T19:03:43.392663+0000","last_clean":"2024-04-23T19:03:43.392663+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:03:43.392663+0000","last_undegraded":"2024-04-23T19:03:43.392663+0000","last_fullsized":"2024-04-23T19:03:43.392663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'42","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.296791+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:56.296791+0000","last_peered":"2024-04-23T19:03:56.296791+0000","last_clean":"2024-04-23T19:03:56.296791+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:56.296791+0000","last_undegraded":"2024-04-23T19:03:56.296791+0000","last_fullsized":"2024-04-23T19:03:56.296791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.912181+0000","last_change":"2024-04-23T19:00:19.289159+0000","last_active":"2024-04-23T19:03:43.912181+0000","last_peered":"2024-04-23T19:03:43.912181+0000","last_clean":"2024-04-23T19:03:43.912181+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:03:43.912181+0000","last_undegraded":"2024-04-23T19:03:43.912181+0000","last_fullsized":"2024-04-23T19:03:43.912181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'24","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.968214+0000","last_change":"2024-04-23T19:00:21.311697+0000","last_active":"2024-04-23T19:03:55.968214+0000","last_peered":"2024-04-23T19:03:55.968214+0000","last_clean":"2024-04-23T19:03:55.968214+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:03:55.968214+0000","last_undegraded":"2024-04-23T19:03:55.968214+0000","last_fullsized":"2024-04-23T19:03:55.968214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.426342+0000","last_change":"2024-04-23T19:04:01.426361+0000","last_active":"2024-04-23T19:04:01.426342+0000","last_peered":"2024-04-23T19:04:01.426342+0000","last_clean":"2024-04-23T19:04:01.426342+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:04:01.426342+0000","last_undegraded":"2024-04-23T19:04:01.426342+0000","last_fullsized":"2024-04-23T19:04:01.426342+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.426273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:06.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388148+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388148+0000","last_peered":"2024-04-23T19:03:43.388148+0000","last_clean":"2024-04-23T19:03:43.388148+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388148+0000","last_undegraded":"2024-04-23T19:03:43.388148+0000","last_fullsized":"2024-04-23T19:03:43.388148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394477+0000","last_change":"2024-04-23T19:00:17.295245+0000","last_active":"2024-04-23T19:03:43.394477+0000","last_peered":"2024-04-23T19:03:43.394477+0000","last_clean":"2024-04-23T19:03:43.394477+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:03:43.394477+0000","last_undegraded":"2024-04-23T19:03:43.394477+0000","last_fullsized":"2024-04-23T19:03:43.394477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'40","reported_seq":168,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.247520+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:56.247520+0000","last_peered":"2024-04-23T19:03:56.247520+0000","last_clean":"2024-04-23T19:03:56.247520+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:56.247520+0000","last_undegraded":"2024-04-23T19:03:56.247520+0000","last_fullsized":"2024-04-23T19:03:56.247520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114873+0000","last_change":"2024-04-23T19:03:32.293970+0000","last_active":"2024-04-23T19:03:44.114873+0000","last_peered":"2024-04-23T19:03:44.114873+0000","last_clean":"2024-04-23T19:03:44.114873+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:03:44.114873+0000","last_undegraded":"2024-04-23T19:03:44.114873+0000","last_fullsized":"2024-04-23T19:03:44.114873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'15","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.845320+0000","last_change":"2024-04-23T19:04:01.845493+0000","last_active":"2024-04-23T19:04:01.845320+0000","last_peered":"2024-04-23T19:04:01.845320+0000","last_clean":"2024-04-23T19:04:01.845320+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:04:01.845320+0000","last_undegraded":"2024-04-23T19:04:01.845320+0000","last_fullsized":"2024-04-23T19:04:01.845320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.845084+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:36.043539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":392,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.184403+0000","last_change":"2024-04-23T19:00:23.323378+0000","last_active":"2024-04-23T19:03:55.184403+0000","last_peered":"2024-04-23T19:03:55.184403+0000","last_clean":"2024-04-23T19:03:55.184403+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:03:55.184403+0000","last_undegraded":"2024-04-23T19:03:55.184403+0000","last_fullsized":"2024-04-23T19:03:55.184403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:25.058268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112611+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112611+0000","last_peered":"2024-04-23T19:03:44.112611+0000","last_clean":"2024-04-23T19:03:44.112611+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112611+0000","last_undegraded":"2024-04-23T19:03:44.112611+0000","last_fullsized":"2024-04-23T19:03:44.112611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:16.322419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909662+0000","last_change":"2024-04-23T19:00:17.308319+0000","last_active":"2024-04-23T19:03:43.909662+0000","last_peered":"2024-04-23T19:03:43.909662+0000","last_clean":"2024-04-23T19:03:43.909662+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:03:43.909662+0000","last_undegraded":"2024-04-23T19:03:43.909662+0000","last_fullsized":"2024-04-23T19:03:43.909662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'42","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.225106+0000","last_change":"2024-04-23T19:00:15.275686+0000","last_active":"2024-04-23T19:03:56.225106+0000","last_peered":"2024-04-23T19:03:56.225106+0000","last_clean":"2024-04-23T19:03:56.225106+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:03:56.225106+0000","last_undegraded":"2024-04-23T19:03:56.225106+0000","last_fullsized":"2024-04-23T19:03:56.225106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113265+0000","last_change":"2024-04-23T19:00:19.312145+0000","last_active":"2024-04-23T19:03:44.113265+0000","last_peered":"2024-04-23T19:03:44.113265+0000","last_clean":"2024-04-23T19:03:44.113265+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:03:44.113265+0000","last_undegraded":"2024-04-23T19:03:44.113265+0000","last_fullsized":"2024-04-23T19:03:44.113265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:38.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'26","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.278985+0000","last_change":"2024-04-23T19:00:21.315057+0000","last_active":"2024-04-23T19:03:56.278985+0000","last_peered":"2024-04-23T19:03:56.278985+0000","last_clean":"2024-04-23T19:03:56.278985+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:03:56.278985+0000","last_undegraded":"2024-04-23T19:03:56.278985+0000","last_fullsized":"2024-04-23T19:03:56.278985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.111983+0000","last_change":"2024-04-23T19:00:23.327916+0000","last_active":"2024-04-23T19:03:44.111983+0000","last_peered":"2024-04-23T19:03:44.111983+0000","last_clean":"2024-04-23T19:03:44.111983+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:03:44.111983+0000","last_undegraded":"2024-04-23T19:03:44.111983+0000","last_fullsized":"2024-04-23T19:03:44.111983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115183+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115183+0000","last_peered":"2024-04-23T19:03:44.115183+0000","last_clean":"2024-04-23T19:03:44.115183+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115183+0000","last_undegraded":"2024-04-23T19:03:44.115183+0000","last_fullsized":"2024-04-23T19:03:44.115183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:18.449030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910851+0000","last_change":"2024-04-23T19:00:17.308544+0000","last_active":"2024-04-23T19:03:43.910851+0000","last_peered":"2024-04-23T19:03:43.910851+0000","last_clean":"2024-04-23T19:03:43.910851+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:03:43.910851+0000","last_undegraded":"2024-04-23T19:03:43.910851+0000","last_fullsized":"2024-04-23T19:03:43.910851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.267637+0000","last_change":"2024-04-23T19:00:55.483104+0000","last_active":"2024-04-23T19:03:56.267637+0000","last_peered":"2024-04-23T19:03:56.267637+0000","last_clean":"2024-04-23T19:03:56.267637+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:03:56.267637+0000","last_undegraded":"2024-04-23T19:03:56.267637+0000","last_fullsized":"2024-04-23T19:03:56.267637+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389034+0000","last_change":"2024-04-23T19:00:19.300943+0000","last_active":"2024-04-23T19:03:43.389034+0000","last_peered":"2024-04-23T19:03:43.389034+0000","last_clean":"2024-04-23T19:03:43.389034+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:03:43.389034+0000","last_undegraded":"2024-04-23T19:03:43.389034+0000","last_fullsized":"2024-04-23T19:03:43.389034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'20","reported_seq":142,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.282764+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:56.282764+0000","last_peered":"2024-04-23T19:03:56.282764+0000","last_clean":"2024-04-23T19:03:56.282764+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:56.282764+0000","last_undegraded":"2024-04-23T19:03:56.282764+0000","last_fullsized":"2024-04-23T19:03:56.282764+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707890+0000","last_change":"2024-04-23T19:00:23.330029+0000","last_active":"2024-04-23T19:03:43.707890+0000","last_peered":"2024-04-23T19:03:43.707890+0000","last_clean":"2024-04-23T19:03:43.707890+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:03:43.707890+0000","last_undegraded":"2024-04-23T19:03:43.707890+0000","last_fullsized":"2024-04-23T19:03:43.707890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:04.294309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392985+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392985+0000","last_peered":"2024-04-23T19:03:43.392985+0000","last_clean":"2024-04-23T19:03:43.392985+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392985+0000","last_undegraded":"2024-04-23T19:03:43.392985+0000","last_fullsized":"2024-04-23T19:03:43.392985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390447+0000","last_change":"2024-04-23T19:00:17.293172+0000","last_active":"2024-04-23T19:03:43.390447+0000","last_peered":"2024-04-23T19:03:43.390447+0000","last_clean":"2024-04-23T19:03:43.390447+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:03:43.390447+0000","last_undegraded":"2024-04-23T19:03:43.390447+0000","last_fullsized":"2024-04-23T19:03:43.390447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.202779+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:03:56.202779+0000","last_peered":"2024-04-23T19:03:56.202779+0000","last_clean":"2024-04-23T19:03:56.202779+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:03:56.202779+0000","last_undegraded":"2024-04-23T19:03:56.202779+0000","last_fullsized":"2024-04-23T19:03:56.202779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908926+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908926+0000","last_peered":"2024-04-23T19:03:43.908926+0000","last_clean":"2024-04-23T19:03:43.908926+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908926+0000","last_undegraded":"2024-04-23T19:03:43.908926+0000","last_fullsized":"2024-04-23T19:03:43.908926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.957566+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:55.957566+0000","last_peered":"2024-04-23T19:03:55.957566+0000","last_clean":"2024-04-23T19:03:55.957566+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:55.957566+0000","last_undegraded":"2024-04-23T19:03:55.957566+0000","last_fullsized":"2024-04-23T19:03:55.957566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909320+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909320+0000","last_peered":"2024-04-23T19:03:43.909320+0000","last_clean":"2024-04-23T19:03:43.909320+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909320+0000","last_undegraded":"2024-04-23T19:03:43.909320+0000","last_fullsized":"2024-04-23T19:03:43.909320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114601+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114601+0000","last_peered":"2024-04-23T19:03:44.114601+0000","last_clean":"2024-04-23T19:03:44.114601+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114601+0000","last_undegraded":"2024-04-23T19:03:44.114601+0000","last_fullsized":"2024-04-23T19:03:44.114601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:40.758717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909293+0000","last_change":"2024-04-23T19:00:17.325525+0000","last_active":"2024-04-23T19:03:43.909293+0000","last_peered":"2024-04-23T19:03:43.909293+0000","last_clean":"2024-04-23T19:03:43.909293+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:03:43.909293+0000","last_undegraded":"2024-04-23T19:03:43.909293+0000","last_fullsized":"2024-04-23T19:03:43.909293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'50","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.173264+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:56.173264+0000","last_peered":"2024-04-23T19:03:56.173264+0000","last_clean":"2024-04-23T19:03:56.173264+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:56.173264+0000","last_undegraded":"2024-04-23T19:03:56.173264+0000","last_fullsized":"2024-04-23T19:03:56.173264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":162,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113135+0000","last_change":"2024-04-23T19:03:32.303428+0000","last_active":"2024-04-23T19:03:44.113135+0000","last_peered":"2024-04-23T19:03:44.113135+0000","last_clean":"2024-04-23T19:03:44.113135+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:03:44.113135+0000","last_undegraded":"2024-04-23T19:03:44.113135+0000","last_fullsized":"2024-04-23T19:03:44.113135+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'21","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.971866+0000","last_change":"2024-04-23T19:00:21.313962+0000","last_active":"2024-04-23T19:03:55.971866+0000","last_peered":"2024-04-23T19:03:55.971866+0000","last_clean":"2024-04-23T19:03:55.971866+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:03:55.971866+0000","last_undegraded":"2024-04-23T19:03:55.971866+0000","last_fullsized":"2024-04-23T19:03:55.971866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113356+0000","last_change":"2024-04-23T19:00:23.348526+0000","last_active":"2024-04-23T19:03:44.113356+0000","last_peered":"2024-04-23T19:03:44.113356+0000","last_clean":"2024-04-23T19:03:44.113356+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:03:44.113356+0000","last_undegraded":"2024-04-23T19:03:44.113356+0000","last_fullsized":"2024-04-23T19:03:44.113356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910005+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.910005+0000","last_peered":"2024-04-23T19:03:43.910005+0000","last_clean":"2024-04-23T19:03:43.910005+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.910005+0000","last_undegraded":"2024-04-23T19:03:43.910005+0000","last_fullsized":"2024-04-23T19:03:43.910005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115674+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115674+0000","last_peered":"2024-04-23T19:03:44.115674+0000","last_clean":"2024-04-23T19:03:44.115674+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115674+0000","last_undegraded":"2024-04-23T19:03:44.115674+0000","last_fullsized":"2024-04-23T19:03:44.115674+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'58","reported_seq":275,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.214041+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:56.214041+0000","last_peered":"2024-04-23T19:03:56.214041+0000","last_clean":"2024-04-23T19:03:56.214041+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:56.214041+0000","last_undegraded":"2024-04-23T19:03:56.214041+0000","last_fullsized":"2024-04-23T19:03:56.214041+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:47.778821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115479+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115479+0000","last_peered":"2024-04-23T19:03:44.115479+0000","last_clean":"2024-04-23T19:03:44.115479+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115479+0000","last_undegraded":"2024-04-23T19:03:44.115479+0000","last_fullsized":"2024-04-23T19:03:44.115479+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.261466+0000","last_change":"2024-04-23T19:00:15.246501+0000","last_active":"2024-04-23T19:03:56.261466+0000","last_peered":"2024-04-23T19:03:56.261466+0000","last_clean":"2024-04-23T19:03:56.261466+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:03:56.261466+0000","last_undegraded":"2024-04-23T19:03:56.261466+0000","last_fullsized":"2024-04-23T19:03:56.261466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389639+0000","last_change":"2024-04-23T19:00:17.317075+0000","last_active":"2024-04-23T19:03:43.389639+0000","last_peered":"2024-04-23T19:03:43.389639+0000","last_clean":"2024-04-23T19:03:43.389639+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:03:43.389639+0000","last_undegraded":"2024-04-23T19:03:43.389639+0000","last_fullsized":"2024-04-23T19:03:43.389639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.196958+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:56.196958+0000","last_peered":"2024-04-23T19:03:56.196958+0000","last_clean":"2024-04-23T19:03:56.196958+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:56.196958+0000","last_undegraded":"2024-04-23T19:03:56.196958+0000","last_fullsized":"2024-04-23T19:03:56.196958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114111+0000","last_change":"2024-04-23T19:00:17.301652+0000","last_active":"2024-04-23T19:03:44.114111+0000","last_peered":"2024-04-23T19:03:44.114111+0000","last_clean":"2024-04-23T19:03:44.114111+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:03:44.114111+0000","last_undegraded":"2024-04-23T19:03:44.114111+0000","last_fullsized":"2024-04-23T19:03:44.114111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'42","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.267752+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:56.267752+0000","last_peered":"2024-04-23T19:03:56.267752+0000","last_clean":"2024-04-23T19:03:56.267752+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:56.267752+0000","last_undegraded":"2024-04-23T19:03:56.267752+0000","last_fullsized":"2024-04-23T19:03:56.267752+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392628+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392628+0000","last_peered":"2024-04-23T19:03:43.392628+0000","last_clean":"2024-04-23T19:03:43.392628+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392628+0000","last_undegraded":"2024-04-23T19:03:43.392628+0000","last_fullsized":"2024-04-23T19:03:43.392628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.258474+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:56.258474+0000","last_peered":"2024-04-23T19:03:56.258474+0000","last_clean":"2024-04-23T19:03:56.258474+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:56.258474+0000","last_undegraded":"2024-04-23T19:03:56.258474+0000","last_fullsized":"2024-04-23T19:03:56.258474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911523+0000","last_change":"2024-04-23T19:00:17.324877+0000","last_active":"2024-04-23T19:03:43.911523+0000","last_peered":"2024-04-23T19:03:43.911523+0000","last_clean":"2024-04-23T19:03:43.911523+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:03:43.911523+0000","last_undegraded":"2024-04-23T19:03:43.911523+0000","last_fullsized":"2024-04-23T19:03:43.911523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'68","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.268589+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:56.268589+0000","last_peered":"2024-04-23T19:03:56.268589+0000","last_clean":"2024-04-23T19:03:56.268589+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:56.268589+0000","last_undegraded":"2024-04-23T19:03:56.268589+0000","last_fullsized":"2024-04-23T19:03:56.268589+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389764+0000","last_change":"2024-04-23T19:00:17.300177+0000","last_active":"2024-04-23T19:03:43.389764+0000","last_peered":"2024-04-23T19:03:43.389764+0000","last_clean":"2024-04-23T19:03:43.389764+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:03:43.389764+0000","last_undegraded":"2024-04-23T19:03:43.389764+0000","last_fullsized":"2024-04-23T19:03:43.389764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'52","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.157975+0000","last_change":"2024-04-23T19:00:15.276364+0000","last_active":"2024-04-23T19:03:56.157975+0000","last_peered":"2024-04-23T19:03:56.157975+0000","last_clean":"2024-04-23T19:03:56.157975+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:03:56.157975+0000","last_undegraded":"2024-04-23T19:03:56.157975+0000","last_fullsized":"2024-04-23T19:03:56.157975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:58.803651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707915+0000","last_change":"2024-04-23T19:00:17.299028+0000","last_active":"2024-04-23T19:03:43.707915+0000","last_peered":"2024-04-23T19:03:43.707915+0000","last_clean":"2024-04-23T19:03:43.707915+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:03:43.707915+0000","last_undegraded":"2024-04-23T19:03:43.707915+0000","last_fullsized":"2024-04-23T19:03:43.707915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:07.236133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.193849+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:56.193849+0000","last_peered":"2024-04-23T19:03:56.193849+0000","last_clean":"2024-04-23T19:03:56.193849+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:56.193849+0000","last_undegraded":"2024-04-23T19:03:56.193849+0000","last_fullsized":"2024-04-23T19:03:56.193849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114624+0000","last_change":"2024-04-23T19:00:17.306060+0000","last_active":"2024-04-23T19:03:44.114624+0000","last_peered":"2024-04-23T19:03:44.114624+0000","last_clean":"2024-04-23T19:03:44.114624+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:03:44.114624+0000","last_undegraded":"2024-04-23T19:03:44.114624+0000","last_fullsized":"2024-04-23T19:03:44.114624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'56","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.252458+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:56.252458+0000","last_peered":"2024-04-23T19:03:56.252458+0000","last_clean":"2024-04-23T19:03:56.252458+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:56.252458+0000","last_undegraded":"2024-04-23T19:03:56.252458+0000","last_fullsized":"2024-04-23T19:03:56.252458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12,"num_write":96,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911250+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911250+0000","last_peered":"2024-04-23T19:03:43.911250+0000","last_clean":"2024-04-23T19:03:43.911250+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911250+0000","last_undegraded":"2024-04-23T19:03:43.911250+0000","last_fullsized":"2024-04-23T19:03:43.911250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.237716+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:56.237716+0000","last_peered":"2024-04-23T19:03:56.237716+0000","last_clean":"2024-04-23T19:03:56.237716+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:56.237716+0000","last_undegraded":"2024-04-23T19:03:56.237716+0000","last_fullsized":"2024-04-23T19:03:56.237716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.394115+0000","last_change":"2024-04-23T19:00:17.300623+0000","last_active":"2024-04-23T19:03:43.394115+0000","last_peered":"2024-04-23T19:03:43.394115+0000","last_clean":"2024-04-23T19:03:43.394115+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:03:43.394115+0000","last_undegraded":"2024-04-23T19:03:43.394115+0000","last_fullsized":"2024-04-23T19:03:43.394115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'62","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.250618+0000","last_change":"2024-04-23T19:00:15.284577+0000","last_active":"2024-04-23T19:03:56.250618+0000","last_peered":"2024-04-23T19:03:56.250618+0000","last_clean":"2024-04-23T19:03:56.250618+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:03:56.250618+0000","last_undegraded":"2024-04-23T19:03:56.250618+0000","last_fullsized":"2024-04-23T19:03:56.250618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911922+0000","last_change":"2024-04-23T19:00:17.324933+0000","last_active":"2024-04-23T19:03:43.911922+0000","last_peered":"2024-04-23T19:03:43.911922+0000","last_clean":"2024-04-23T19:03:43.911922+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:03:43.911922+0000","last_undegraded":"2024-04-23T19:03:43.911922+0000","last_fullsized":"2024-04-23T19:03:43.911922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'42","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.207063+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:56.207063+0000","last_peered":"2024-04-23T19:03:56.207063+0000","last_clean":"2024-04-23T19:03:56.207063+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:56.207063+0000","last_undegraded":"2024-04-23T19:03:56.207063+0000","last_fullsized":"2024-04-23T19:03:56.207063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113841+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113841+0000","last_peered":"2024-04-23T19:03:44.113841+0000","last_clean":"2024-04-23T19:03:44.113841+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113841+0000","last_undegraded":"2024-04-23T19:03:44.113841+0000","last_fullsized":"2024-04-23T19:03:44.113841+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.815837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'44","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.084170+0000","last_change":"2024-04-23T19:00:15.275783+0000","last_active":"2024-04-23T19:03:56.084170+0000","last_peered":"2024-04-23T19:03:56.084170+0000","last_clean":"2024-04-23T19:03:56.084170+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:03:56.084170+0000","last_undegraded":"2024-04-23T19:03:56.084170+0000","last_fullsized":"2024-04-23T19:03:56.084170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:52.709857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112346+0000","last_change":"2024-04-23T19:00:17.301511+0000","last_active":"2024-04-23T19:03:44.112346+0000","last_peered":"2024-04-23T19:03:44.112346+0000","last_clean":"2024-04-23T19:03:44.112346+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:03:44.112346+0000","last_undegraded":"2024-04-23T19:03:44.112346+0000","last_fullsized":"2024-04-23T19:03:44.112346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'44","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.269017+0000","last_change":"2024-04-23T19:00:15.282116+0000","last_active":"2024-04-23T19:03:56.269017+0000","last_peered":"2024-04-23T19:03:56.269017+0000","last_clean":"2024-04-23T19:03:56.269017+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:03:56.269017+0000","last_undegraded":"2024-04-23T19:03:56.269017+0000","last_fullsized":"2024-04-23T19:03:56.269017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:12:08.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389530+0000","last_change":"2024-04-23T19:00:17.302597+0000","last_active":"2024-04-23T19:03:43.389530+0000","last_peered":"2024-04-23T19:03:43.389530+0000","last_clean":"2024-04-23T19:03:43.389530+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:03:43.389530+0000","last_undegraded":"2024-04-23T19:03:43.389530+0000","last_fullsized":"2024-04-23T19:03:43.389530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'36","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.237388+0000","last_change":"2024-04-23T19:00:15.269956+0000","last_active":"2024-04-23T19:03:56.237388+0000","last_peered":"2024-04-23T19:03:56.237388+0000","last_clean":"2024-04-23T19:03:56.237388+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:03:56.237388+0000","last_undegraded":"2024-04-23T19:03:56.237388+0000","last_fullsized":"2024-04-23T19:03:56.237388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113173+0000","last_change":"2024-04-23T19:00:17.304224+0000","last_active":"2024-04-23T19:03:44.113173+0000","last_peered":"2024-04-23T19:03:44.113173+0000","last_clean":"2024-04-23T19:03:44.113173+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:03:44.113173+0000","last_undegraded":"2024-04-23T19:03:44.113173+0000","last_fullsized":"2024-04-23T19:03:44.113173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:01.500455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'56","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.269815+0000","last_change":"2024-04-23T19:00:55.104179+0000","last_active":"2024-04-23T19:03:56.269815+0000","last_peered":"2024-04-23T19:03:56.269815+0000","last_clean":"2024-04-23T19:03:56.269815+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:03:56.269815+0000","last_undegraded":"2024-04-23T19:03:56.269815+0000","last_fullsized":"2024-04-23T19:03:56.269815+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.260682+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:56.260682+0000","last_peered":"2024-04-23T19:03:56.260682+0000","last_clean":"2024-04-23T19:03:56.260682+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:56.260682+0000","last_undegraded":"2024-04-23T19:03:56.260682+0000","last_fullsized":"2024-04-23T19:03:56.260682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114578+0000","last_change":"2024-04-23T19:00:17.309023+0000","last_active":"2024-04-23T19:03:44.114578+0000","last_peered":"2024-04-23T19:03:44.114578+0000","last_clean":"2024-04-23T19:03:44.114578+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:03:44.114578+0000","last_undegraded":"2024-04-23T19:03:44.114578+0000","last_fullsized":"2024-04-23T19:03:44.114578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'56","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.272562+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:56.272562+0000","last_peered":"2024-04-23T19:03:56.272562+0000","last_clean":"2024-04-23T19:03:56.272562+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:56.272562+0000","last_undegraded":"2024-04-23T19:03:56.272562+0000","last_fullsized":"2024-04-23T19:03:56.272562+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.390202+0000","last_change":"2024-04-23T19:00:17.317807+0000","last_active":"2024-04-23T19:03:43.390202+0000","last_peered":"2024-04-23T19:03:43.390202+0000","last_clean":"2024-04-23T19:03:43.390202+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:03:43.390202+0000","last_undegraded":"2024-04-23T19:03:43.390202+0000","last_fullsized":"2024-04-23T19:03:43.390202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1104,"ondisk_log_size":1104,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1070,"num_read_kb":1553,"num_write":547,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":870,"ondisk_log_size":870,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37336,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334504,"statfs":{"total":96636764160,"available":96598532096,"internally_reserved":0,"allocated":2039808,"data_stored":1406946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":815907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1462272,"data_stored":815753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1433600,"data_stored":815702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1400832,"data_stored":814476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":1437696,"data_stored":815992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37304,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334536,"statfs":{"total":96636764160,"available":96598564864,"internally_reserved":0,"allocated":2015232,"data_stored":1405784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:04:02.939 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.940 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.941 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.942 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.943 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.944 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.945 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.946 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.947 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.948 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.948 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.948 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.948 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.948 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.949 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.949 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.949 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.949 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.949 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.950 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.951 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T19:00:02.155506+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.952 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.953 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.954 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.955 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.956 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.957 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.958 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.959 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.960 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.961 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.962 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.963 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.964 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.965 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.966 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.967 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:02.968 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T19:04:22.969 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:04:23.332 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:04:23.337 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:04:23.349 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-04-23T19:04:22.020020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5019,"num_read_kb":3922,"num_write":4431,"num_write_kb":6187922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5658,"ondisk_log_size":5658,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295000,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754679720,"statfs":{"total":773094113280,"available":772792033280,"internally_reserved":0,"allocated":12607488,"data_stored":7704972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005802"},"pg_stats":[{"pgid":"3.3f","version":"116'56","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.008167+0000","last_change":"2024-04-23T19:04:18.008233+0000","last_active":"2024-04-23T19:04:18.008167+0000","last_peered":"2024-04-23T19:04:18.008167+0000","last_clean":"2024-04-23T19:04:18.008167+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:04:18.008167+0000","last_undegraded":"2024-04-23T19:04:18.008167+0000","last_fullsized":"2024-04-23T19:04:18.008167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:18.007961+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:18.007961+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.007961+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.393969+0000","last_change":"2024-04-23T19:04:13.394029+0000","last_active":"2024-04-23T19:04:13.393969+0000","last_peered":"2024-04-23T19:04:13.393969+0000","last_clean":"2024-04-23T19:04:13.393969+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:04:13.393969+0000","last_undegraded":"2024-04-23T19:04:13.393969+0000","last_fullsized":"2024-04-23T19:04:13.393969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:13.393767+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:13.393767+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.393767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:09.994694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.544253+0000","last_change":"2024-04-23T19:04:09.544313+0000","last_active":"2024-04-23T19:04:09.544253+0000","last_peered":"2024-04-23T19:04:09.544253+0000","last_clean":"2024-04-23T19:04:09.544253+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:04:09.544253+0000","last_undegraded":"2024-04-23T19:04:09.544253+0000","last_fullsized":"2024-04-23T19:04:09.544253+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:09.544061+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:09.544061+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.544061+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:55.178917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.018460+0000","last_change":"2024-04-23T19:04:10.018488+0000","last_active":"2024-04-23T19:04:10.018460+0000","last_peered":"2024-04-23T19:04:10.018460+0000","last_clean":"2024-04-23T19:04:10.018460+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:04:10.018460+0000","last_undegraded":"2024-04-23T19:04:10.018460+0000","last_fullsized":"2024-04-23T19:04:10.018460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:10.018359+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:10.018359+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.018359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:59.168653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.193053+0000","last_change":"2024-04-23T19:00:15.256420+0000","last_active":"2024-04-23T19:03:56.193053+0000","last_peered":"2024-04-23T19:03:56.193053+0000","last_clean":"2024-04-23T19:03:56.193053+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:03:56.193053+0000","last_undegraded":"2024-04-23T19:03:56.193053+0000","last_fullsized":"2024-04-23T19:03:56.193053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.149512+0000","last_change":"2024-04-23T19:04:20.149659+0000","last_active":"2024-04-23T19:04:20.149512+0000","last_peered":"2024-04-23T19:04:20.149512+0000","last_clean":"2024-04-23T19:04:20.149512+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:04:20.149512+0000","last_undegraded":"2024-04-23T19:04:20.149512+0000","last_fullsized":"2024-04-23T19:04:20.149512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:20.149253+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:20.149253+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.149253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:38.802261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'52","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.628859+0000","last_change":"2024-04-23T19:00:15.268506+0000","last_active":"2024-04-23T19:04:01.628859+0000","last_peered":"2024-04-23T19:04:01.628859+0000","last_clean":"2024-04-23T19:04:01.628859+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:04:01.628859+0000","last_undegraded":"2024-04-23T19:04:01.628859+0000","last_fullsized":"2024-04-23T19:04:01.628859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113550+0000","last_change":"2024-04-23T19:00:17.296248+0000","last_active":"2024-04-23T19:03:44.113550+0000","last_peered":"2024-04-23T19:03:44.113550+0000","last_clean":"2024-04-23T19:03:44.113550+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:03:44.113550+0000","last_undegraded":"2024-04-23T19:03:44.113550+0000","last_fullsized":"2024-04-23T19:03:44.113550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'44","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.192953+0000","last_change":"2024-04-23T19:00:15.282128+0000","last_active":"2024-04-23T19:03:56.192953+0000","last_peered":"2024-04-23T19:03:56.192953+0000","last_clean":"2024-04-23T19:03:56.192953+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:03:56.192953+0000","last_undegraded":"2024-04-23T19:03:56.192953+0000","last_fullsized":"2024-04-23T19:03:56.192953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.250723+0000","last_change":"2024-04-23T19:04:06.250723+0000","last_active":"2024-04-23T19:04:06.250723+0000","last_peered":"2024-04-23T19:04:06.250723+0000","last_clean":"2024-04-23T19:04:06.250723+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:04:06.250723+0000","last_undegraded":"2024-04-23T19:04:06.250723+0000","last_fullsized":"2024-04-23T19:04:06.250723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:06.250456+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:06.250456+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.250456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:41:22.388683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'38","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.379228+0000","last_change":"2024-04-23T19:04:17.379293+0000","last_active":"2024-04-23T19:04:17.379228+0000","last_peered":"2024-04-23T19:04:17.379228+0000","last_clean":"2024-04-23T19:04:17.379228+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:04:17.379228+0000","last_undegraded":"2024-04-23T19:04:17.379228+0000","last_fullsized":"2024-04-23T19:04:17.379228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:17.379035+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:17.379035+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.379035+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:33.141203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.005541+0000","last_change":"2024-04-23T19:04:10.005603+0000","last_active":"2024-04-23T19:04:10.005541+0000","last_peered":"2024-04-23T19:04:10.005541+0000","last_clean":"2024-04-23T19:04:10.005541+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:04:10.005541+0000","last_undegraded":"2024-04-23T19:04:10.005541+0000","last_fullsized":"2024-04-23T19:04:10.005541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-04-23T19:04:10.005426+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-04-23T19:04:10.005426+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.005426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:09.258211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'20","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.229816+0000","last_change":"2024-04-23T19:00:15.270075+0000","last_active":"2024-04-23T19:03:56.229816+0000","last_peered":"2024-04-23T19:03:56.229816+0000","last_clean":"2024-04-23T19:03:56.229816+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:03:56.229816+0000","last_undegraded":"2024-04-23T19:03:56.229816+0000","last_fullsized":"2024-04-23T19:03:56.229816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.384623+0000","last_change":"2024-04-23T19:04:11.384687+0000","last_active":"2024-04-23T19:04:11.384623+0000","last_peered":"2024-04-23T19:04:11.384623+0000","last_clean":"2024-04-23T19:04:11.384623+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:04:11.384623+0000","last_undegraded":"2024-04-23T19:04:11.384623+0000","last_fullsized":"2024-04-23T19:04:11.384623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-23T19:04:11.384413+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.384413+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.384413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:57.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.245139+0000","last_change":"2024-04-23T19:00:15.278591+0000","last_active":"2024-04-23T19:03:56.245139+0000","last_peered":"2024-04-23T19:03:56.245139+0000","last_clean":"2024-04-23T19:03:56.245139+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:03:56.245139+0000","last_undegraded":"2024-04-23T19:03:56.245139+0000","last_fullsized":"2024-04-23T19:03:56.245139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.974476+0000","last_change":"2024-04-23T19:04:08.974603+0000","last_active":"2024-04-23T19:04:08.974476+0000","last_peered":"2024-04-23T19:04:08.974476+0000","last_clean":"2024-04-23T19:04:08.974476+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:04:08.974476+0000","last_undegraded":"2024-04-23T19:04:08.974476+0000","last_fullsized":"2024-04-23T19:04:08.974476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'8","last_scrub_stamp":"2024-04-23T19:04:08.974238+0000","last_deep_scrub":"89'8","last_deep_scrub_stamp":"2024-04-23T19:04:08.974238+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.974238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:23.342084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909226+0000","last_change":"2024-04-23T19:00:17.298879+0000","last_active":"2024-04-23T19:03:43.909226+0000","last_peered":"2024-04-23T19:03:43.909226+0000","last_clean":"2024-04-23T19:03:43.909226+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:03:43.909226+0000","last_undegraded":"2024-04-23T19:03:43.909226+0000","last_fullsized":"2024-04-23T19:03:43.909226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.008010+0000","last_change":"2024-04-23T19:04:14.008071+0000","last_active":"2024-04-23T19:04:14.008010+0000","last_peered":"2024-04-23T19:04:14.008010+0000","last_clean":"2024-04-23T19:04:14.008010+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:04:14.008010+0000","last_undegraded":"2024-04-23T19:04:14.008010+0000","last_fullsized":"2024-04-23T19:04:14.008010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:14.007823+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:14.007823+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.007823+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:02.029745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.014299+0000","last_change":"2024-04-23T19:04:08.014365+0000","last_active":"2024-04-23T19:04:08.014299+0000","last_peered":"2024-04-23T19:04:08.014299+0000","last_clean":"2024-04-23T19:04:08.014299+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:04:08.014299+0000","last_undegraded":"2024-04-23T19:04:08.014299+0000","last_fullsized":"2024-04-23T19:04:08.014299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:08.014057+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:08.014057+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.014057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:00.990004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.160560+0000","last_change":"2024-04-23T19:04:17.160620+0000","last_active":"2024-04-23T19:04:17.160560+0000","last_peered":"2024-04-23T19:04:17.160560+0000","last_clean":"2024-04-23T19:04:17.160560+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:04:17.160560+0000","last_undegraded":"2024-04-23T19:04:17.160560+0000","last_fullsized":"2024-04-23T19:04:17.160560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:17.160373+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:17.160373+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.160373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:06.310668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.361954+0000","last_change":"2024-04-23T19:04:10.362013+0000","last_active":"2024-04-23T19:04:10.361954+0000","last_peered":"2024-04-23T19:04:10.361954+0000","last_clean":"2024-04-23T19:04:10.361954+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:04:10.361954+0000","last_undegraded":"2024-04-23T19:04:10.361954+0000","last_fullsized":"2024-04-23T19:04:10.361954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'14","last_scrub_stamp":"2024-04-23T19:04:10.361754+0000","last_deep_scrub":"57'14","last_deep_scrub_stamp":"2024-04-23T19:04:10.361754+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.361754+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:40.685164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.131762+0000","last_change":"2024-04-23T19:04:16.131822+0000","last_active":"2024-04-23T19:04:16.131762+0000","last_peered":"2024-04-23T19:04:16.131762+0000","last_clean":"2024-04-23T19:04:16.131762+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:04:16.131762+0000","last_undegraded":"2024-04-23T19:04:16.131762+0000","last_fullsized":"2024-04-23T19:04:16.131762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:16.131570+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:16.131570+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.131570+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:12.862429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.940073+0000","last_change":"2024-04-23T19:04:07.940142+0000","last_active":"2024-04-23T19:04:07.940073+0000","last_peered":"2024-04-23T19:04:07.940073+0000","last_clean":"2024-04-23T19:04:07.940073+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:04:07.940073+0000","last_undegraded":"2024-04-23T19:04:07.940073+0000","last_fullsized":"2024-04-23T19:04:07.940073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:07.939845+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:07.939845+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:54.688217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'32","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.269390+0000","last_change":"2024-04-23T19:00:15.283867+0000","last_active":"2024-04-23T19:03:56.269390+0000","last_peered":"2024-04-23T19:03:56.269390+0000","last_clean":"2024-04-23T19:03:56.269390+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:03:56.269390+0000","last_undegraded":"2024-04-23T19:03:56.269390+0000","last_fullsized":"2024-04-23T19:03:56.269390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.007622+0000","last_change":"2024-04-23T19:04:12.007691+0000","last_active":"2024-04-23T19:04:12.007622+0000","last_peered":"2024-04-23T19:04:12.007622+0000","last_clean":"2024-04-23T19:04:12.007622+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:04:12.007622+0000","last_undegraded":"2024-04-23T19:04:12.007622+0000","last_fullsized":"2024-04-23T19:04:12.007622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:12.007381+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:12.007381+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.007381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:56.924916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'54","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.167632+0000","last_change":"2024-04-23T19:00:15.263209+0000","last_active":"2024-04-23T19:03:56.167632+0000","last_peered":"2024-04-23T19:03:56.167632+0000","last_clean":"2024-04-23T19:03:56.167632+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:03:56.167632+0000","last_undegraded":"2024-04-23T19:03:56.167632+0000","last_fullsized":"2024-04-23T19:03:56.167632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.101587+0000","last_change":"2024-04-23T19:04:15.101729+0000","last_active":"2024-04-23T19:04:15.101587+0000","last_peered":"2024-04-23T19:04:15.101587+0000","last_clean":"2024-04-23T19:04:15.101587+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:04:15.101587+0000","last_undegraded":"2024-04-23T19:04:15.101587+0000","last_fullsized":"2024-04-23T19:04:15.101587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-04-23T19:04:15.101352+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-04-23T19:04:15.101352+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.101352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:11.702279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'38","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.214165+0000","last_change":"2024-04-23T19:00:15.261976+0000","last_active":"2024-04-23T19:03:56.214165+0000","last_peered":"2024-04-23T19:03:56.214165+0000","last_clean":"2024-04-23T19:03:56.214165+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:03:56.214165+0000","last_undegraded":"2024-04-23T19:03:56.214165+0000","last_fullsized":"2024-04-23T19:03:56.214165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908899+0000","last_change":"2024-04-23T19:00:25.350292+0000","last_active":"2024-04-23T19:03:43.908899+0000","last_peered":"2024-04-23T19:03:43.908899+0000","last_clean":"2024-04-23T19:03:43.908899+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:03:43.908899+0000","last_undegraded":"2024-04-23T19:03:43.908899+0000","last_fullsized":"2024-04-23T19:03:43.908899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.850246+0000","last_change":"2024-04-23T19:04:20.850307+0000","last_active":"2024-04-23T19:04:20.850246+0000","last_peered":"2024-04-23T19:04:20.850246+0000","last_clean":"2024-04-23T19:04:20.850246+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:04:20.850246+0000","last_undegraded":"2024-04-23T19:04:20.850246+0000","last_fullsized":"2024-04-23T19:04:20.850246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.850014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.850014+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.850014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:28.063027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'48","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.052830+0000","last_change":"2024-04-23T19:04:20.052963+0000","last_active":"2024-04-23T19:04:20.052830+0000","last_peered":"2024-04-23T19:04:20.052830+0000","last_clean":"2024-04-23T19:04:20.052830+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:04:20.052830+0000","last_undegraded":"2024-04-23T19:04:20.052830+0000","last_fullsized":"2024-04-23T19:04:20.052830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:20.052592+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:20.052592+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.052592+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:13.028540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.377530+0000","last_change":"2024-04-23T19:04:18.377587+0000","last_active":"2024-04-23T19:04:18.377530+0000","last_peered":"2024-04-23T19:04:18.377530+0000","last_clean":"2024-04-23T19:04:18.377530+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:04:18.377530+0000","last_undegraded":"2024-04-23T19:04:18.377530+0000","last_fullsized":"2024-04-23T19:04:18.377530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.377330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.377330+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.377330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:55.319797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'22","reported_seq":143,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.324760+0000","last_change":"2024-04-23T19:01:39.113284+0000","last_active":"2024-04-23T19:03:59.324760+0000","last_peered":"2024-04-23T19:03:59.324760+0000","last_clean":"2024-04-23T19:03:59.324760+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:03:59.324760+0000","last_undegraded":"2024-04-23T19:03:59.324760+0000","last_fullsized":"2024-04-23T19:03:59.324760+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114545+0000","last_change":"2024-04-23T19:00:23.329040+0000","last_active":"2024-04-23T19:03:44.114545+0000","last_peered":"2024-04-23T19:03:44.114545+0000","last_clean":"2024-04-23T19:03:44.114545+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:03:44.114545+0000","last_undegraded":"2024-04-23T19:03:44.114545+0000","last_fullsized":"2024-04-23T19:03:44.114545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388011+0000","last_change":"2024-04-23T19:00:25.332909+0000","last_active":"2024-04-23T19:03:43.388011+0000","last_peered":"2024-04-23T19:03:43.388011+0000","last_clean":"2024-04-23T19:03:43.388011+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:03:43.388011+0000","last_undegraded":"2024-04-23T19:03:43.388011+0000","last_fullsized":"2024-04-23T19:03:43.388011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.304934+0000","last_change":"2024-04-23T19:04:06.304994+0000","last_active":"2024-04-23T19:04:06.304934+0000","last_peered":"2024-04-23T19:04:06.304934+0000","last_clean":"2024-04-23T19:04:06.304934+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:04:06.304934+0000","last_undegraded":"2024-04-23T19:04:06.304934+0000","last_fullsized":"2024-04-23T19:04:06.304934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:06.304698+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.304698+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.304698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:53.608671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'62","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.236094+0000","last_change":"2024-04-23T19:00:15.277628+0000","last_active":"2024-04-23T19:03:56.236094+0000","last_peered":"2024-04-23T19:03:56.236094+0000","last_clean":"2024-04-23T19:03:56.236094+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:03:56.236094+0000","last_undegraded":"2024-04-23T19:03:56.236094+0000","last_fullsized":"2024-04-23T19:03:56.236094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391321+0000","last_change":"2024-04-23T19:00:19.310553+0000","last_active":"2024-04-23T19:03:43.391321+0000","last_peered":"2024-04-23T19:03:43.391321+0000","last_clean":"2024-04-23T19:03:43.391321+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:03:43.391321+0000","last_undegraded":"2024-04-23T19:03:43.391321+0000","last_fullsized":"2024-04-23T19:03:43.391321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"116'9","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.865860+0000","last_change":"2024-04-23T19:04:03.865928+0000","last_active":"2024-04-23T19:04:03.865860+0000","last_peered":"2024-04-23T19:04:03.865860+0000","last_clean":"2024-04-23T19:04:03.865860+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:04:03.865860+0000","last_undegraded":"2024-04-23T19:04:03.865860+0000","last_fullsized":"2024-04-23T19:04:03.865860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'9","last_scrub_stamp":"2024-04-23T19:04:03.865681+0000","last_deep_scrub":"116'9","last_deep_scrub_stamp":"2024-04-23T19:04:03.865681+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.865681+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:37.482152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910408+0000","last_change":"2024-04-23T19:00:23.334243+0000","last_active":"2024-04-23T19:03:43.910408+0000","last_peered":"2024-04-23T19:03:43.910408+0000","last_clean":"2024-04-23T19:03:43.910408+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:03:43.910408+0000","last_undegraded":"2024-04-23T19:03:43.910408+0000","last_fullsized":"2024-04-23T19:03:43.910408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.538570+0000","last_change":"2024-04-23T19:04:05.538628+0000","last_active":"2024-04-23T19:04:05.538570+0000","last_peered":"2024-04-23T19:04:05.538570+0000","last_clean":"2024-04-23T19:04:05.538570+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:04:05.538570+0000","last_undegraded":"2024-04-23T19:04:05.538570+0000","last_fullsized":"2024-04-23T19:04:05.538570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.538348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.538348+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.538348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:51.173204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.634767+0000","last_change":"2024-04-23T19:04:16.634937+0000","last_active":"2024-04-23T19:04:16.634767+0000","last_peered":"2024-04-23T19:04:16.634767+0000","last_clean":"2024-04-23T19:04:16.634767+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:04:16.634767+0000","last_undegraded":"2024-04-23T19:04:16.634767+0000","last_fullsized":"2024-04-23T19:04:16.634767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:16.634534+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:16.634534+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.634534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.464050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'44","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.190848+0000","last_change":"2024-04-23T19:00:15.279290+0000","last_active":"2024-04-23T19:03:56.190848+0000","last_peered":"2024-04-23T19:03:56.190848+0000","last_clean":"2024-04-23T19:03:56.190848+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:03:56.190848+0000","last_undegraded":"2024-04-23T19:03:56.190848+0000","last_fullsized":"2024-04-23T19:03:56.190848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.805997+0000","last_change":"2024-04-23T19:04:19.806052+0000","last_active":"2024-04-23T19:04:19.805997+0000","last_peered":"2024-04-23T19:04:19.805997+0000","last_clean":"2024-04-23T19:04:19.805997+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:04:19.805997+0000","last_undegraded":"2024-04-23T19:04:19.805997+0000","last_fullsized":"2024-04-23T19:04:19.805997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.805796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.805796+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.805796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:30.023911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"116'15","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.130014+0000","last_change":"2024-04-23T19:04:15.130096+0000","last_active":"2024-04-23T19:04:15.130014+0000","last_peered":"2024-04-23T19:04:15.130014+0000","last_clean":"2024-04-23T19:04:15.130014+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:04:15.130014+0000","last_undegraded":"2024-04-23T19:04:15.130014+0000","last_fullsized":"2024-04-23T19:04:15.130014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:15.129819+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:15.129819+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.129819+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:27.829926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'138","reported_seq":363,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.321230+0000","last_change":"2024-04-23T19:00:23.338165+0000","last_active":"2024-04-23T19:03:56.321230+0000","last_peered":"2024-04-23T19:03:56.321230+0000","last_clean":"2024-04-23T19:03:56.321230+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:03:56.321230+0000","last_undegraded":"2024-04-23T19:03:56.321230+0000","last_fullsized":"2024-04-23T19:03:56.321230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909813+0000","last_change":"2024-04-23T19:00:25.332160+0000","last_active":"2024-04-23T19:03:43.909813+0000","last_peered":"2024-04-23T19:03:43.909813+0000","last_clean":"2024-04-23T19:03:43.909813+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:03:43.909813+0000","last_undegraded":"2024-04-23T19:03:43.909813+0000","last_fullsized":"2024-04-23T19:03:43.909813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.748940+0000","last_change":"2024-04-23T19:04:15.749006+0000","last_active":"2024-04-23T19:04:15.748940+0000","last_peered":"2024-04-23T19:04:15.748940+0000","last_clean":"2024-04-23T19:04:15.748940+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:04:15.748940+0000","last_undegraded":"2024-04-23T19:04:15.748940+0000","last_fullsized":"2024-04-23T19:04:15.748940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:15.748737+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:15.748737+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.748737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:22.778779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'48","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.100785+0000","last_change":"2024-04-23T19:04:12.100847+0000","last_active":"2024-04-23T19:04:12.100785+0000","last_peered":"2024-04-23T19:04:12.100785+0000","last_clean":"2024-04-23T19:04:12.100785+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:04:12.100785+0000","last_undegraded":"2024-04-23T19:04:12.100785+0000","last_fullsized":"2024-04-23T19:04:12.100785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:12.100585+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:12.100585+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.100585+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:46.299040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.366651+0000","last_change":"2024-04-23T19:04:14.366705+0000","last_active":"2024-04-23T19:04:14.366651+0000","last_peered":"2024-04-23T19:04:14.366651+0000","last_clean":"2024-04-23T19:04:14.366651+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:04:14.366651+0000","last_undegraded":"2024-04-23T19:04:14.366651+0000","last_fullsized":"2024-04-23T19:04:14.366651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:14.366452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:14.366452+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.366452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:06.533771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'23","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.029557+0000","last_change":"2024-04-23T19:04:17.029633+0000","last_active":"2024-04-23T19:04:17.029557+0000","last_peered":"2024-04-23T19:04:17.029557+0000","last_clean":"2024-04-23T19:04:17.029557+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:04:17.029557+0000","last_undegraded":"2024-04-23T19:04:17.029557+0000","last_fullsized":"2024-04-23T19:04:17.029557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:17.029366+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:17.029366+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.029366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:37.775720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'138","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.848142+0000","last_change":"2024-04-23T19:04:01.848166+0000","last_active":"2024-04-23T19:04:01.848142+0000","last_peered":"2024-04-23T19:04:01.848142+0000","last_clean":"2024-04-23T19:04:01.848142+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:04:01.848142+0000","last_undegraded":"2024-04-23T19:04:01.848142+0000","last_fullsized":"2024-04-23T19:04:01.848142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.848048+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:05.290229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.371117+0000","last_change":"2024-04-23T19:04:09.371178+0000","last_active":"2024-04-23T19:04:09.371117+0000","last_peered":"2024-04-23T19:04:09.371117+0000","last_clean":"2024-04-23T19:04:09.371117+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:04:09.371117+0000","last_undegraded":"2024-04-23T19:04:09.371117+0000","last_fullsized":"2024-04-23T19:04:09.371117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:09.370889+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:09.370889+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.370889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:57.392811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.052590+0000","last_change":"2024-04-23T19:04:16.052654+0000","last_active":"2024-04-23T19:04:16.052590+0000","last_peered":"2024-04-23T19:04:16.052590+0000","last_clean":"2024-04-23T19:04:16.052590+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:04:16.052590+0000","last_undegraded":"2024-04-23T19:04:16.052590+0000","last_fullsized":"2024-04-23T19:04:16.052590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:16.052402+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:16.052402+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.052402+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:01.687258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"116'2","reported_seq":293,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.974614+0000","last_change":"2024-04-23T19:04:06.974686+0000","last_active":"2024-04-23T19:04:06.974614+0000","last_peered":"2024-04-23T19:04:06.974614+0000","last_clean":"2024-04-23T19:04:06.974614+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:04:06.974614+0000","last_undegraded":"2024-04-23T19:04:06.974614+0000","last_fullsized":"2024-04-23T19:04:06.974614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:06.974385+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.974385+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.974385+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:31.138018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'38","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.221006+0000","last_change":"2024-04-23T19:04:02.221089+0000","last_active":"2024-04-23T19:04:02.221006+0000","last_peered":"2024-04-23T19:04:02.221006+0000","last_clean":"2024-04-23T19:04:02.221006+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:04:02.221006+0000","last_undegraded":"2024-04-23T19:04:02.221006+0000","last_fullsized":"2024-04-23T19:04:02.221006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:02.220813+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:02.220813+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.220813+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:26.384447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.464968+0000","last_change":"2024-04-23T19:04:19.465071+0000","last_active":"2024-04-23T19:04:19.464968+0000","last_peered":"2024-04-23T19:04:19.464968+0000","last_clean":"2024-04-23T19:04:19.464968+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:04:19.464968+0000","last_undegraded":"2024-04-23T19:04:19.464968+0000","last_fullsized":"2024-04-23T19:04:19.464968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.464712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.464712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.464712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:19.055281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388884+0000","last_change":"2024-04-23T19:00:25.334293+0000","last_active":"2024-04-23T19:03:43.388884+0000","last_peered":"2024-04-23T19:03:43.388884+0000","last_clean":"2024-04-23T19:03:43.388884+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:03:43.388884+0000","last_undegraded":"2024-04-23T19:03:43.388884+0000","last_fullsized":"2024-04-23T19:03:43.388884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909583+0000","last_change":"2024-04-23T19:00:17.301026+0000","last_active":"2024-04-23T19:03:43.909583+0000","last_peered":"2024-04-23T19:03:43.909583+0000","last_clean":"2024-04-23T19:03:43.909583+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:03:43.909583+0000","last_undegraded":"2024-04-23T19:03:43.909583+0000","last_fullsized":"2024-04-23T19:03:43.909583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'62","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.200238+0000","last_change":"2024-04-23T19:00:15.279771+0000","last_active":"2024-04-23T19:03:56.200238+0000","last_peered":"2024-04-23T19:03:56.200238+0000","last_clean":"2024-04-23T19:03:56.200238+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:03:56.200238+0000","last_undegraded":"2024-04-23T19:03:56.200238+0000","last_fullsized":"2024-04-23T19:03:56.200238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.996260+0000","last_change":"2024-04-23T19:04:00.996299+0000","last_active":"2024-04-23T19:04:00.996260+0000","last_peered":"2024-04-23T19:04:00.996260+0000","last_clean":"2024-04-23T19:04:00.996260+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:04:00.996260+0000","last_undegraded":"2024-04-23T19:04:00.996260+0000","last_fullsized":"2024-04-23T19:04:00.996260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.996139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.783439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'23","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.691386+0000","last_change":"2024-04-23T19:04:10.691464+0000","last_active":"2024-04-23T19:04:10.691386+0000","last_peered":"2024-04-23T19:04:10.691386+0000","last_clean":"2024-04-23T19:04:10.691386+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:04:10.691386+0000","last_undegraded":"2024-04-23T19:04:10.691386+0000","last_fullsized":"2024-04-23T19:04:10.691386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:10.691176+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:10.691176+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.691176+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:23.752968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.824414+0000","last_change":"2024-04-23T19:04:05.824493+0000","last_active":"2024-04-23T19:04:05.824414+0000","last_peered":"2024-04-23T19:04:05.824414+0000","last_clean":"2024-04-23T19:04:05.824414+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:04:05.824414+0000","last_undegraded":"2024-04-23T19:04:05.824414+0000","last_fullsized":"2024-04-23T19:04:05.824414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.824218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.824218+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.824218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:51.459074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708777+0000","last_change":"2024-04-23T19:00:25.344995+0000","last_active":"2024-04-23T19:03:43.708777+0000","last_peered":"2024-04-23T19:03:43.708777+0000","last_clean":"2024-04-23T19:03:43.708777+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:03:43.708777+0000","last_undegraded":"2024-04-23T19:03:43.708777+0000","last_fullsized":"2024-04-23T19:03:43.708777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.238092+0000","last_change":"2024-04-23T19:04:04.238150+0000","last_active":"2024-04-23T19:04:04.238092+0000","last_peered":"2024-04-23T19:04:04.238092+0000","last_clean":"2024-04-23T19:04:04.238092+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:04:04.238092+0000","last_undegraded":"2024-04-23T19:04:04.238092+0000","last_fullsized":"2024-04-23T19:04:04.238092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:04.237885+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:04.237885+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.237885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:18.605731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'28","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.030762+0000","last_change":"2024-04-23T19:04:12.030820+0000","last_active":"2024-04-23T19:04:12.030762+0000","last_peered":"2024-04-23T19:04:12.030762+0000","last_clean":"2024-04-23T19:04:12.030762+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:04:12.030762+0000","last_undegraded":"2024-04-23T19:04:12.030762+0000","last_fullsized":"2024-04-23T19:04:12.030762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:12.030567+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:12.030567+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.030567+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:15.472747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.017534+0000","last_change":"2024-04-23T19:04:02.017639+0000","last_active":"2024-04-23T19:04:02.017534+0000","last_peered":"2024-04-23T19:04:02.017534+0000","last_clean":"2024-04-23T19:04:02.017534+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:04:02.017534+0000","last_undegraded":"2024-04-23T19:04:02.017534+0000","last_fullsized":"2024-04-23T19:04:02.017534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.017294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.017294+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.017294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:06.320183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'32","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.053831+0000","last_change":"2024-04-23T19:04:13.053915+0000","last_active":"2024-04-23T19:04:13.053831+0000","last_peered":"2024-04-23T19:04:13.053831+0000","last_clean":"2024-04-23T19:04:13.053831+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:04:13.053831+0000","last_undegraded":"2024-04-23T19:04:13.053831+0000","last_fullsized":"2024-04-23T19:04:13.053831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:13.053625+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:13.053625+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.053625+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:12.306410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'138","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.588692+0000","last_change":"2024-04-23T19:04:19.588841+0000","last_active":"2024-04-23T19:04:19.588692+0000","last_peered":"2024-04-23T19:04:19.588692+0000","last_clean":"2024-04-23T19:04:19.588692+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:04:19.588692+0000","last_undegraded":"2024-04-23T19:04:19.588692+0000","last_fullsized":"2024-04-23T19:04:19.588692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:19.588382+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:19.588382+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.588382+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:26.154620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.400773+0000","last_change":"2024-04-23T19:03:59.400805+0000","last_active":"2024-04-23T19:03:59.400773+0000","last_peered":"2024-04-23T19:03:59.400773+0000","last_clean":"2024-04-23T19:03:59.400773+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:59.400773+0000","last_undegraded":"2024-04-23T19:03:59.400773+0000","last_fullsized":"2024-04-23T19:03:59.400773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_clean_scrub_stamp":"2024-04-23T19:03:59.400658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:02.291518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114010+0000","last_change":"2024-04-23T19:00:17.295963+0000","last_active":"2024-04-23T19:03:44.114010+0000","last_peered":"2024-04-23T19:03:44.114010+0000","last_clean":"2024-04-23T19:03:44.114010+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:03:44.114010+0000","last_undegraded":"2024-04-23T19:03:44.114010+0000","last_fullsized":"2024-04-23T19:03:44.114010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'36","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.241117+0000","last_change":"2024-04-23T19:00:15.269763+0000","last_active":"2024-04-23T19:03:56.241117+0000","last_peered":"2024-04-23T19:03:56.241117+0000","last_clean":"2024-04-23T19:03:56.241117+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:03:56.241117+0000","last_undegraded":"2024-04-23T19:03:56.241117+0000","last_fullsized":"2024-04-23T19:03:56.241117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.035178+0000","last_change":"2024-04-23T19:04:13.035240+0000","last_active":"2024-04-23T19:04:13.035178+0000","last_peered":"2024-04-23T19:04:13.035178+0000","last_clean":"2024-04-23T19:04:13.035178+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:04:13.035178+0000","last_undegraded":"2024-04-23T19:04:13.035178+0000","last_fullsized":"2024-04-23T19:04:13.035178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:13.034980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:13.034980+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.034980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:35.581669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'40","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.594338+0000","last_change":"2024-04-23T19:04:17.594412+0000","last_active":"2024-04-23T19:04:17.594338+0000","last_peered":"2024-04-23T19:04:17.594338+0000","last_clean":"2024-04-23T19:04:17.594338+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:04:17.594338+0000","last_undegraded":"2024-04-23T19:04:17.594338+0000","last_fullsized":"2024-04-23T19:04:17.594338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:17.594124+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:17.594124+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.594124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:38.141344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.133572+0000","last_change":"2024-04-23T19:04:17.133626+0000","last_active":"2024-04-23T19:04:17.133572+0000","last_peered":"2024-04-23T19:04:17.133572+0000","last_clean":"2024-04-23T19:04:17.133572+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:04:17.133572+0000","last_undegraded":"2024-04-23T19:04:17.133572+0000","last_fullsized":"2024-04-23T19:04:17.133572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.133385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.133385+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.133385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.033787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"116'9","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.432949+0000","last_change":"2024-04-23T19:04:02.432972+0000","last_active":"2024-04-23T19:04:02.432949+0000","last_peered":"2024-04-23T19:04:02.432949+0000","last_clean":"2024-04-23T19:04:02.432949+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:04:02.432949+0000","last_undegraded":"2024-04-23T19:04:02.432949+0000","last_fullsized":"2024-04-23T19:04:02.432949+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'9","last_scrub_stamp":"2024-04-23T19:04:02.432887+0000","last_deep_scrub":"116'9","last_deep_scrub_stamp":"2024-04-23T19:04:02.432887+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.432887+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:38.237620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.068383+0000","last_change":"2024-04-23T19:04:12.068446+0000","last_active":"2024-04-23T19:04:12.068383+0000","last_peered":"2024-04-23T19:04:12.068383+0000","last_clean":"2024-04-23T19:04:12.068383+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:04:12.068383+0000","last_undegraded":"2024-04-23T19:04:12.068383+0000","last_fullsized":"2024-04-23T19:04:12.068383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:12.068159+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:12.068159+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.068159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:42.391569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'42","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.234383+0000","last_change":"2024-04-23T19:00:15.260345+0000","last_active":"2024-04-23T19:03:56.234383+0000","last_peered":"2024-04-23T19:03:56.234383+0000","last_clean":"2024-04-23T19:03:56.234383+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:03:56.234383+0000","last_undegraded":"2024-04-23T19:03:56.234383+0000","last_fullsized":"2024-04-23T19:03:56.234383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.943499+0000","last_change":"2024-04-23T19:04:03.943553+0000","last_active":"2024-04-23T19:04:03.943499+0000","last_peered":"2024-04-23T19:04:03.943499+0000","last_clean":"2024-04-23T19:04:03.943499+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:04:03.943499+0000","last_undegraded":"2024-04-23T19:04:03.943499+0000","last_fullsized":"2024-04-23T19:04:03.943499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.943302+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:33.673299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'26","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.881699+0000","last_change":"2024-04-23T19:04:02.881845+0000","last_active":"2024-04-23T19:04:02.881699+0000","last_peered":"2024-04-23T19:04:02.881699+0000","last_clean":"2024-04-23T19:04:02.881699+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:04:02.881699+0000","last_undegraded":"2024-04-23T19:04:02.881699+0000","last_fullsized":"2024-04-23T19:04:02.881699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:02.881475+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:02.881475+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.881475+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:51.012695+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114550+0000","last_change":"2024-04-23T19:00:23.328042+0000","last_active":"2024-04-23T19:03:44.114550+0000","last_peered":"2024-04-23T19:03:44.114550+0000","last_clean":"2024-04-23T19:03:44.114550+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:03:44.114550+0000","last_undegraded":"2024-04-23T19:03:44.114550+0000","last_fullsized":"2024-04-23T19:03:44.114550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388250+0000","last_change":"2024-04-23T19:00:25.351413+0000","last_active":"2024-04-23T19:03:43.388250+0000","last_peered":"2024-04-23T19:03:43.388250+0000","last_clean":"2024-04-23T19:03:43.388250+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:03:43.388250+0000","last_undegraded":"2024-04-23T19:03:43.388250+0000","last_fullsized":"2024-04-23T19:03:43.388250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.092948+0000","last_change":"2024-04-23T19:04:14.093012+0000","last_active":"2024-04-23T19:04:14.092948+0000","last_peered":"2024-04-23T19:04:14.092948+0000","last_clean":"2024-04-23T19:04:14.092948+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:04:14.092948+0000","last_undegraded":"2024-04-23T19:04:14.092948+0000","last_fullsized":"2024-04-23T19:04:14.092948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:14.092748+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:14.092748+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.092748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:34.839102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'50","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.132040+0000","last_change":"2024-04-23T19:04:13.132101+0000","last_active":"2024-04-23T19:04:13.132040+0000","last_peered":"2024-04-23T19:04:13.132040+0000","last_clean":"2024-04-23T19:04:13.132040+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:04:13.132040+0000","last_undegraded":"2024-04-23T19:04:13.132040+0000","last_fullsized":"2024-04-23T19:04:13.132040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-04-23T19:04:13.131846+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-04-23T19:04:13.131846+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.131846+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:01.263066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.500436+0000","last_change":"2024-04-23T19:04:05.500510+0000","last_active":"2024-04-23T19:04:05.500436+0000","last_peered":"2024-04-23T19:04:05.500436+0000","last_clean":"2024-04-23T19:04:05.500436+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:04:05.500436+0000","last_undegraded":"2024-04-23T19:04:05.500436+0000","last_fullsized":"2024-04-23T19:04:05.500436+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.500207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.500207+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.500207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:54.624476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'35","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.088728+0000","last_change":"2024-04-23T19:04:14.088806+0000","last_active":"2024-04-23T19:04:14.088728+0000","last_peered":"2024-04-23T19:04:14.088728+0000","last_clean":"2024-04-23T19:04:14.088728+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:04:14.088728+0000","last_undegraded":"2024-04-23T19:04:14.088728+0000","last_fullsized":"2024-04-23T19:04:14.088728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'35","last_scrub_stamp":"2024-04-23T19:04:14.088533+0000","last_deep_scrub":"116'35","last_deep_scrub_stamp":"2024-04-23T19:04:14.088533+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.088533+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:22.612491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":146,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":388,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.159473+0000","last_change":"2024-04-23T19:04:16.159540+0000","last_active":"2024-04-23T19:04:16.159473+0000","last_peered":"2024-04-23T19:04:16.159473+0000","last_clean":"2024-04-23T19:04:16.159473+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:04:16.159473+0000","last_undegraded":"2024-04-23T19:04:16.159473+0000","last_fullsized":"2024-04-23T19:04:16.159473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:16.159281+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:16.159281+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.159281+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:48.033509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":163,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.459746+0000","last_change":"2024-04-23T19:04:11.459809+0000","last_active":"2024-04-23T19:04:11.459746+0000","last_peered":"2024-04-23T19:04:11.459746+0000","last_clean":"2024-04-23T19:04:11.459746+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:04:11.459746+0000","last_undegraded":"2024-04-23T19:04:11.459746+0000","last_fullsized":"2024-04-23T19:04:11.459746+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-04-23T19:04:11.459542+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-04-23T19:04:11.459542+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.459542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:08.060469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.983981+0000","last_change":"2024-04-23T19:04:07.984042+0000","last_active":"2024-04-23T19:04:07.983981+0000","last_peered":"2024-04-23T19:04:07.983981+0000","last_clean":"2024-04-23T19:04:07.983981+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:04:07.983981+0000","last_undegraded":"2024-04-23T19:04:07.983981+0000","last_fullsized":"2024-04-23T19:04:07.983981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'8","last_scrub_stamp":"2024-04-23T19:04:07.983769+0000","last_deep_scrub":"57'8","last_deep_scrub_stamp":"2024-04-23T19:04:07.983769+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.983769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:55.287742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'56","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.247088+0000","last_change":"2024-04-23T19:00:15.273819+0000","last_active":"2024-04-23T19:03:56.247088+0000","last_peered":"2024-04-23T19:03:56.247088+0000","last_clean":"2024-04-23T19:03:56.247088+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:03:56.247088+0000","last_undegraded":"2024-04-23T19:03:56.247088+0000","last_fullsized":"2024-04-23T19:03:56.247088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":388,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.391256+0000","last_change":"2024-04-23T19:04:12.391394+0000","last_active":"2024-04-23T19:04:12.391256+0000","last_peered":"2024-04-23T19:04:12.391256+0000","last_clean":"2024-04-23T19:04:12.391256+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:04:12.391256+0000","last_undegraded":"2024-04-23T19:04:12.391256+0000","last_fullsized":"2024-04-23T19:04:12.391256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-04-23T19:04:12.390988+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-04-23T19:04:12.390988+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.390988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:33.137342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"116'17","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.737886+0000","last_change":"2024-04-23T19:04:08.737961+0000","last_active":"2024-04-23T19:04:08.737886+0000","last_peered":"2024-04-23T19:04:08.737886+0000","last_clean":"2024-04-23T19:04:08.737886+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:04:08.737886+0000","last_undegraded":"2024-04-23T19:04:08.737886+0000","last_fullsized":"2024-04-23T19:04:08.737886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'17","last_scrub_stamp":"2024-04-23T19:04:08.737701+0000","last_deep_scrub":"116'17","last_deep_scrub_stamp":"2024-04-23T19:04:08.737701+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.737701+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.905021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":419,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.174174+0000","last_change":"2024-04-23T19:04:19.174316+0000","last_active":"2024-04-23T19:04:19.174174+0000","last_peered":"2024-04-23T19:04:19.174174+0000","last_clean":"2024-04-23T19:04:19.174174+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:04:19.174174+0000","last_undegraded":"2024-04-23T19:04:19.174174+0000","last_fullsized":"2024-04-23T19:04:19.174174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:19.173947+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:19.173947+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.173947+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:08.298216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910253+0000","last_change":"2024-04-23T19:00:25.332042+0000","last_active":"2024-04-23T19:03:43.910253+0000","last_peered":"2024-04-23T19:03:43.910253+0000","last_clean":"2024-04-23T19:03:43.910253+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:03:43.910253+0000","last_undegraded":"2024-04-23T19:03:43.910253+0000","last_fullsized":"2024-04-23T19:03:43.910253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.459926+0000","last_change":"2024-04-23T19:04:17.459989+0000","last_active":"2024-04-23T19:04:17.459926+0000","last_peered":"2024-04-23T19:04:17.459926+0000","last_clean":"2024-04-23T19:04:17.459926+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:04:17.459926+0000","last_undegraded":"2024-04-23T19:04:17.459926+0000","last_fullsized":"2024-04-23T19:04:17.459926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.459688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.459688+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.459688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:34:01.304683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.261061+0000","last_change":"2024-04-23T19:00:15.261353+0000","last_active":"2024-04-23T19:03:56.261061+0000","last_peered":"2024-04-23T19:03:56.261061+0000","last_clean":"2024-04-23T19:03:56.261061+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:03:56.261061+0000","last_undegraded":"2024-04-23T19:03:56.261061+0000","last_fullsized":"2024-04-23T19:03:56.261061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.109328+0000","last_change":"2024-04-23T19:04:21.109384+0000","last_active":"2024-04-23T19:04:21.109328+0000","last_peered":"2024-04-23T19:04:21.109328+0000","last_clean":"2024-04-23T19:04:21.109328+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:04:21.109328+0000","last_undegraded":"2024-04-23T19:04:21.109328+0000","last_fullsized":"2024-04-23T19:04:21.109328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.109080+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.109080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:58.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'29","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.346683+0000","last_change":"2024-04-23T19:00:21.312595+0000","last_active":"2024-04-23T19:03:55.346683+0000","last_peered":"2024-04-23T19:03:55.346683+0000","last_clean":"2024-04-23T19:03:55.346683+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:03:55.346683+0000","last_undegraded":"2024-04-23T19:03:55.346683+0000","last_fullsized":"2024-04-23T19:03:55.346683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.234660+0000","last_change":"2024-04-23T19:04:07.234718+0000","last_active":"2024-04-23T19:04:07.234660+0000","last_peered":"2024-04-23T19:04:07.234660+0000","last_clean":"2024-04-23T19:04:07.234660+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:04:07.234660+0000","last_undegraded":"2024-04-23T19:04:07.234660+0000","last_fullsized":"2024-04-23T19:04:07.234660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.234461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.234461+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.234461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:52.151995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":153,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113372+0000","last_change":"2024-04-23T19:03:32.303679+0000","last_active":"2024-04-23T19:03:44.113372+0000","last_peered":"2024-04-23T19:03:44.113372+0000","last_clean":"2024-04-23T19:03:44.113372+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:03:44.113372+0000","last_undegraded":"2024-04-23T19:03:44.113372+0000","last_fullsized":"2024-04-23T19:03:44.113372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.228220+0000","last_change":"2024-04-23T19:04:08.228280+0000","last_active":"2024-04-23T19:04:08.228220+0000","last_peered":"2024-04-23T19:04:08.228220+0000","last_clean":"2024-04-23T19:04:08.228220+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:04:08.228220+0000","last_undegraded":"2024-04-23T19:04:08.228220+0000","last_fullsized":"2024-04-23T19:04:08.228220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:08.228012+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:08.228012+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.228012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:30.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"116'119","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.960633+0000","last_change":"2024-04-23T19:04:20.960714+0000","last_active":"2024-04-23T19:04:20.960633+0000","last_peered":"2024-04-23T19:04:20.960633+0000","last_clean":"2024-04-23T19:04:20.960633+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:04:20.960633+0000","last_undegraded":"2024-04-23T19:04:20.960633+0000","last_fullsized":"2024-04-23T19:04:20.960633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'119","last_scrub_stamp":"2024-04-23T19:04:20.960444+0000","last_deep_scrub":"116'119","last_deep_scrub_stamp":"2024-04-23T19:04:20.960444+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.960444+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:32.947863+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.628448+0000","last_change":"2024-04-23T19:00:09.194186+0000","last_active":"2024-04-23T19:04:01.628448+0000","last_peered":"2024-04-23T19:04:01.628448+0000","last_clean":"2024-04-23T19:04:01.628448+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:04:01.628448+0000","last_undegraded":"2024-04-23T19:04:01.628448+0000","last_fullsized":"2024-04-23T19:04:01.628448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.260886+0000","last_change":"2024-04-23T19:00:15.279442+0000","last_active":"2024-04-23T19:03:56.260886+0000","last_peered":"2024-04-23T19:03:56.260886+0000","last_clean":"2024-04-23T19:03:56.260886+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:03:56.260886+0000","last_undegraded":"2024-04-23T19:03:56.260886+0000","last_fullsized":"2024-04-23T19:03:56.260886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.024486+0000","last_change":"2024-04-23T19:04:11.024537+0000","last_active":"2024-04-23T19:04:11.024486+0000","last_peered":"2024-04-23T19:04:11.024486+0000","last_clean":"2024-04-23T19:04:11.024486+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:04:11.024486+0000","last_undegraded":"2024-04-23T19:04:11.024486+0000","last_fullsized":"2024-04-23T19:04:11.024486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:11.024301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:11.024301+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.024301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.562463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'51","reported_seq":275,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.255381+0000","last_change":"2024-04-23T19:04:03.255459+0000","last_active":"2024-04-23T19:04:03.255381+0000","last_peered":"2024-04-23T19:04:03.255381+0000","last_clean":"2024-04-23T19:04:03.255381+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:04:03.255381+0000","last_undegraded":"2024-04-23T19:04:03.255381+0000","last_fullsized":"2024-04-23T19:04:03.255381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'51","last_scrub_stamp":"2024-04-23T19:04:03.255190+0000","last_deep_scrub":"116'51","last_deep_scrub_stamp":"2024-04-23T19:04:03.255190+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.255190+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:56.231137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.469304+0000","last_change":"2024-04-23T19:04:03.469410+0000","last_active":"2024-04-23T19:04:03.469304+0000","last_peered":"2024-04-23T19:04:03.469304+0000","last_clean":"2024-04-23T19:04:03.469304+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:04:03.469304+0000","last_undegraded":"2024-04-23T19:04:03.469304+0000","last_fullsized":"2024-04-23T19:04:03.469304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.469047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.469047+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.469047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:51.490970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.707806+0000","last_change":"2024-04-23T19:00:25.326216+0000","last_active":"2024-04-23T19:03:43.707806+0000","last_peered":"2024-04-23T19:03:43.707806+0000","last_clean":"2024-04-23T19:03:43.707806+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:03:43.707806+0000","last_undegraded":"2024-04-23T19:03:43.707806+0000","last_fullsized":"2024-04-23T19:03:43.707806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.605966+0000","last_change":"2024-04-23T19:04:20.606031+0000","last_active":"2024-04-23T19:04:20.605966+0000","last_peered":"2024-04-23T19:04:20.605966+0000","last_clean":"2024-04-23T19:04:20.605966+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:04:20.605966+0000","last_undegraded":"2024-04-23T19:04:20.605966+0000","last_fullsized":"2024-04-23T19:04:20.605966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:20.605740+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:20.605740+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.605740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:27.818753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":116,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-23T19:04:21.957890+0000","last_change":"2024-04-23T19:04:21.957581+0000","last_active":"2024-04-23T19:04:21.957890+0000","last_peered":"2024-04-23T19:04:21.957890+0000","last_clean":"2024-04-23T19:04:21.957890+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:04:21.957890+0000","last_undegraded":"2024-04-23T19:04:21.957890+0000","last_fullsized":"2024-04-23T19:04:21.957890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'64","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.258581+0000","last_change":"2024-04-23T19:00:15.275779+0000","last_active":"2024-04-23T19:03:56.258581+0000","last_peered":"2024-04-23T19:03:56.258581+0000","last_clean":"2024-04-23T19:03:56.258581+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:03:56.258581+0000","last_undegraded":"2024-04-23T19:03:56.258581+0000","last_fullsized":"2024-04-23T19:03:56.258581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.355403+0000","last_change":"2024-04-23T19:04:16.355462+0000","last_active":"2024-04-23T19:04:16.355403+0000","last_peered":"2024-04-23T19:04:16.355403+0000","last_clean":"2024-04-23T19:04:16.355403+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:04:16.355403+0000","last_undegraded":"2024-04-23T19:04:16.355403+0000","last_fullsized":"2024-04-23T19:04:16.355403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:16.355181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:16.355181+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.355181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:29.416973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'155","reported_seq":469,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.452484+0000","last_change":"2024-04-23T19:04:18.452650+0000","last_active":"2024-04-23T19:04:18.452484+0000","last_peered":"2024-04-23T19:04:18.452484+0000","last_clean":"2024-04-23T19:04:18.452484+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:04:18.452484+0000","last_undegraded":"2024-04-23T19:04:18.452484+0000","last_fullsized":"2024-04-23T19:04:18.452484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'155","last_scrub_stamp":"2024-04-23T19:04:18.452249+0000","last_deep_scrub":"116'155","last_deep_scrub_stamp":"2024-04-23T19:04:18.452249+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.452249+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:26.229526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114470+0000","last_change":"2024-04-23T19:00:23.343877+0000","last_active":"2024-04-23T19:03:44.114470+0000","last_peered":"2024-04-23T19:03:44.114470+0000","last_clean":"2024-04-23T19:03:44.114470+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:03:44.114470+0000","last_undegraded":"2024-04-23T19:03:44.114470+0000","last_fullsized":"2024-04-23T19:03:44.114470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.462170+0000","last_change":"2024-04-23T19:04:21.462234+0000","last_active":"2024-04-23T19:04:21.462170+0000","last_peered":"2024-04-23T19:04:21.462170+0000","last_clean":"2024-04-23T19:04:21.462170+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:04:21.462170+0000","last_undegraded":"2024-04-23T19:04:21.462170+0000","last_fullsized":"2024-04-23T19:04:21.462170+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-23T19:04:21.461933+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-23T19:04:21.461933+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.461933+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:42.009153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.408129+0000","last_change":"2024-04-23T19:04:15.408224+0000","last_active":"2024-04-23T19:04:15.408129+0000","last_peered":"2024-04-23T19:04:15.408129+0000","last_clean":"2024-04-23T19:04:15.408129+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:04:15.408129+0000","last_undegraded":"2024-04-23T19:04:15.408129+0000","last_fullsized":"2024-04-23T19:04:15.408129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-04-23T19:04:15.407932+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-04-23T19:04:15.407932+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.407932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:31.170100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.949922+0000","last_change":"2024-04-23T19:04:04.949922+0000","last_active":"2024-04-23T19:04:04.949922+0000","last_peered":"2024-04-23T19:04:04.949922+0000","last_clean":"2024-04-23T19:04:04.949922+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:04:04.949922+0000","last_undegraded":"2024-04-23T19:04:04.949922+0000","last_fullsized":"2024-04-23T19:04:04.949922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.949681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.949681+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.949681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:07:40.982094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'28","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.421424+0000","last_change":"2024-04-23T19:04:13.421424+0000","last_active":"2024-04-23T19:04:13.421424+0000","last_peered":"2024-04-23T19:04:13.421424+0000","last_clean":"2024-04-23T19:04:13.421424+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:04:13.421424+0000","last_undegraded":"2024-04-23T19:04:13.421424+0000","last_fullsized":"2024-04-23T19:04:13.421424+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:13.420977+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:13.420977+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.420977+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:29.751910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.987101+0000","last_change":"2024-04-23T19:04:02.987211+0000","last_active":"2024-04-23T19:04:02.987101+0000","last_peered":"2024-04-23T19:04:02.987101+0000","last_clean":"2024-04-23T19:04:02.987101+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:04:02.987101+0000","last_undegraded":"2024-04-23T19:04:02.987101+0000","last_fullsized":"2024-04-23T19:04:02.987101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:02.986892+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:02.986892+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.986892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:20:45.106266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'17","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:48.813207+0000","last_change":"2024-04-23T19:00:21.314061+0000","last_active":"2024-04-23T19:03:48.813207+0000","last_peered":"2024-04-23T19:03:48.813207+0000","last_clean":"2024-04-23T19:03:48.813207+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:03:48.813207+0000","last_undegraded":"2024-04-23T19:03:48.813207+0000","last_fullsized":"2024-04-23T19:03:48.813207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.501385+0000","last_change":"2024-04-23T19:04:06.501448+0000","last_active":"2024-04-23T19:04:06.501385+0000","last_peered":"2024-04-23T19:04:06.501385+0000","last_clean":"2024-04-23T19:04:06.501385+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:04:06.501385+0000","last_undegraded":"2024-04-23T19:04:06.501385+0000","last_fullsized":"2024-04-23T19:04:06.501385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:06.501180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:06.501180+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.501180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:27.247533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392445+0000","last_change":"2024-04-23T19:00:25.352661+0000","last_active":"2024-04-23T19:03:43.392445+0000","last_peered":"2024-04-23T19:03:43.392445+0000","last_clean":"2024-04-23T19:03:43.392445+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:03:43.392445+0000","last_undegraded":"2024-04-23T19:03:43.392445+0000","last_fullsized":"2024-04-23T19:03:43.392445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.480148+0000","last_change":"2024-04-23T19:04:04.480207+0000","last_active":"2024-04-23T19:04:04.480148+0000","last_peered":"2024-04-23T19:04:04.480148+0000","last_clean":"2024-04-23T19:04:04.480148+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:04:04.480148+0000","last_undegraded":"2024-04-23T19:04:04.480148+0000","last_fullsized":"2024-04-23T19:04:04.480148+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:04.479918+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:04.479918+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.479918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:51.783891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.628434+0000","last_change":"2024-04-23T19:00:09.201415+0000","last_active":"2024-04-23T19:04:01.628434+0000","last_peered":"2024-04-23T19:04:01.628434+0000","last_clean":"2024-04-23T19:04:01.628434+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:04:01.628434+0000","last_undegraded":"2024-04-23T19:04:01.628434+0000","last_fullsized":"2024-04-23T19:04:01.628434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'36","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.245101+0000","last_change":"2024-04-23T19:00:15.278105+0000","last_active":"2024-04-23T19:03:56.245101+0000","last_peered":"2024-04-23T19:03:56.245101+0000","last_clean":"2024-04-23T19:03:56.245101+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:03:56.245101+0000","last_undegraded":"2024-04-23T19:03:56.245101+0000","last_fullsized":"2024-04-23T19:03:56.245101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"116'2","reported_seq":292,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.510923+0000","last_change":"2024-04-23T19:04:11.510991+0000","last_active":"2024-04-23T19:04:11.510923+0000","last_peered":"2024-04-23T19:04:11.510923+0000","last_clean":"2024-04-23T19:04:11.510923+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:04:11.510923+0000","last_undegraded":"2024-04-23T19:04:11.510923+0000","last_fullsized":"2024-04-23T19:04:11.510923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:11.510730+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.510730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.510730+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:27.272898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393136+0000","last_change":"2024-04-23T19:00:21.302434+0000","last_active":"2024-04-23T19:03:43.393136+0000","last_peered":"2024-04-23T19:03:43.393136+0000","last_clean":"2024-04-23T19:03:43.393136+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:03:43.393136+0000","last_undegraded":"2024-04-23T19:03:43.393136+0000","last_fullsized":"2024-04-23T19:03:43.393136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.709877+0000","last_change":"2024-04-23T19:00:23.334361+0000","last_active":"2024-04-23T19:03:43.709877+0000","last_peered":"2024-04-23T19:03:43.709877+0000","last_clean":"2024-04-23T19:03:43.709877+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:03:43.709877+0000","last_undegraded":"2024-04-23T19:03:43.709877+0000","last_fullsized":"2024-04-23T19:03:43.709877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.387779+0000","last_change":"2024-04-23T19:00:25.338271+0000","last_active":"2024-04-23T19:03:43.387779+0000","last_peered":"2024-04-23T19:03:43.387779+0000","last_clean":"2024-04-23T19:03:43.387779+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:03:43.387779+0000","last_undegraded":"2024-04-23T19:03:43.387779+0000","last_fullsized":"2024-04-23T19:03:43.387779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.474019+0000","last_change":"2024-04-23T19:04:03.474072+0000","last_active":"2024-04-23T19:04:03.474019+0000","last_peered":"2024-04-23T19:04:03.474019+0000","last_clean":"2024-04-23T19:04:03.474019+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:04:03.474019+0000","last_undegraded":"2024-04-23T19:04:03.474019+0000","last_fullsized":"2024-04-23T19:04:03.474019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.473795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.473795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.473795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:46.953046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.297757+0000","last_change":"2024-04-23T19:00:15.267764+0000","last_active":"2024-04-23T19:03:56.297757+0000","last_peered":"2024-04-23T19:03:56.297757+0000","last_clean":"2024-04-23T19:03:56.297757+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:03:56.297757+0000","last_undegraded":"2024-04-23T19:03:56.297757+0000","last_fullsized":"2024-04-23T19:03:56.297757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.435963+0000","last_change":"2024-04-23T19:04:00.435963+0000","last_active":"2024-04-23T19:04:00.435963+0000","last_peered":"2024-04-23T19:04:00.435963+0000","last_clean":"2024-04-23T19:04:00.435963+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:04:00.435963+0000","last_undegraded":"2024-04-23T19:04:00.435963+0000","last_fullsized":"2024-04-23T19:04:00.435963+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.435859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:34.052330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.491324+0000","last_change":"2024-04-23T19:04:09.491378+0000","last_active":"2024-04-23T19:04:09.491324+0000","last_peered":"2024-04-23T19:04:09.491324+0000","last_clean":"2024-04-23T19:04:09.491324+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:04:09.491324+0000","last_undegraded":"2024-04-23T19:04:09.491324+0000","last_fullsized":"2024-04-23T19:04:09.491324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.491110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.491110+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.491110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:25.822043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'46","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.628738+0000","last_change":"2024-04-23T19:04:15.628738+0000","last_active":"2024-04-23T19:04:15.628738+0000","last_peered":"2024-04-23T19:04:15.628738+0000","last_clean":"2024-04-23T19:04:15.628738+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:04:15.628738+0000","last_undegraded":"2024-04-23T19:04:15.628738+0000","last_fullsized":"2024-04-23T19:04:15.628738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:15.628439+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:15.628439+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.628439+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:22.658481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909053+0000","last_change":"2024-04-23T19:00:23.323056+0000","last_active":"2024-04-23T19:03:43.909053+0000","last_peered":"2024-04-23T19:03:43.909053+0000","last_clean":"2024-04-23T19:03:43.909053+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:03:43.909053+0000","last_undegraded":"2024-04-23T19:03:43.909053+0000","last_fullsized":"2024-04-23T19:03:43.909053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.379144+0000","last_change":"2024-04-23T19:04:01.379184+0000","last_active":"2024-04-23T19:04:01.379144+0000","last_peered":"2024-04-23T19:04:01.379144+0000","last_clean":"2024-04-23T19:04:01.379144+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:04:01.379144+0000","last_undegraded":"2024-04-23T19:04:01.379144+0000","last_fullsized":"2024-04-23T19:04:01.379144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.379039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:04.821220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.485510+0000","last_change":"2024-04-23T19:04:08.485633+0000","last_active":"2024-04-23T19:04:08.485510+0000","last_peered":"2024-04-23T19:04:08.485510+0000","last_clean":"2024-04-23T19:04:08.485510+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:04:08.485510+0000","last_undegraded":"2024-04-23T19:04:08.485510+0000","last_fullsized":"2024-04-23T19:04:08.485510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'8","last_scrub_stamp":"2024-04-23T19:04:08.485266+0000","last_deep_scrub":"57'8","last_deep_scrub_stamp":"2024-04-23T19:04:08.485266+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.485266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.652586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'44","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.161909+0000","last_change":"2024-04-23T19:03:32.303530+0000","last_active":"2024-04-23T19:03:56.161909+0000","last_peered":"2024-04-23T19:03:56.161909+0000","last_clean":"2024-04-23T19:03:56.161909+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:03:56.161909+0000","last_undegraded":"2024-04-23T19:03:56.161909+0000","last_fullsized":"2024-04-23T19:03:56.161909+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.551157+0000","last_change":"2024-04-23T19:00:09.583880+0000","last_active":"2024-04-23T19:04:02.551157+0000","last_peered":"2024-04-23T19:04:02.551157+0000","last_clean":"2024-04-23T19:04:02.551157+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:04:02.551157+0000","last_undegraded":"2024-04-23T19:04:02.551157+0000","last_fullsized":"2024-04-23T19:04:02.551157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.221679+0000","last_change":"2024-04-23T19:04:03.221738+0000","last_active":"2024-04-23T19:04:03.221679+0000","last_peered":"2024-04-23T19:04:03.221679+0000","last_clean":"2024-04-23T19:04:03.221679+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:04:03.221679+0000","last_undegraded":"2024-04-23T19:04:03.221679+0000","last_fullsized":"2024-04-23T19:04:03.221679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.221480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.221480+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.221480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:58.768547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"116'21","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.516915+0000","last_change":"2024-04-23T19:04:10.516993+0000","last_active":"2024-04-23T19:04:10.516915+0000","last_peered":"2024-04-23T19:04:10.516915+0000","last_clean":"2024-04-23T19:04:10.516915+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:04:10.516915+0000","last_undegraded":"2024-04-23T19:04:10.516915+0000","last_fullsized":"2024-04-23T19:04:10.516915+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-04-23T19:04:10.516730+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-04-23T19:04:10.516730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.516730+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:31.263084+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'138","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.319871+0000","last_change":"2024-04-23T19:00:23.325726+0000","last_active":"2024-04-23T19:03:56.319871+0000","last_peered":"2024-04-23T19:03:56.319871+0000","last_clean":"2024-04-23T19:03:56.319871+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:03:56.319871+0000","last_undegraded":"2024-04-23T19:03:56.319871+0000","last_fullsized":"2024-04-23T19:03:56.319871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.393352+0000","last_change":"2024-04-23T19:00:25.351079+0000","last_active":"2024-04-23T19:03:43.393352+0000","last_peered":"2024-04-23T19:03:43.393352+0000","last_clean":"2024-04-23T19:03:43.393352+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:03:43.393352+0000","last_undegraded":"2024-04-23T19:03:43.393352+0000","last_fullsized":"2024-04-23T19:03:43.393352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.722695+0000","last_change":"2024-04-23T19:04:11.722695+0000","last_active":"2024-04-23T19:04:11.722695+0000","last_peered":"2024-04-23T19:04:11.722695+0000","last_clean":"2024-04-23T19:04:11.722695+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:04:11.722695+0000","last_undegraded":"2024-04-23T19:04:11.722695+0000","last_fullsized":"2024-04-23T19:04:11.722695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:11.722335+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.722335+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.722335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:27.484503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'40","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.219803+0000","last_change":"2024-04-23T19:00:15.271954+0000","last_active":"2024-04-23T19:03:56.219803+0000","last_peered":"2024-04-23T19:03:56.219803+0000","last_clean":"2024-04-23T19:03:56.219803+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:03:56.219803+0000","last_undegraded":"2024-04-23T19:03:56.219803+0000","last_fullsized":"2024-04-23T19:03:56.219803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115572+0000","last_change":"2024-04-23T19:03:32.305039+0000","last_active":"2024-04-23T19:03:44.115572+0000","last_peered":"2024-04-23T19:03:44.115572+0000","last_clean":"2024-04-23T19:03:44.115572+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:03:44.115572+0000","last_undegraded":"2024-04-23T19:03:44.115572+0000","last_fullsized":"2024-04-23T19:03:44.115572+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:08.174824+0000","last_clean_scrub_stamp":"2024-04-23T19:00:08.174824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.140735+0000","last_change":"2024-04-23T19:04:19.140787+0000","last_active":"2024-04-23T19:04:19.140735+0000","last_peered":"2024-04-23T19:04:19.140735+0000","last_clean":"2024-04-23T19:04:19.140735+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:04:19.140735+0000","last_undegraded":"2024-04-23T19:04:19.140735+0000","last_fullsized":"2024-04-23T19:04:19.140735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.140514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.140514+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.140514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:34.902682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"116'15","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.914619+0000","last_change":"2024-04-23T19:04:05.914749+0000","last_active":"2024-04-23T19:04:05.914619+0000","last_peered":"2024-04-23T19:04:05.914619+0000","last_clean":"2024-04-23T19:04:05.914619+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:04:05.914619+0000","last_undegraded":"2024-04-23T19:04:05.914619+0000","last_fullsized":"2024-04-23T19:04:05.914619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:05.914386+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:05.914386+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.914386+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:41.719119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'138","reported_seq":451,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.816596+0000","last_change":"2024-04-23T19:04:03.816660+0000","last_active":"2024-04-23T19:04:03.816596+0000","last_peered":"2024-04-23T19:04:03.816596+0000","last_clean":"2024-04-23T19:04:03.816596+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:04:03.816596+0000","last_undegraded":"2024-04-23T19:04:03.816596+0000","last_fullsized":"2024-04-23T19:04:03.816596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:03.816386+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:03.816386+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.816386+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:51.838308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":123,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.956744+0000","last_change":"2024-04-23T19:01:39.096276+0000","last_active":"2024-04-23T19:03:56.956744+0000","last_peered":"2024-04-23T19:03:56.956744+0000","last_clean":"2024-04-23T19:03:56.956744+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:03:56.956744+0000","last_undegraded":"2024-04-23T19:03:56.956744+0000","last_fullsized":"2024-04-23T19:03:56.956744+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909543+0000","last_change":"2024-04-23T19:00:17.300852+0000","last_active":"2024-04-23T19:03:43.909543+0000","last_peered":"2024-04-23T19:03:43.909543+0000","last_clean":"2024-04-23T19:03:43.909543+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:03:43.909543+0000","last_undegraded":"2024-04-23T19:03:43.909543+0000","last_fullsized":"2024-04-23T19:03:43.909543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'44","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.258728+0000","last_change":"2024-04-23T19:00:15.262468+0000","last_active":"2024-04-23T19:03:56.258728+0000","last_peered":"2024-04-23T19:03:56.258728+0000","last_clean":"2024-04-23T19:03:56.258728+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:03:56.258728+0000","last_undegraded":"2024-04-23T19:03:56.258728+0000","last_fullsized":"2024-04-23T19:03:56.258728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.116151+0000","last_change":"2024-04-23T19:04:11.116257+0000","last_active":"2024-04-23T19:04:11.116151+0000","last_peered":"2024-04-23T19:04:11.116151+0000","last_clean":"2024-04-23T19:04:11.116151+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:04:11.116151+0000","last_undegraded":"2024-04-23T19:04:11.116151+0000","last_fullsized":"2024-04-23T19:04:11.116151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:11.115902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:11.115902+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.115902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:03.194983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.801097+0000","last_change":"2024-04-23T19:04:17.801097+0000","last_active":"2024-04-23T19:04:17.801097+0000","last_peered":"2024-04-23T19:04:17.801097+0000","last_clean":"2024-04-23T19:04:17.801097+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:04:17.801097+0000","last_undegraded":"2024-04-23T19:04:17.801097+0000","last_fullsized":"2024-04-23T19:04:17.801097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.800847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.800847+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.800847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:38.348067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'57","reported_seq":282,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.983006+0000","last_change":"2024-04-23T19:04:18.983092+0000","last_active":"2024-04-23T19:04:18.983006+0000","last_peered":"2024-04-23T19:04:18.983006+0000","last_clean":"2024-04-23T19:04:18.983006+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:04:18.983006+0000","last_undegraded":"2024-04-23T19:04:18.983006+0000","last_fullsized":"2024-04-23T19:04:18.983006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'57","last_scrub_stamp":"2024-04-23T19:04:18.982820+0000","last_deep_scrub":"116'57","last_deep_scrub_stamp":"2024-04-23T19:04:18.982820+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.982820+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.150140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.832684+0000","last_change":"2024-04-23T19:04:00.832735+0000","last_active":"2024-04-23T19:04:00.832684+0000","last_peered":"2024-04-23T19:04:00.832684+0000","last_clean":"2024-04-23T19:04:00.832684+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:04:00.832684+0000","last_undegraded":"2024-04-23T19:04:00.832684+0000","last_fullsized":"2024-04-23T19:04:00.832684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.832522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:03.723382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.389004+0000","last_change":"2024-04-23T19:00:25.335543+0000","last_active":"2024-04-23T19:03:43.389004+0000","last_peered":"2024-04-23T19:03:43.389004+0000","last_clean":"2024-04-23T19:03:43.389004+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:03:43.389004+0000","last_undegraded":"2024-04-23T19:03:43.389004+0000","last_fullsized":"2024-04-23T19:03:43.389004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.361353+0000","last_change":"2024-04-23T19:04:00.361389+0000","last_active":"2024-04-23T19:04:00.361353+0000","last_peered":"2024-04-23T19:04:00.361353+0000","last_clean":"2024-04-23T19:04:00.361353+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:04:00.361353+0000","last_undegraded":"2024-04-23T19:04:00.361353+0000","last_fullsized":"2024-04-23T19:04:00.361353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.361115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:00.899277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.946543+0000","last_change":"2024-04-23T19:04:06.946608+0000","last_active":"2024-04-23T19:04:06.946543+0000","last_peered":"2024-04-23T19:04:06.946543+0000","last_clean":"2024-04-23T19:04:06.946543+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:04:06.946543+0000","last_undegraded":"2024-04-23T19:04:06.946543+0000","last_fullsized":"2024-04-23T19:04:06.946543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:06.946339+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.946339+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.946339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:50.425590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'42","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.225378+0000","last_change":"2024-04-23T19:00:15.271673+0000","last_active":"2024-04-23T19:03:56.225378+0000","last_peered":"2024-04-23T19:03:56.225378+0000","last_clean":"2024-04-23T19:03:56.225378+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:03:56.225378+0000","last_undegraded":"2024-04-23T19:03:56.225378+0000","last_fullsized":"2024-04-23T19:03:56.225378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.535624+0000","last_change":"2024-04-23T19:04:07.535679+0000","last_active":"2024-04-23T19:04:07.535624+0000","last_peered":"2024-04-23T19:04:07.535624+0000","last_clean":"2024-04-23T19:04:07.535624+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:04:07.535624+0000","last_undegraded":"2024-04-23T19:04:07.535624+0000","last_fullsized":"2024-04-23T19:04:07.535624+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.535419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.535419+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.535419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:29.334892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'26","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.801748+0000","last_change":"2024-04-23T19:04:06.801829+0000","last_active":"2024-04-23T19:04:06.801748+0000","last_peered":"2024-04-23T19:04:06.801748+0000","last_clean":"2024-04-23T19:04:06.801748+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:04:06.801748+0000","last_undegraded":"2024-04-23T19:04:06.801748+0000","last_fullsized":"2024-04-23T19:04:06.801748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:06.801529+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:06.801529+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.801529+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:27.547883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.817729+0000","last_change":"2024-04-23T19:04:02.817782+0000","last_active":"2024-04-23T19:04:02.817729+0000","last_peered":"2024-04-23T19:04:02.817729+0000","last_clean":"2024-04-23T19:04:02.817729+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:04:02.817729+0000","last_undegraded":"2024-04-23T19:04:02.817729+0000","last_fullsized":"2024-04-23T19:04:02.817729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.817544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.817544+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.817544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:02.070329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.728414+0000","last_change":"2024-04-23T19:04:09.728491+0000","last_active":"2024-04-23T19:04:09.728414+0000","last_peered":"2024-04-23T19:04:09.728414+0000","last_clean":"2024-04-23T19:04:09.728414+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:04:09.728414+0000","last_undegraded":"2024-04-23T19:04:09.728414+0000","last_fullsized":"2024-04-23T19:04:09.728414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.728213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.728213+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.728213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:21.715632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.509986+0000","last_change":"2024-04-23T19:04:08.510050+0000","last_active":"2024-04-23T19:04:08.509986+0000","last_peered":"2024-04-23T19:04:08.509986+0000","last_clean":"2024-04-23T19:04:08.509986+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:04:08.509986+0000","last_undegraded":"2024-04-23T19:04:08.509986+0000","last_fullsized":"2024-04-23T19:04:08.509986+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:08.509782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:08.509782+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.509782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:38.833192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'66","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.272406+0000","last_change":"2024-04-23T19:00:15.281856+0000","last_active":"2024-04-23T19:03:56.272406+0000","last_peered":"2024-04-23T19:03:56.272406+0000","last_clean":"2024-04-23T19:03:56.272406+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:03:56.272406+0000","last_undegraded":"2024-04-23T19:03:56.272406+0000","last_fullsized":"2024-04-23T19:03:56.272406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.821496+0000","last_change":"2024-04-23T19:04:21.821554+0000","last_active":"2024-04-23T19:04:21.821496+0000","last_peered":"2024-04-23T19:04:21.821496+0000","last_clean":"2024-04-23T19:04:21.821496+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:04:21.821496+0000","last_undegraded":"2024-04-23T19:04:21.821496+0000","last_fullsized":"2024-04-23T19:04:21.821496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.821293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.821293+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.821293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:03.297512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"116'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.554308+0000","last_change":"2024-04-23T19:04:13.554379+0000","last_active":"2024-04-23T19:04:13.554308+0000","last_peered":"2024-04-23T19:04:13.554308+0000","last_clean":"2024-04-23T19:04:13.554308+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:04:13.554308+0000","last_undegraded":"2024-04-23T19:04:13.554308+0000","last_fullsized":"2024-04-23T19:04:13.554308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'13","last_scrub_stamp":"2024-04-23T19:04:13.554081+0000","last_deep_scrub":"116'13","last_deep_scrub_stamp":"2024-04-23T19:04:13.554081+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.554081+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:57.399076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.952994+0000","last_change":"2024-04-23T19:04:02.953047+0000","last_active":"2024-04-23T19:04:02.952994+0000","last_peered":"2024-04-23T19:04:02.952994+0000","last_clean":"2024-04-23T19:04:02.952994+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:04:02.952994+0000","last_undegraded":"2024-04-23T19:04:02.952994+0000","last_fullsized":"2024-04-23T19:04:02.952994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.952795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.952795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.952795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:30.524113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":123,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.325127+0000","last_change":"2024-04-23T19:01:39.099551+0000","last_active":"2024-04-23T19:03:59.325127+0000","last_peered":"2024-04-23T19:03:59.325127+0000","last_clean":"2024-04-23T19:03:59.325127+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:03:59.325127+0000","last_undegraded":"2024-04-23T19:03:59.325127+0000","last_fullsized":"2024-04-23T19:03:59.325127+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.737501+0000","last_change":"2024-04-23T19:04:13.737569+0000","last_active":"2024-04-23T19:04:13.737501+0000","last_peered":"2024-04-23T19:04:13.737501+0000","last_clean":"2024-04-23T19:04:13.737501+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:04:13.737501+0000","last_undegraded":"2024-04-23T19:04:13.737501+0000","last_fullsized":"2024-04-23T19:04:13.737501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:13.737281+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:13.737281+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.737281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.217889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'48","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.335181+0000","last_change":"2024-04-23T19:04:21.335249+0000","last_active":"2024-04-23T19:04:21.335181+0000","last_peered":"2024-04-23T19:04:21.335181+0000","last_clean":"2024-04-23T19:04:21.335181+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:04:21.335181+0000","last_undegraded":"2024-04-23T19:04:21.335181+0000","last_fullsized":"2024-04-23T19:04:21.335181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:21.334981+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:21.334981+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.334981+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:28.365024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.950146+0000","last_change":"2024-04-23T19:04:04.950205+0000","last_active":"2024-04-23T19:04:04.950146+0000","last_peered":"2024-04-23T19:04:04.950146+0000","last_clean":"2024-04-23T19:04:04.950146+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:04:04.950146+0000","last_undegraded":"2024-04-23T19:04:04.950146+0000","last_fullsized":"2024-04-23T19:04:04.950146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.949925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.949925+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.949925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:39.148380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'29","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.832997+0000","last_change":"2024-04-23T19:04:04.833084+0000","last_active":"2024-04-23T19:04:04.832997+0000","last_peered":"2024-04-23T19:04:04.832997+0000","last_clean":"2024-04-23T19:04:04.832997+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:04:04.832997+0000","last_undegraded":"2024-04-23T19:04:04.832997+0000","last_fullsized":"2024-04-23T19:04:04.832997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'29","last_scrub_stamp":"2024-04-23T19:04:04.832764+0000","last_deep_scrub":"116'29","last_deep_scrub_stamp":"2024-04-23T19:04:04.832764+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.832764+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:35.156175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.154379+0000","last_change":"2024-04-23T19:04:21.154432+0000","last_active":"2024-04-23T19:04:21.154379+0000","last_peered":"2024-04-23T19:04:21.154379+0000","last_clean":"2024-04-23T19:04:21.154379+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:04:21.154379+0000","last_undegraded":"2024-04-23T19:04:21.154379+0000","last_fullsized":"2024-04-23T19:04:21.154379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.154185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.154185+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.154185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:09.176108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388539+0000","last_change":"2024-04-23T19:00:25.330067+0000","last_active":"2024-04-23T19:03:43.388539+0000","last_peered":"2024-04-23T19:03:43.388539+0000","last_clean":"2024-04-23T19:03:43.388539+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:03:43.388539+0000","last_undegraded":"2024-04-23T19:03:43.388539+0000","last_fullsized":"2024-04-23T19:03:43.388539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391375+0000","last_change":"2024-04-23T19:00:55.104106+0000","last_active":"2024-04-23T19:03:43.391375+0000","last_peered":"2024-04-23T19:03:43.391375+0000","last_clean":"2024-04-23T19:03:43.391375+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:03:43.391375+0000","last_undegraded":"2024-04-23T19:03:43.391375+0000","last_fullsized":"2024-04-23T19:03:43.391375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'56","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.248121+0000","last_change":"2024-04-23T19:00:15.276264+0000","last_active":"2024-04-23T19:03:56.248121+0000","last_peered":"2024-04-23T19:03:56.248121+0000","last_clean":"2024-04-23T19:03:56.248121+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:03:56.248121+0000","last_undegraded":"2024-04-23T19:03:56.248121+0000","last_fullsized":"2024-04-23T19:03:56.248121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.260129+0000","last_change":"2024-04-23T19:04:02.260185+0000","last_active":"2024-04-23T19:04:02.260129+0000","last_peered":"2024-04-23T19:04:02.260129+0000","last_clean":"2024-04-23T19:04:02.260129+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:04:02.260129+0000","last_undegraded":"2024-04-23T19:04:02.260129+0000","last_fullsized":"2024-04-23T19:04:02.260129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.259941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.259941+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.259941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:34:34.827166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'23","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.024612+0000","last_change":"2024-04-23T19:04:15.024704+0000","last_active":"2024-04-23T19:04:15.024612+0000","last_peered":"2024-04-23T19:04:15.024612+0000","last_clean":"2024-04-23T19:04:15.024612+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:04:15.024612+0000","last_undegraded":"2024-04-23T19:04:15.024612+0000","last_fullsized":"2024-04-23T19:04:15.024612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:15.024424+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:15.024424+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.024424+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:47.959153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.504042+0000","last_change":"2024-04-23T19:04:04.504098+0000","last_active":"2024-04-23T19:04:04.504042+0000","last_peered":"2024-04-23T19:04:04.504042+0000","last_clean":"2024-04-23T19:04:04.504042+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:04:04.504042+0000","last_undegraded":"2024-04-23T19:04:04.504042+0000","last_fullsized":"2024-04-23T19:04:04.504042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.503808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.503808+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.503808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:34.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.150323+0000","last_change":"2024-04-23T19:04:10.150384+0000","last_active":"2024-04-23T19:04:10.150323+0000","last_peered":"2024-04-23T19:04:10.150323+0000","last_clean":"2024-04-23T19:04:10.150323+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:04:10.150323+0000","last_undegraded":"2024-04-23T19:04:10.150323+0000","last_fullsized":"2024-04-23T19:04:10.150323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:10.150112+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:10.150112+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.150112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:37.721431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'40","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.263597+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:56.263597+0000","last_peered":"2024-04-23T19:03:56.263597+0000","last_clean":"2024-04-23T19:03:56.263597+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:56.263597+0000","last_undegraded":"2024-04-23T19:03:56.263597+0000","last_fullsized":"2024-04-23T19:03:56.263597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.486506+0000","last_change":"2024-04-23T19:04:07.486506+0000","last_active":"2024-04-23T19:04:07.486506+0000","last_peered":"2024-04-23T19:04:07.486506+0000","last_clean":"2024-04-23T19:04:07.486506+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:04:07.486506+0000","last_undegraded":"2024-04-23T19:04:07.486506+0000","last_fullsized":"2024-04-23T19:04:07.486506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.486252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.486252+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.486252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:04.087179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'36","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.308064+0000","last_change":"2024-04-23T19:03:32.305092+0000","last_active":"2024-04-23T19:03:56.308064+0000","last_peered":"2024-04-23T19:03:56.308064+0000","last_clean":"2024-04-23T19:03:56.308064+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:03:56.308064+0000","last_undegraded":"2024-04-23T19:03:56.308064+0000","last_fullsized":"2024-04-23T19:03:56.308064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.266763+0000","last_change":"2024-04-23T19:04:04.266816+0000","last_active":"2024-04-23T19:04:04.266763+0000","last_peered":"2024-04-23T19:04:04.266763+0000","last_clean":"2024-04-23T19:04:04.266763+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:04:04.266763+0000","last_undegraded":"2024-04-23T19:04:04.266763+0000","last_fullsized":"2024-04-23T19:04:04.266763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.266571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.266571+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.266571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:40.071305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.391565+0000","last_change":"2024-04-23T19:00:25.348091+0000","last_active":"2024-04-23T19:03:43.391565+0000","last_peered":"2024-04-23T19:03:43.391565+0000","last_clean":"2024-04-23T19:03:43.391565+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:03:43.391565+0000","last_undegraded":"2024-04-23T19:03:43.391565+0000","last_fullsized":"2024-04-23T19:03:43.391565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.598248+0000","last_change":"2024-04-23T19:04:14.598248+0000","last_active":"2024-04-23T19:04:14.598248+0000","last_peered":"2024-04-23T19:04:14.598248+0000","last_clean":"2024-04-23T19:04:14.598248+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:04:14.598248+0000","last_undegraded":"2024-04-23T19:04:14.598248+0000","last_fullsized":"2024-04-23T19:04:14.598248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-23T19:04:14.597970+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-23T19:04:14.597970+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.597970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:22.375247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'60","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.455836+0000","last_change":"2024-04-23T19:04:14.455903+0000","last_active":"2024-04-23T19:04:14.455836+0000","last_peered":"2024-04-23T19:04:14.455836+0000","last_clean":"2024-04-23T19:04:14.455836+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:04:14.455836+0000","last_undegraded":"2024-04-23T19:04:14.455836+0000","last_fullsized":"2024-04-23T19:04:14.455836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-04-23T19:04:14.455632+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-04-23T19:04:14.455632+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.455632+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:27.517424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.277343+0000","last_change":"2024-04-23T19:04:05.277395+0000","last_active":"2024-04-23T19:04:05.277343+0000","last_peered":"2024-04-23T19:04:05.277343+0000","last_clean":"2024-04-23T19:04:05.277343+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:04:05.277343+0000","last_undegraded":"2024-04-23T19:04:05.277343+0000","last_fullsized":"2024-04-23T19:04:05.277343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.277117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.277117+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.277117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:16.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.009170+0000","last_change":"2024-04-23T19:04:04.009319+0000","last_active":"2024-04-23T19:04:04.009170+0000","last_peered":"2024-04-23T19:04:04.009170+0000","last_clean":"2024-04-23T19:04:04.009170+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:04:04.009170+0000","last_undegraded":"2024-04-23T19:04:04.009170+0000","last_fullsized":"2024-04-23T19:04:04.009170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-04-23T19:04:04.008931+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-04-23T19:04:04.008931+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.008931+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:35.883159+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.420062+0000","last_change":"2024-04-23T19:04:20.420114+0000","last_active":"2024-04-23T19:04:20.420062+0000","last_peered":"2024-04-23T19:04:20.420062+0000","last_clean":"2024-04-23T19:04:20.420062+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:04:20.420062+0000","last_undegraded":"2024-04-23T19:04:20.420062+0000","last_fullsized":"2024-04-23T19:04:20.420062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.419859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.419859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.419859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:49.249375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.708131+0000","last_change":"2024-04-23T19:00:25.339491+0000","last_active":"2024-04-23T19:03:43.708131+0000","last_peered":"2024-04-23T19:03:43.708131+0000","last_clean":"2024-04-23T19:03:43.708131+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:03:43.708131+0000","last_undegraded":"2024-04-23T19:03:43.708131+0000","last_fullsized":"2024-04-23T19:03:43.708131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.785503+0000","last_change":"2024-04-23T19:04:16.785628+0000","last_active":"2024-04-23T19:04:16.785503+0000","last_peered":"2024-04-23T19:04:16.785503+0000","last_clean":"2024-04-23T19:04:16.785503+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:04:16.785503+0000","last_undegraded":"2024-04-23T19:04:16.785503+0000","last_fullsized":"2024-04-23T19:04:16.785503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:16.785232+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:16.785232+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.785232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:04.397703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'42","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.296791+0000","last_change":"2024-04-23T19:00:15.268956+0000","last_active":"2024-04-23T19:03:56.296791+0000","last_peered":"2024-04-23T19:03:56.296791+0000","last_clean":"2024-04-23T19:03:56.296791+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:03:56.296791+0000","last_undegraded":"2024-04-23T19:03:56.296791+0000","last_fullsized":"2024-04-23T19:03:56.296791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.160699+0000","last_change":"2024-04-23T19:04:17.160846+0000","last_active":"2024-04-23T19:04:17.160699+0000","last_peered":"2024-04-23T19:04:17.160699+0000","last_clean":"2024-04-23T19:04:17.160699+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:04:17.160699+0000","last_undegraded":"2024-04-23T19:04:17.160699+0000","last_fullsized":"2024-04-23T19:04:17.160699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.160447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.160447+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.160447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:29.147866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'28","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.753358+0000","last_change":"2024-04-23T19:04:07.753432+0000","last_active":"2024-04-23T19:04:07.753358+0000","last_peered":"2024-04-23T19:04:07.753358+0000","last_clean":"2024-04-23T19:04:07.753358+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:04:07.753358+0000","last_undegraded":"2024-04-23T19:04:07.753358+0000","last_fullsized":"2024-04-23T19:04:07.753358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:07.753180+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:07.753180+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.753180+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:04.354107+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.426342+0000","last_change":"2024-04-23T19:04:01.426361+0000","last_active":"2024-04-23T19:04:01.426342+0000","last_peered":"2024-04-23T19:04:01.426342+0000","last_clean":"2024-04-23T19:04:01.426342+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:04:01.426342+0000","last_undegraded":"2024-04-23T19:04:01.426342+0000","last_fullsized":"2024-04-23T19:04:01.426342+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.426273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:06.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"98'11","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.388148+0000","last_change":"2024-04-23T19:00:25.330071+0000","last_active":"2024-04-23T19:03:43.388148+0000","last_peered":"2024-04-23T19:03:43.388148+0000","last_clean":"2024-04-23T19:03:43.388148+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:03:43.388148+0000","last_undegraded":"2024-04-23T19:03:43.388148+0000","last_fullsized":"2024-04-23T19:03:43.388148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.951782+0000","last_change":"2024-04-23T19:04:09.951849+0000","last_active":"2024-04-23T19:04:09.951782+0000","last_peered":"2024-04-23T19:04:09.951782+0000","last_clean":"2024-04-23T19:04:09.951782+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:04:09.951782+0000","last_undegraded":"2024-04-23T19:04:09.951782+0000","last_fullsized":"2024-04-23T19:04:09.951782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:09.951567+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:09.951567+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.951567+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:21.339434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'40","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.324392+0000","last_change":"2024-04-23T19:01:39.189421+0000","last_active":"2024-04-23T19:03:59.324392+0000","last_peered":"2024-04-23T19:03:59.324392+0000","last_clean":"2024-04-23T19:03:59.324392+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:03:59.324392+0000","last_undegraded":"2024-04-23T19:03:59.324392+0000","last_fullsized":"2024-04-23T19:03:59.324392+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.512313+0000","last_change":"2024-04-23T19:04:06.512368+0000","last_active":"2024-04-23T19:04:06.512313+0000","last_peered":"2024-04-23T19:04:06.512313+0000","last_clean":"2024-04-23T19:04:06.512313+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:04:06.512313+0000","last_undegraded":"2024-04-23T19:04:06.512313+0000","last_fullsized":"2024-04-23T19:04:06.512313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:06.512135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:06.512135+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.512135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:05.764920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'15","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.845493+0000","last_change":"2024-04-23T19:04:01.845493+0000","last_active":"2024-04-23T19:04:01.845493+0000","last_peered":"2024-04-23T19:04:01.845493+0000","last_clean":"2024-04-23T19:04:01.845493+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:04:01.845493+0000","last_undegraded":"2024-04-23T19:04:01.845493+0000","last_fullsized":"2024-04-23T19:04:01.845493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.845084+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:36.043539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":401,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.196132+0000","last_change":"2024-04-23T19:04:09.196194+0000","last_active":"2024-04-23T19:04:09.196132+0000","last_peered":"2024-04-23T19:04:09.196132+0000","last_clean":"2024-04-23T19:04:09.196132+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:04:09.196132+0000","last_undegraded":"2024-04-23T19:04:09.196132+0000","last_fullsized":"2024-04-23T19:04:09.196132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:09.195905+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:09.195905+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.195905+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:00:54.108731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.112753+0000","last_change":"2024-04-23T19:00:25.328938+0000","last_active":"2024-04-23T19:03:44.112753+0000","last_peered":"2024-04-23T19:03:44.112753+0000","last_clean":"2024-04-23T19:03:44.112753+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:03:44.112753+0000","last_undegraded":"2024-04-23T19:03:44.112753+0000","last_fullsized":"2024-04-23T19:03:44.112753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.187110+0000","last_change":"2024-04-23T19:04:18.187164+0000","last_active":"2024-04-23T19:04:18.187110+0000","last_peered":"2024-04-23T19:04:18.187110+0000","last_clean":"2024-04-23T19:04:18.187110+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:04:18.187110+0000","last_undegraded":"2024-04-23T19:04:18.187110+0000","last_fullsized":"2024-04-23T19:04:18.187110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.186906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.186906+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.186906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:31.248698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'42","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.364925+0000","last_change":"2024-04-23T19:04:19.364986+0000","last_active":"2024-04-23T19:04:19.364925+0000","last_peered":"2024-04-23T19:04:19.364925+0000","last_clean":"2024-04-23T19:04:19.364925+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:04:19.364925+0000","last_undegraded":"2024-04-23T19:04:19.364925+0000","last_fullsized":"2024-04-23T19:04:19.364925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:19.364730+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:19.364730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.364730+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:34:03.209726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.033520+0000","last_change":"2024-04-23T19:04:09.033574+0000","last_active":"2024-04-23T19:04:09.033520+0000","last_peered":"2024-04-23T19:04:09.033520+0000","last_clean":"2024-04-23T19:04:09.033520+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:04:09.033520+0000","last_undegraded":"2024-04-23T19:04:09.033520+0000","last_fullsized":"2024-04-23T19:04:09.033520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.033307+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:57.556321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'32","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.307389+0000","last_change":"2024-04-23T19:04:05.307497+0000","last_active":"2024-04-23T19:04:05.307389+0000","last_peered":"2024-04-23T19:04:05.307389+0000","last_clean":"2024-04-23T19:04:05.307389+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:04:05.307389+0000","last_undegraded":"2024-04-23T19:04:05.307389+0000","last_fullsized":"2024-04-23T19:04:05.307389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:05.307144+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:05.307144+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.307144+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:54.457438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.582678+0000","last_change":"2024-04-23T19:04:21.582732+0000","last_active":"2024-04-23T19:04:21.582678+0000","last_peered":"2024-04-23T19:04:21.582678+0000","last_clean":"2024-04-23T19:04:21.582678+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:04:21.582678+0000","last_undegraded":"2024-04-23T19:04:21.582678+0000","last_fullsized":"2024-04-23T19:04:21.582678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.582488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.582488+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.582488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:10:46.474465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115327+0000","last_change":"2024-04-23T19:00:25.335764+0000","last_active":"2024-04-23T19:03:44.115327+0000","last_peered":"2024-04-23T19:03:44.115327+0000","last_clean":"2024-04-23T19:03:44.115327+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:03:44.115327+0000","last_undegraded":"2024-04-23T19:03:44.115327+0000","last_fullsized":"2024-04-23T19:03:44.115327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.144746+0000","last_change":"2024-04-23T19:04:16.144806+0000","last_active":"2024-04-23T19:04:16.144746+0000","last_peered":"2024-04-23T19:04:16.144746+0000","last_clean":"2024-04-23T19:04:16.144746+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:04:16.144746+0000","last_undegraded":"2024-04-23T19:04:16.144746+0000","last_fullsized":"2024-04-23T19:04:16.144746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-23T19:04:16.144522+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-23T19:04:16.144522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.144522+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:08.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.080984+0000","last_change":"2024-04-23T19:04:19.081131+0000","last_active":"2024-04-23T19:04:19.080984+0000","last_peered":"2024-04-23T19:04:19.080984+0000","last_clean":"2024-04-23T19:04:19.080984+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:04:19.080984+0000","last_undegraded":"2024-04-23T19:04:19.080984+0000","last_fullsized":"2024-04-23T19:04:19.080984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:19.080702+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:19.080702+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.080702+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:43.244336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.348448+0000","last_change":"2024-04-23T19:04:20.348505+0000","last_active":"2024-04-23T19:04:20.348448+0000","last_peered":"2024-04-23T19:04:20.348448+0000","last_clean":"2024-04-23T19:04:20.348448+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:04:20.348448+0000","last_undegraded":"2024-04-23T19:04:20.348448+0000","last_fullsized":"2024-04-23T19:04:20.348448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.348220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.348220+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.348220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:28.125498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'20","reported_seq":143,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.324887+0000","last_change":"2024-04-23T19:01:39.340385+0000","last_active":"2024-04-23T19:03:59.324887+0000","last_peered":"2024-04-23T19:03:59.324887+0000","last_clean":"2024-04-23T19:03:59.324887+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:03:59.324887+0000","last_undegraded":"2024-04-23T19:03:59.324887+0000","last_fullsized":"2024-04-23T19:03:59.324887+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.143021+0000","last_change":"2024-04-23T19:04:20.143077+0000","last_active":"2024-04-23T19:04:20.143021+0000","last_peered":"2024-04-23T19:04:20.143021+0000","last_clean":"2024-04-23T19:04:20.143021+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:04:20.143021+0000","last_undegraded":"2024-04-23T19:04:20.143021+0000","last_fullsized":"2024-04-23T19:04:20.143021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.142757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.142757+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.142757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:42.252737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392985+0000","last_change":"2024-04-23T19:00:25.345930+0000","last_active":"2024-04-23T19:03:43.392985+0000","last_peered":"2024-04-23T19:03:43.392985+0000","last_clean":"2024-04-23T19:03:43.392985+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:03:43.392985+0000","last_undegraded":"2024-04-23T19:03:43.392985+0000","last_fullsized":"2024-04-23T19:03:43.392985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.760403+0000","last_change":"2024-04-23T19:04:18.760497+0000","last_active":"2024-04-23T19:04:18.760403+0000","last_peered":"2024-04-23T19:04:18.760403+0000","last_clean":"2024-04-23T19:04:18.760403+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:04:18.760403+0000","last_undegraded":"2024-04-23T19:04:18.760403+0000","last_fullsized":"2024-04-23T19:04:18.760403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-23T19:04:18.760211+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-23T19:04:18.760211+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.760211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:24.942267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'44","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.694636+0000","last_change":"2024-04-23T19:00:15.270408+0000","last_active":"2024-04-23T19:04:00.694636+0000","last_peered":"2024-04-23T19:04:00.694636+0000","last_clean":"2024-04-23T19:04:00.694636+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:04:00.694636+0000","last_undegraded":"2024-04-23T19:04:00.694636+0000","last_fullsized":"2024-04-23T19:04:00.694636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.908926+0000","last_change":"2024-04-23T19:00:19.300438+0000","last_active":"2024-04-23T19:03:43.908926+0000","last_peered":"2024-04-23T19:03:43.908926+0000","last_clean":"2024-04-23T19:03:43.908926+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:03:43.908926+0000","last_undegraded":"2024-04-23T19:03:43.908926+0000","last_fullsized":"2024-04-23T19:03:43.908926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:18.265553+0000","last_clean_scrub_stamp":"2024-04-23T19:00:18.265553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'18","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:55.957566+0000","last_change":"2024-04-23T19:00:21.304408+0000","last_active":"2024-04-23T19:03:55.957566+0000","last_peered":"2024-04-23T19:03:55.957566+0000","last_clean":"2024-04-23T19:03:55.957566+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:03:55.957566+0000","last_undegraded":"2024-04-23T19:03:55.957566+0000","last_fullsized":"2024-04-23T19:03:55.957566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:20.273068+0000","last_clean_scrub_stamp":"2024-04-23T19:00:20.273068+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.909320+0000","last_change":"2024-04-23T19:00:23.322637+0000","last_active":"2024-04-23T19:03:43.909320+0000","last_peered":"2024-04-23T19:03:43.909320+0000","last_clean":"2024-04-23T19:03:43.909320+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:03:43.909320+0000","last_undegraded":"2024-04-23T19:03:43.909320+0000","last_fullsized":"2024-04-23T19:03:43.909320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:22.279818+0000","last_clean_scrub_stamp":"2024-04-23T19:00:22.279818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.114716+0000","last_change":"2024-04-23T19:00:25.343493+0000","last_active":"2024-04-23T19:03:44.114716+0000","last_peered":"2024-04-23T19:03:44.114716+0000","last_clean":"2024-04-23T19:03:44.114716+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:03:44.114716+0000","last_undegraded":"2024-04-23T19:03:44.114716+0000","last_fullsized":"2024-04-23T19:03:44.114716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.092992+0000","last_change":"2024-04-23T19:04:13.093062+0000","last_active":"2024-04-23T19:04:13.092992+0000","last_peered":"2024-04-23T19:04:13.092992+0000","last_clean":"2024-04-23T19:04:13.092992+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:04:13.092992+0000","last_undegraded":"2024-04-23T19:04:13.092992+0000","last_fullsized":"2024-04-23T19:04:13.092992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:13.092795+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:13.092795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.092795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:58.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'50","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.173264+0000","last_change":"2024-04-23T19:01:39.333838+0000","last_active":"2024-04-23T19:03:56.173264+0000","last_peered":"2024-04-23T19:03:56.173264+0000","last_clean":"2024-04-23T19:03:56.173264+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:03:56.173264+0000","last_undegraded":"2024-04-23T19:03:56.173264+0000","last_fullsized":"2024-04-23T19:03:56.173264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":171,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.418968+0000","last_change":"2024-04-23T19:04:12.419040+0000","last_active":"2024-04-23T19:04:12.418968+0000","last_peered":"2024-04-23T19:04:12.418968+0000","last_clean":"2024-04-23T19:04:12.418968+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:04:12.418968+0000","last_undegraded":"2024-04-23T19:04:12.418968+0000","last_fullsized":"2024-04-23T19:04:12.418968+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:12.418765+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:12.418765+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.418765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:04.586084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'24","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.916796+0000","last_change":"2024-04-23T19:04:04.916870+0000","last_active":"2024-04-23T19:04:04.916796+0000","last_peered":"2024-04-23T19:04:04.916796+0000","last_clean":"2024-04-23T19:04:04.916796+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:04:04.916796+0000","last_undegraded":"2024-04-23T19:04:04.916796+0000","last_fullsized":"2024-04-23T19:04:04.916796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-04-23T19:04:04.916613+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-04-23T19:04:04.916613+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.916613+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:10.168421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.425047+0000","last_change":"2024-04-23T19:04:02.425096+0000","last_active":"2024-04-23T19:04:02.425047+0000","last_peered":"2024-04-23T19:04:02.425047+0000","last_clean":"2024-04-23T19:04:02.425047+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:04:02.425047+0000","last_undegraded":"2024-04-23T19:04:02.425047+0000","last_fullsized":"2024-04-23T19:04:02.425047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.424719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.424719+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.424719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:01.677504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.910005+0000","last_change":"2024-04-23T19:00:25.332730+0000","last_active":"2024-04-23T19:03:43.910005+0000","last_peered":"2024-04-23T19:03:43.910005+0000","last_clean":"2024-04-23T19:03:43.910005+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:03:43.910005+0000","last_undegraded":"2024-04-23T19:03:43.910005+0000","last_fullsized":"2024-04-23T19:03:43.910005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:24.292895+0000","last_clean_scrub_stamp":"2024-04-23T19:00:24.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115674+0000","last_change":"2024-04-23T19:03:32.306538+0000","last_active":"2024-04-23T19:03:44.115674+0000","last_peered":"2024-04-23T19:03:44.115674+0000","last_clean":"2024-04-23T19:03:44.115674+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:03:44.115674+0000","last_undegraded":"2024-04-23T19:03:44.115674+0000","last_fullsized":"2024-04-23T19:03:44.115674+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'58","reported_seq":276,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.220635+0000","last_change":"2024-04-23T19:01:39.167300+0000","last_active":"2024-04-23T19:03:56.220635+0000","last_peered":"2024-04-23T19:03:56.220635+0000","last_clean":"2024-04-23T19:03:56.220635+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:03:56.220635+0000","last_undegraded":"2024-04-23T19:03:56.220635+0000","last_fullsized":"2024-04-23T19:03:56.220635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.115479+0000","last_change":"2024-04-23T19:03:32.303977+0000","last_active":"2024-04-23T19:03:44.115479+0000","last_peered":"2024-04-23T19:03:44.115479+0000","last_clean":"2024-04-23T19:03:44.115479+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:03:44.115479+0000","last_undegraded":"2024-04-23T19:03:44.115479+0000","last_fullsized":"2024-04-23T19:03:44.115479+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'44","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.936294+0000","last_change":"2024-04-23T19:04:05.936359+0000","last_active":"2024-04-23T19:04:05.936294+0000","last_peered":"2024-04-23T19:04:05.936294+0000","last_clean":"2024-04-23T19:04:05.936294+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:04:05.936294+0000","last_undegraded":"2024-04-23T19:04:05.936294+0000","last_fullsized":"2024-04-23T19:04:05.936294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:05.936104+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:05.936104+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.936104+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:09:25.295580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.348842+0000","last_change":"2024-04-23T19:04:07.348911+0000","last_active":"2024-04-23T19:04:07.348842+0000","last_peered":"2024-04-23T19:04:07.348842+0000","last_clean":"2024-04-23T19:04:07.348842+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:04:07.348842+0000","last_undegraded":"2024-04-23T19:04:07.348842+0000","last_fullsized":"2024-04-23T19:04:07.348842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:07.348615+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:07.348615+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.348615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:56.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'34","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.196958+0000","last_change":"2024-04-23T19:00:15.271819+0000","last_active":"2024-04-23T19:03:56.196958+0000","last_peered":"2024-04-23T19:03:56.196958+0000","last_clean":"2024-04-23T19:03:56.196958+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:03:56.196958+0000","last_undegraded":"2024-04-23T19:03:56.196958+0000","last_fullsized":"2024-04-23T19:03:56.196958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.414159+0000","last_change":"2024-04-23T19:04:16.414331+0000","last_active":"2024-04-23T19:04:16.414159+0000","last_peered":"2024-04-23T19:04:16.414159+0000","last_clean":"2024-04-23T19:04:16.414159+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:04:16.414159+0000","last_undegraded":"2024-04-23T19:04:16.414159+0000","last_fullsized":"2024-04-23T19:04:16.414159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'12","last_scrub_stamp":"2024-04-23T19:04:16.413901+0000","last_deep_scrub":"98'12","last_deep_scrub_stamp":"2024-04-23T19:04:16.413901+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.413901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.356368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'42","reported_seq":172,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.267752+0000","last_change":"2024-04-23T19:01:39.304174+0000","last_active":"2024-04-23T19:03:56.267752+0000","last_peered":"2024-04-23T19:03:56.267752+0000","last_clean":"2024-04-23T19:03:56.267752+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:03:56.267752+0000","last_undegraded":"2024-04-23T19:03:56.267752+0000","last_fullsized":"2024-04-23T19:03:56.267752+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.392628+0000","last_change":"2024-04-23T19:00:17.290256+0000","last_active":"2024-04-23T19:03:43.392628+0000","last_peered":"2024-04-23T19:03:43.392628+0000","last_clean":"2024-04-23T19:03:43.392628+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:03:43.392628+0000","last_undegraded":"2024-04-23T19:03:43.392628+0000","last_fullsized":"2024-04-23T19:03:43.392628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'46","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.258474+0000","last_change":"2024-04-23T19:00:15.288223+0000","last_active":"2024-04-23T19:03:56.258474+0000","last_peered":"2024-04-23T19:03:56.258474+0000","last_clean":"2024-04-23T19:03:56.258474+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:03:56.258474+0000","last_undegraded":"2024-04-23T19:03:56.258474+0000","last_fullsized":"2024-04-23T19:03:56.258474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.975530+0000","last_change":"2024-04-23T19:04:08.975592+0000","last_active":"2024-04-23T19:04:08.975530+0000","last_peered":"2024-04-23T19:04:08.975530+0000","last_clean":"2024-04-23T19:04:08.975530+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:04:08.975530+0000","last_undegraded":"2024-04-23T19:04:08.975530+0000","last_fullsized":"2024-04-23T19:04:08.975530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:08.975323+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:08.975323+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.975323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:58.099593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'68","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.268589+0000","last_change":"2024-04-23T19:03:32.307346+0000","last_active":"2024-04-23T19:03:56.268589+0000","last_peered":"2024-04-23T19:03:56.268589+0000","last_clean":"2024-04-23T19:03:56.268589+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:03:56.268589+0000","last_undegraded":"2024-04-23T19:03:56.268589+0000","last_fullsized":"2024-04-23T19:03:56.268589+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.723346+0000","last_change":"2024-04-23T19:04:14.723412+0000","last_active":"2024-04-23T19:04:14.723346+0000","last_peered":"2024-04-23T19:04:14.723346+0000","last_clean":"2024-04-23T19:04:14.723346+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:04:14.723346+0000","last_undegraded":"2024-04-23T19:04:14.723346+0000","last_fullsized":"2024-04-23T19:04:14.723346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:14.723146+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:14.723146+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.723146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:02.010322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'52","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.085290+0000","last_change":"2024-04-23T19:04:15.085353+0000","last_active":"2024-04-23T19:04:15.085290+0000","last_peered":"2024-04-23T19:04:15.085290+0000","last_clean":"2024-04-23T19:04:15.085290+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:04:15.085290+0000","last_undegraded":"2024-04-23T19:04:15.085290+0000","last_fullsized":"2024-04-23T19:04:15.085290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:15.085072+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:15.085072+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.085072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:20.336880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.199336+0000","last_change":"2024-04-23T19:04:18.199400+0000","last_active":"2024-04-23T19:04:18.199336+0000","last_peered":"2024-04-23T19:04:18.199336+0000","last_clean":"2024-04-23T19:04:18.199336+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:04:18.199336+0000","last_undegraded":"2024-04-23T19:04:18.199336+0000","last_fullsized":"2024-04-23T19:04:18.199336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:18.199141+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:18.199141+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.199141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:22:05.503114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.193849+0000","last_change":"2024-04-23T19:00:15.281071+0000","last_active":"2024-04-23T19:03:56.193849+0000","last_peered":"2024-04-23T19:03:56.193849+0000","last_clean":"2024-04-23T19:03:56.193849+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:03:56.193849+0000","last_undegraded":"2024-04-23T19:03:56.193849+0000","last_fullsized":"2024-04-23T19:03:56.193849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.520943+0000","last_change":"2024-04-23T19:04:12.521002+0000","last_active":"2024-04-23T19:04:12.520943+0000","last_peered":"2024-04-23T19:04:12.520943+0000","last_clean":"2024-04-23T19:04:12.520943+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:04:12.520943+0000","last_undegraded":"2024-04-23T19:04:12.520943+0000","last_fullsized":"2024-04-23T19:04:12.520943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:12.520732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:12.520732+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.520732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:49.463199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'56","reported_seq":262,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.252458+0000","last_change":"2024-04-23T19:00:15.267702+0000","last_active":"2024-04-23T19:03:56.252458+0000","last_peered":"2024-04-23T19:03:56.252458+0000","last_clean":"2024-04-23T19:03:56.252458+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:03:56.252458+0000","last_undegraded":"2024-04-23T19:03:56.252458+0000","last_fullsized":"2024-04-23T19:03:56.252458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12,"num_write":96,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:43.911250+0000","last_change":"2024-04-23T19:00:17.296952+0000","last_active":"2024-04-23T19:03:43.911250+0000","last_peered":"2024-04-23T19:03:43.911250+0000","last_clean":"2024-04-23T19:03:43.911250+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:03:43.911250+0000","last_undegraded":"2024-04-23T19:03:43.911250+0000","last_fullsized":"2024-04-23T19:03:43.911250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'58","reported_seq":260,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.237716+0000","last_change":"2024-04-23T19:00:15.276705+0000","last_active":"2024-04-23T19:03:56.237716+0000","last_peered":"2024-04-23T19:03:56.237716+0000","last_clean":"2024-04-23T19:03:56.237716+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:03:56.237716+0000","last_undegraded":"2024-04-23T19:03:56.237716+0000","last_fullsized":"2024-04-23T19:03:56.237716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.958009+0000","last_change":"2024-04-23T19:04:10.958072+0000","last_active":"2024-04-23T19:04:10.958009+0000","last_peered":"2024-04-23T19:04:10.958009+0000","last_clean":"2024-04-23T19:04:10.958009+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:04:10.958009+0000","last_undegraded":"2024-04-23T19:04:10.958009+0000","last_fullsized":"2024-04-23T19:04:10.958009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-23T19:04:10.957802+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-23T19:04:10.957802+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.957802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:32.529640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'62","reported_seq":272,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.348098+0000","last_change":"2024-04-23T19:04:15.348157+0000","last_active":"2024-04-23T19:04:15.348098+0000","last_peered":"2024-04-23T19:04:15.348098+0000","last_clean":"2024-04-23T19:04:15.348098+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:04:15.348098+0000","last_undegraded":"2024-04-23T19:04:15.348098+0000","last_fullsized":"2024-04-23T19:04:15.348098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:15.347904+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:15.347904+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.347904+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:31.678837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.017909+0000","last_change":"2024-04-23T19:04:11.018039+0000","last_active":"2024-04-23T19:04:11.017909+0000","last_peered":"2024-04-23T19:04:11.017909+0000","last_clean":"2024-04-23T19:04:11.017909+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:04:11.017909+0000","last_undegraded":"2024-04-23T19:04:11.017909+0000","last_fullsized":"2024-04-23T19:04:11.017909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:11.017650+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.017650+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.017650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:32.817124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'42","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.207063+0000","last_change":"2024-04-23T19:00:15.277200+0000","last_active":"2024-04-23T19:03:56.207063+0000","last_peered":"2024-04-23T19:03:56.207063+0000","last_clean":"2024-04-23T19:03:56.207063+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:03:56.207063+0000","last_undegraded":"2024-04-23T19:03:56.207063+0000","last_fullsized":"2024-04-23T19:03:56.207063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:44.113962+0000","last_change":"2024-04-23T19:00:55.104620+0000","last_active":"2024-04-23T19:03:44.113962+0000","last_peered":"2024-04-23T19:03:44.113962+0000","last_clean":"2024-04-23T19:03:44.113962+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:03:44.113962+0000","last_undegraded":"2024-04-23T19:03:44.113962+0000","last_fullsized":"2024-04-23T19:03:44.113962+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:16.251607+0000","last_clean_scrub_stamp":"2024-04-23T19:00:16.251607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'44","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.087637+0000","last_change":"2024-04-23T19:04:14.087778+0000","last_active":"2024-04-23T19:04:14.087637+0000","last_peered":"2024-04-23T19:04:14.087637+0000","last_clean":"2024-04-23T19:04:14.087637+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:04:14.087637+0000","last_undegraded":"2024-04-23T19:04:14.087637+0000","last_fullsized":"2024-04-23T19:04:14.087637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:14.087323+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:14.087323+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.087323+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:47.703794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.593055+0000","last_change":"2024-04-23T19:04:18.593111+0000","last_active":"2024-04-23T19:04:18.593055+0000","last_peered":"2024-04-23T19:04:18.593055+0000","last_clean":"2024-04-23T19:04:18.593055+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:04:18.593055+0000","last_undegraded":"2024-04-23T19:04:18.593055+0000","last_fullsized":"2024-04-23T19:04:18.593055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.592844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.592844+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.592844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:24.774900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'44","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.994046+0000","last_change":"2024-04-23T19:04:19.994110+0000","last_active":"2024-04-23T19:04:19.994046+0000","last_peered":"2024-04-23T19:04:19.994046+0000","last_clean":"2024-04-23T19:04:19.994046+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:04:19.994046+0000","last_undegraded":"2024-04-23T19:04:19.994046+0000","last_fullsized":"2024-04-23T19:04:19.994046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:19.993852+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:19.993852+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.993852+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:54.257079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.754037+0000","last_change":"2024-04-23T19:04:12.754099+0000","last_active":"2024-04-23T19:04:12.754037+0000","last_peered":"2024-04-23T19:04:12.754037+0000","last_clean":"2024-04-23T19:04:12.754037+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:04:12.754037+0000","last_undegraded":"2024-04-23T19:04:12.754037+0000","last_fullsized":"2024-04-23T19:04:12.754037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'10","last_scrub_stamp":"2024-04-23T19:04:12.753839+0000","last_deep_scrub":"98'10","last_deep_scrub_stamp":"2024-04-23T19:04:12.753839+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.753839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:31.406847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'36","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.980720+0000","last_change":"2024-04-23T19:04:06.980779+0000","last_active":"2024-04-23T19:04:06.980720+0000","last_peered":"2024-04-23T19:04:06.980720+0000","last_clean":"2024-04-23T19:04:06.980720+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:04:06.980720+0000","last_undegraded":"2024-04-23T19:04:06.980720+0000","last_fullsized":"2024-04-23T19:04:06.980720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:06.980512+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:06.980512+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.980512+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:37.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.967824+0000","last_change":"2024-04-23T19:04:05.967890+0000","last_active":"2024-04-23T19:04:05.967824+0000","last_peered":"2024-04-23T19:04:05.967824+0000","last_clean":"2024-04-23T19:04:05.967824+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:04:05.967824+0000","last_undegraded":"2024-04-23T19:04:05.967824+0000","last_fullsized":"2024-04-23T19:04:05.967824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:05.967627+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:05.967627+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.967627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:11:16.102311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'56","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.117953+0000","last_change":"2024-04-23T19:04:18.118087+0000","last_active":"2024-04-23T19:04:18.117953+0000","last_peered":"2024-04-23T19:04:18.117953+0000","last_clean":"2024-04-23T19:04:18.117953+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:04:18.117953+0000","last_undegraded":"2024-04-23T19:04:18.117953+0000","last_fullsized":"2024-04-23T19:04:18.117953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:18.117705+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:18.117705+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.117705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:11:28.252389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"116'44","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.260682+0000","last_change":"2024-04-23T19:00:15.266323+0000","last_active":"2024-04-23T19:03:56.260682+0000","last_peered":"2024-04-23T19:03:56.260682+0000","last_clean":"2024-04-23T19:03:56.260682+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:03:56.260682+0000","last_undegraded":"2024-04-23T19:03:56.260682+0000","last_fullsized":"2024-04-23T19:03:56.260682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.467416+0000","last_change":"2024-04-23T19:04:10.467478+0000","last_active":"2024-04-23T19:04:10.467416+0000","last_peered":"2024-04-23T19:04:10.467416+0000","last_clean":"2024-04-23T19:04:10.467416+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:04:10.467416+0000","last_undegraded":"2024-04-23T19:04:10.467416+0000","last_fullsized":"2024-04-23T19:04:10.467416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:10.467210+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:10.467210+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.467210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:23.529002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'56","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.272562+0000","last_change":"2024-04-23T19:03:32.301243+0000","last_active":"2024-04-23T19:03:56.272562+0000","last_peered":"2024-04-23T19:03:56.272562+0000","last_clean":"2024-04-23T19:03:56.272562+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:03:56.272562+0000","last_undegraded":"2024-04-23T19:03:56.272562+0000","last_fullsized":"2024-04-23T19:03:56.272562+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.338075+0000","last_change":"2024-04-23T19:04:08.338197+0000","last_active":"2024-04-23T19:04:08.338075+0000","last_peered":"2024-04-23T19:04:08.338075+0000","last_clean":"2024-04-23T19:04:08.338075+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:04:08.338075+0000","last_undegraded":"2024-04-23T19:04:08.338075+0000","last_fullsized":"2024-04-23T19:04:08.338075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-23T19:04:08.337843+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-23T19:04:08.337843+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.337843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:07.590628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1104,"ondisk_log_size":1104,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1070,"num_read_kb":1553,"num_write":547,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":980,"ondisk_log_size":980,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37328,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334512,"statfs":{"total":96636764160,"available":96598540288,"internally_reserved":0,"allocated":2039808,"data_stored":1406946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36720,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":1417216,"data_stored":815907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1462272,"data_stored":815753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1433600,"data_stored":815702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":1437696,"data_stored":815992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37304,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334536,"statfs":{"total":96636764160,"available":96598564864,"internally_reserved":0,"allocated":2015232,"data_stored":1405784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.360 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.361 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.362 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.363 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.364 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.365 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.366 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T19:00:08.174824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=8, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.367 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.368 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.369 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-23T19:00:18.265553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-23T19:00:20.273068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-23T19:00:22.279818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-23T19:00:24.292895+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=24, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.370 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.371 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.372 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.372 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-23T19:00:16.251607+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.372 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.372 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:23.372 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T19:04:43.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:04:43.732 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:04:43.740 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:04:43.753 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-23T19:04:42.030384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5019,"num_read_kb":3922,"num_write":4431,"num_write_kb":6187922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5699,"ondisk_log_size":5699,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295000,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754679720,"statfs":{"total":773094113280,"available":772792033280,"internally_reserved":0,"allocated":12607488,"data_stored":7704972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005832"},"pg_stats":[{"pgid":"3.3f","version":"116'56","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.008233+0000","last_change":"2024-04-23T19:04:18.008233+0000","last_active":"2024-04-23T19:04:18.008233+0000","last_peered":"2024-04-23T19:04:18.008233+0000","last_clean":"2024-04-23T19:04:18.008233+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:04:18.008233+0000","last_undegraded":"2024-04-23T19:04:18.008233+0000","last_fullsized":"2024-04-23T19:04:18.008233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:18.007961+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:18.007961+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.007961+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.393969+0000","last_change":"2024-04-23T19:04:13.394029+0000","last_active":"2024-04-23T19:04:13.393969+0000","last_peered":"2024-04-23T19:04:13.393969+0000","last_clean":"2024-04-23T19:04:13.393969+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:04:13.393969+0000","last_undegraded":"2024-04-23T19:04:13.393969+0000","last_fullsized":"2024-04-23T19:04:13.393969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:13.393767+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:13.393767+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.393767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:09.994694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.544313+0000","last_change":"2024-04-23T19:04:09.544313+0000","last_active":"2024-04-23T19:04:09.544313+0000","last_peered":"2024-04-23T19:04:09.544313+0000","last_clean":"2024-04-23T19:04:09.544313+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:04:09.544313+0000","last_undegraded":"2024-04-23T19:04:09.544313+0000","last_fullsized":"2024-04-23T19:04:09.544313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:09.544061+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:09.544061+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.544061+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:55.178917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.018460+0000","last_change":"2024-04-23T19:04:10.018488+0000","last_active":"2024-04-23T19:04:10.018460+0000","last_peered":"2024-04-23T19:04:10.018460+0000","last_clean":"2024-04-23T19:04:10.018460+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:04:10.018460+0000","last_undegraded":"2024-04-23T19:04:10.018460+0000","last_fullsized":"2024-04-23T19:04:10.018460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:10.018359+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:10.018359+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.018359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:59.168653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.619501+0000","last_change":"2024-04-23T19:04:23.619501+0000","last_active":"2024-04-23T19:04:23.619501+0000","last_peered":"2024-04-23T19:04:23.619501+0000","last_clean":"2024-04-23T19:04:23.619501+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:04:23.619501+0000","last_undegraded":"2024-04-23T19:04:23.619501+0000","last_fullsized":"2024-04-23T19:04:23.619501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:23.619219+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:23.619219+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.619219+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:55.397378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.149512+0000","last_change":"2024-04-23T19:04:20.149659+0000","last_active":"2024-04-23T19:04:20.149512+0000","last_peered":"2024-04-23T19:04:20.149512+0000","last_clean":"2024-04-23T19:04:20.149512+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:04:20.149512+0000","last_undegraded":"2024-04-23T19:04:20.149512+0000","last_fullsized":"2024-04-23T19:04:20.149512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:20.149253+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:20.149253+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.149253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:38.802261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'52","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.342086+0000","last_change":"2024-04-23T19:04:27.342148+0000","last_active":"2024-04-23T19:04:27.342086+0000","last_peered":"2024-04-23T19:04:27.342086+0000","last_clean":"2024-04-23T19:04:27.342086+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:04:27.342086+0000","last_undegraded":"2024-04-23T19:04:27.342086+0000","last_fullsized":"2024-04-23T19:04:27.342086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:27.341819+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:27.341819+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.341819+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:08.818038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.630515+0000","last_change":"2024-04-23T19:04:22.630581+0000","last_active":"2024-04-23T19:04:22.630515+0000","last_peered":"2024-04-23T19:04:22.630515+0000","last_clean":"2024-04-23T19:04:22.630515+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:04:22.630515+0000","last_undegraded":"2024-04-23T19:04:22.630515+0000","last_fullsized":"2024-04-23T19:04:22.630515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:22.630304+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:22.630304+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.630304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:59.509699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'44","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.067888+0000","last_change":"2024-04-23T19:04:28.067950+0000","last_active":"2024-04-23T19:04:28.067888+0000","last_peered":"2024-04-23T19:04:28.067888+0000","last_clean":"2024-04-23T19:04:28.067888+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:04:28.067888+0000","last_undegraded":"2024-04-23T19:04:28.067888+0000","last_fullsized":"2024-04-23T19:04:28.067888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:28.067658+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:28.067658+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.067658+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:56.897173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.250723+0000","last_change":"2024-04-23T19:04:06.250723+0000","last_active":"2024-04-23T19:04:06.250723+0000","last_peered":"2024-04-23T19:04:06.250723+0000","last_clean":"2024-04-23T19:04:06.250723+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:04:06.250723+0000","last_undegraded":"2024-04-23T19:04:06.250723+0000","last_fullsized":"2024-04-23T19:04:06.250723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:06.250456+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:06.250456+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.250456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:41:22.388683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'38","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.379228+0000","last_change":"2024-04-23T19:04:17.379293+0000","last_active":"2024-04-23T19:04:17.379228+0000","last_peered":"2024-04-23T19:04:17.379228+0000","last_clean":"2024-04-23T19:04:17.379228+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:04:17.379228+0000","last_undegraded":"2024-04-23T19:04:17.379228+0000","last_fullsized":"2024-04-23T19:04:17.379228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:17.379035+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:17.379035+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.379035+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:33.141203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.005603+0000","last_change":"2024-04-23T19:04:10.005603+0000","last_active":"2024-04-23T19:04:10.005603+0000","last_peered":"2024-04-23T19:04:10.005603+0000","last_clean":"2024-04-23T19:04:10.005603+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:04:10.005603+0000","last_undegraded":"2024-04-23T19:04:10.005603+0000","last_fullsized":"2024-04-23T19:04:10.005603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-04-23T19:04:10.005426+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-04-23T19:04:10.005426+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.005426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:09.258211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.009279+0000","last_change":"2024-04-23T19:04:24.009346+0000","last_active":"2024-04-23T19:04:24.009279+0000","last_peered":"2024-04-23T19:04:24.009279+0000","last_clean":"2024-04-23T19:04:24.009279+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:04:24.009279+0000","last_undegraded":"2024-04-23T19:04:24.009279+0000","last_fullsized":"2024-04-23T19:04:24.009279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-04-23T19:04:24.009055+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-04-23T19:04:24.009055+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.009055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:42.662063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.384687+0000","last_change":"2024-04-23T19:04:11.384687+0000","last_active":"2024-04-23T19:04:11.384687+0000","last_peered":"2024-04-23T19:04:11.384687+0000","last_clean":"2024-04-23T19:04:11.384687+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:04:11.384687+0000","last_undegraded":"2024-04-23T19:04:11.384687+0000","last_fullsized":"2024-04-23T19:04:11.384687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-23T19:04:11.384413+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.384413+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.384413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:57.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'48","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.863240+0000","last_change":"2024-04-23T19:04:33.863300+0000","last_active":"2024-04-23T19:04:33.863240+0000","last_peered":"2024-04-23T19:04:33.863240+0000","last_clean":"2024-04-23T19:04:33.863240+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:04:33.863240+0000","last_undegraded":"2024-04-23T19:04:33.863240+0000","last_fullsized":"2024-04-23T19:04:33.863240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:33.863050+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:33.863050+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.863050+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:05.508145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.974603+0000","last_change":"2024-04-23T19:04:08.974603+0000","last_active":"2024-04-23T19:04:08.974603+0000","last_peered":"2024-04-23T19:04:08.974603+0000","last_clean":"2024-04-23T19:04:08.974603+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:04:08.974603+0000","last_undegraded":"2024-04-23T19:04:08.974603+0000","last_fullsized":"2024-04-23T19:04:08.974603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'8","last_scrub_stamp":"2024-04-23T19:04:08.974238+0000","last_deep_scrub":"89'8","last_deep_scrub_stamp":"2024-04-23T19:04:08.974238+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.974238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:23.342084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.112101+0000","last_change":"2024-04-23T19:04:29.112170+0000","last_active":"2024-04-23T19:04:29.112101+0000","last_peered":"2024-04-23T19:04:29.112101+0000","last_clean":"2024-04-23T19:04:29.112101+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:04:29.112101+0000","last_undegraded":"2024-04-23T19:04:29.112101+0000","last_fullsized":"2024-04-23T19:04:29.112101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'8","last_scrub_stamp":"2024-04-23T19:04:29.111878+0000","last_deep_scrub":"75'8","last_deep_scrub_stamp":"2024-04-23T19:04:29.111878+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.111878+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:10.588097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.008010+0000","last_change":"2024-04-23T19:04:14.008071+0000","last_active":"2024-04-23T19:04:14.008010+0000","last_peered":"2024-04-23T19:04:14.008010+0000","last_clean":"2024-04-23T19:04:14.008010+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:04:14.008010+0000","last_undegraded":"2024-04-23T19:04:14.008010+0000","last_fullsized":"2024-04-23T19:04:14.008010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:14.007823+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:14.007823+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.007823+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:02.029745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.014299+0000","last_change":"2024-04-23T19:04:08.014365+0000","last_active":"2024-04-23T19:04:08.014299+0000","last_peered":"2024-04-23T19:04:08.014299+0000","last_clean":"2024-04-23T19:04:08.014299+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:04:08.014299+0000","last_undegraded":"2024-04-23T19:04:08.014299+0000","last_fullsized":"2024-04-23T19:04:08.014299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:08.014057+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:08.014057+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.014057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:00.990004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.160560+0000","last_change":"2024-04-23T19:04:17.160620+0000","last_active":"2024-04-23T19:04:17.160560+0000","last_peered":"2024-04-23T19:04:17.160560+0000","last_clean":"2024-04-23T19:04:17.160560+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:04:17.160560+0000","last_undegraded":"2024-04-23T19:04:17.160560+0000","last_fullsized":"2024-04-23T19:04:17.160560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:17.160373+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:17.160373+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.160373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:06.310668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.361954+0000","last_change":"2024-04-23T19:04:10.362013+0000","last_active":"2024-04-23T19:04:10.361954+0000","last_peered":"2024-04-23T19:04:10.361954+0000","last_clean":"2024-04-23T19:04:10.361954+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:04:10.361954+0000","last_undegraded":"2024-04-23T19:04:10.361954+0000","last_fullsized":"2024-04-23T19:04:10.361954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'14","last_scrub_stamp":"2024-04-23T19:04:10.361754+0000","last_deep_scrub":"57'14","last_deep_scrub_stamp":"2024-04-23T19:04:10.361754+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.361754+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:40.685164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.131762+0000","last_change":"2024-04-23T19:04:16.131822+0000","last_active":"2024-04-23T19:04:16.131762+0000","last_peered":"2024-04-23T19:04:16.131762+0000","last_clean":"2024-04-23T19:04:16.131762+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:04:16.131762+0000","last_undegraded":"2024-04-23T19:04:16.131762+0000","last_fullsized":"2024-04-23T19:04:16.131762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:16.131570+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:16.131570+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.131570+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:12.862429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.940073+0000","last_change":"2024-04-23T19:04:07.940142+0000","last_active":"2024-04-23T19:04:07.940073+0000","last_peered":"2024-04-23T19:04:07.940073+0000","last_clean":"2024-04-23T19:04:07.940073+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:04:07.940073+0000","last_undegraded":"2024-04-23T19:04:07.940073+0000","last_fullsized":"2024-04-23T19:04:07.940073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:07.939845+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:07.939845+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:54.688217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'32","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.104264+0000","last_change":"2024-04-23T19:04:27.104324+0000","last_active":"2024-04-23T19:04:27.104264+0000","last_peered":"2024-04-23T19:04:27.104264+0000","last_clean":"2024-04-23T19:04:27.104264+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:04:27.104264+0000","last_undegraded":"2024-04-23T19:04:27.104264+0000","last_fullsized":"2024-04-23T19:04:27.104264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:27.104061+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:27.104061+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.104061+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:37.322176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.007622+0000","last_change":"2024-04-23T19:04:12.007691+0000","last_active":"2024-04-23T19:04:12.007622+0000","last_peered":"2024-04-23T19:04:12.007622+0000","last_clean":"2024-04-23T19:04:12.007622+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:04:12.007622+0000","last_undegraded":"2024-04-23T19:04:12.007622+0000","last_fullsized":"2024-04-23T19:04:12.007622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:12.007381+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:12.007381+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.007381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:56.924916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'54","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.869165+0000","last_change":"2024-04-23T19:04:29.869227+0000","last_active":"2024-04-23T19:04:29.869165+0000","last_peered":"2024-04-23T19:04:29.869165+0000","last_clean":"2024-04-23T19:04:29.869165+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:04:29.869165+0000","last_undegraded":"2024-04-23T19:04:29.869165+0000","last_fullsized":"2024-04-23T19:04:29.869165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-04-23T19:04:29.868971+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-04-23T19:04:29.868971+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.868971+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:22:56.636376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.101587+0000","last_change":"2024-04-23T19:04:15.101729+0000","last_active":"2024-04-23T19:04:15.101587+0000","last_peered":"2024-04-23T19:04:15.101587+0000","last_clean":"2024-04-23T19:04:15.101587+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:04:15.101587+0000","last_undegraded":"2024-04-23T19:04:15.101587+0000","last_fullsized":"2024-04-23T19:04:15.101587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-04-23T19:04:15.101352+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-04-23T19:04:15.101352+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.101352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:11.702279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'38","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.657359+0000","last_change":"2024-04-23T19:04:24.657423+0000","last_active":"2024-04-23T19:04:24.657359+0000","last_peered":"2024-04-23T19:04:24.657359+0000","last_clean":"2024-04-23T19:04:24.657359+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:04:24.657359+0000","last_undegraded":"2024-04-23T19:04:24.657359+0000","last_fullsized":"2024-04-23T19:04:24.657359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:24.657123+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:24.657123+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.657123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:52.976305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:38.061703+0000","last_change":"2024-04-23T19:04:38.061755+0000","last_active":"2024-04-23T19:04:38.061703+0000","last_peered":"2024-04-23T19:04:38.061703+0000","last_clean":"2024-04-23T19:04:38.061703+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:04:38.061703+0000","last_undegraded":"2024-04-23T19:04:38.061703+0000","last_fullsized":"2024-04-23T19:04:38.061703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:38.061503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:38.061503+0000","last_clean_scrub_stamp":"2024-04-23T19:04:38.061503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:03.981833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.850246+0000","last_change":"2024-04-23T19:04:20.850307+0000","last_active":"2024-04-23T19:04:20.850246+0000","last_peered":"2024-04-23T19:04:20.850246+0000","last_clean":"2024-04-23T19:04:20.850246+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:04:20.850246+0000","last_undegraded":"2024-04-23T19:04:20.850246+0000","last_fullsized":"2024-04-23T19:04:20.850246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.850014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.850014+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.850014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:28.063027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'48","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.052830+0000","last_change":"2024-04-23T19:04:20.052963+0000","last_active":"2024-04-23T19:04:20.052830+0000","last_peered":"2024-04-23T19:04:20.052830+0000","last_clean":"2024-04-23T19:04:20.052830+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:04:20.052830+0000","last_undegraded":"2024-04-23T19:04:20.052830+0000","last_fullsized":"2024-04-23T19:04:20.052830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:20.052592+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:20.052592+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.052592+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:13.028540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.377530+0000","last_change":"2024-04-23T19:04:18.377587+0000","last_active":"2024-04-23T19:04:18.377530+0000","last_peered":"2024-04-23T19:04:18.377530+0000","last_clean":"2024-04-23T19:04:18.377530+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:04:18.377530+0000","last_undegraded":"2024-04-23T19:04:18.377530+0000","last_fullsized":"2024-04-23T19:04:18.377530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.377330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.377330+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.377330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:55.319797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'26","reported_seq":155,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.784301+0000","last_change":"2024-04-23T19:04:34.784378+0000","last_active":"2024-04-23T19:04:34.784301+0000","last_peered":"2024-04-23T19:04:34.784301+0000","last_clean":"2024-04-23T19:04:34.784301+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:04:34.784301+0000","last_undegraded":"2024-04-23T19:04:34.784301+0000","last_fullsized":"2024-04-23T19:04:34.784301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:34.784105+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:34.784105+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.784105+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:06.429200+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.047670+0000","last_change":"2024-04-23T19:04:30.047731+0000","last_active":"2024-04-23T19:04:30.047670+0000","last_peered":"2024-04-23T19:04:30.047670+0000","last_clean":"2024-04-23T19:04:30.047670+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:04:30.047670+0000","last_undegraded":"2024-04-23T19:04:30.047670+0000","last_fullsized":"2024-04-23T19:04:30.047670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:30.047439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:30.047439+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.047439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:36.229495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"116'49","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.382752+0000","last_change":"2024-04-23T19:04:34.382824+0000","last_active":"2024-04-23T19:04:34.382752+0000","last_peered":"2024-04-23T19:04:34.382752+0000","last_clean":"2024-04-23T19:04:34.382752+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:04:34.382752+0000","last_undegraded":"2024-04-23T19:04:34.382752+0000","last_fullsized":"2024-04-23T19:04:34.382752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'49","last_scrub_stamp":"2024-04-23T19:04:34.382560+0000","last_deep_scrub":"116'49","last_deep_scrub_stamp":"2024-04-23T19:04:34.382560+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.382560+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:09.480804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.304934+0000","last_change":"2024-04-23T19:04:06.304994+0000","last_active":"2024-04-23T19:04:06.304934+0000","last_peered":"2024-04-23T19:04:06.304934+0000","last_clean":"2024-04-23T19:04:06.304934+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:04:06.304934+0000","last_undegraded":"2024-04-23T19:04:06.304934+0000","last_fullsized":"2024-04-23T19:04:06.304934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:06.304698+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.304698+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.304698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:53.608671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'62","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.673790+0000","last_change":"2024-04-23T19:04:29.673936+0000","last_active":"2024-04-23T19:04:29.673790+0000","last_peered":"2024-04-23T19:04:29.673790+0000","last_clean":"2024-04-23T19:04:29.673790+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:04:29.673790+0000","last_undegraded":"2024-04-23T19:04:29.673790+0000","last_fullsized":"2024-04-23T19:04:29.673790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:29.673572+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:29.673572+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.673572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:22:56.440977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.799578+0000","last_change":"2024-04-23T19:04:23.799631+0000","last_active":"2024-04-23T19:04:23.799578+0000","last_peered":"2024-04-23T19:04:23.799578+0000","last_clean":"2024-04-23T19:04:23.799578+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:04:23.799578+0000","last_undegraded":"2024-04-23T19:04:23.799578+0000","last_fullsized":"2024-04-23T19:04:23.799578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:23.799380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:23.799380+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.799380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:48.470948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"116'9","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.865860+0000","last_change":"2024-04-23T19:04:03.865928+0000","last_active":"2024-04-23T19:04:03.865860+0000","last_peered":"2024-04-23T19:04:03.865860+0000","last_clean":"2024-04-23T19:04:03.865860+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:04:03.865860+0000","last_undegraded":"2024-04-23T19:04:03.865860+0000","last_fullsized":"2024-04-23T19:04:03.865860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'9","last_scrub_stamp":"2024-04-23T19:04:03.865681+0000","last_deep_scrub":"116'9","last_deep_scrub_stamp":"2024-04-23T19:04:03.865681+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.865681+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:37.482152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.120813+0000","last_change":"2024-04-23T19:04:34.120879+0000","last_active":"2024-04-23T19:04:34.120813+0000","last_peered":"2024-04-23T19:04:34.120813+0000","last_clean":"2024-04-23T19:04:34.120813+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:04:34.120813+0000","last_undegraded":"2024-04-23T19:04:34.120813+0000","last_fullsized":"2024-04-23T19:04:34.120813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:34.120596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:34.120596+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.120596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:25.028442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.538570+0000","last_change":"2024-04-23T19:04:05.538628+0000","last_active":"2024-04-23T19:04:05.538570+0000","last_peered":"2024-04-23T19:04:05.538570+0000","last_clean":"2024-04-23T19:04:05.538570+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:04:05.538570+0000","last_undegraded":"2024-04-23T19:04:05.538570+0000","last_fullsized":"2024-04-23T19:04:05.538570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.538348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.538348+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.538348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:51.173204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.634767+0000","last_change":"2024-04-23T19:04:16.634937+0000","last_active":"2024-04-23T19:04:16.634767+0000","last_peered":"2024-04-23T19:04:16.634767+0000","last_clean":"2024-04-23T19:04:16.634767+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:04:16.634767+0000","last_undegraded":"2024-04-23T19:04:16.634767+0000","last_fullsized":"2024-04-23T19:04:16.634767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:16.634534+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:16.634534+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.634534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.464050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'44","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.994192+0000","last_change":"2024-04-23T19:04:24.994260+0000","last_active":"2024-04-23T19:04:24.994192+0000","last_peered":"2024-04-23T19:04:24.994192+0000","last_clean":"2024-04-23T19:04:24.994192+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:04:24.994192+0000","last_undegraded":"2024-04-23T19:04:24.994192+0000","last_fullsized":"2024-04-23T19:04:24.994192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:24.993985+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:24.993985+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.993985+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:02.474594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.805997+0000","last_change":"2024-04-23T19:04:19.806052+0000","last_active":"2024-04-23T19:04:19.805997+0000","last_peered":"2024-04-23T19:04:19.805997+0000","last_clean":"2024-04-23T19:04:19.805997+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:04:19.805997+0000","last_undegraded":"2024-04-23T19:04:19.805997+0000","last_fullsized":"2024-04-23T19:04:19.805997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.805796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.805796+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.805796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:30.023911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"116'15","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.130014+0000","last_change":"2024-04-23T19:04:15.130096+0000","last_active":"2024-04-23T19:04:15.130014+0000","last_peered":"2024-04-23T19:04:15.130014+0000","last_clean":"2024-04-23T19:04:15.130014+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:04:15.130014+0000","last_undegraded":"2024-04-23T19:04:15.130014+0000","last_fullsized":"2024-04-23T19:04:15.130014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:15.129819+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:15.129819+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.129819+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:27.829926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'139","reported_seq":372,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.061402+0000","last_change":"2024-04-23T19:04:31.061479+0000","last_active":"2024-04-23T19:04:31.061402+0000","last_peered":"2024-04-23T19:04:31.061402+0000","last_clean":"2024-04-23T19:04:31.061402+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:04:31.061402+0000","last_undegraded":"2024-04-23T19:04:31.061402+0000","last_fullsized":"2024-04-23T19:04:31.061402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-04-23T19:04:31.061202+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-04-23T19:04:31.061202+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.061202+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:37.627440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.034399+0000","last_change":"2024-04-23T19:04:36.034459+0000","last_active":"2024-04-23T19:04:36.034399+0000","last_peered":"2024-04-23T19:04:36.034399+0000","last_clean":"2024-04-23T19:04:36.034399+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:04:36.034399+0000","last_undegraded":"2024-04-23T19:04:36.034399+0000","last_fullsized":"2024-04-23T19:04:36.034399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-04-23T19:04:36.034201+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-04-23T19:04:36.034201+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.034201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:11.132445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.748940+0000","last_change":"2024-04-23T19:04:15.749006+0000","last_active":"2024-04-23T19:04:15.748940+0000","last_peered":"2024-04-23T19:04:15.748940+0000","last_clean":"2024-04-23T19:04:15.748940+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:04:15.748940+0000","last_undegraded":"2024-04-23T19:04:15.748940+0000","last_fullsized":"2024-04-23T19:04:15.748940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:15.748737+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:15.748737+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.748737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:22.778779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'48","reported_seq":256,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.100785+0000","last_change":"2024-04-23T19:04:12.100847+0000","last_active":"2024-04-23T19:04:12.100785+0000","last_peered":"2024-04-23T19:04:12.100785+0000","last_clean":"2024-04-23T19:04:12.100785+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:04:12.100785+0000","last_undegraded":"2024-04-23T19:04:12.100785+0000","last_fullsized":"2024-04-23T19:04:12.100785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:12.100585+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:12.100585+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.100585+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:46.299040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.366651+0000","last_change":"2024-04-23T19:04:14.366705+0000","last_active":"2024-04-23T19:04:14.366651+0000","last_peered":"2024-04-23T19:04:14.366651+0000","last_clean":"2024-04-23T19:04:14.366651+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:04:14.366651+0000","last_undegraded":"2024-04-23T19:04:14.366651+0000","last_fullsized":"2024-04-23T19:04:14.366651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:14.366452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:14.366452+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.366452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:06.533771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'23","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.029557+0000","last_change":"2024-04-23T19:04:17.029633+0000","last_active":"2024-04-23T19:04:17.029557+0000","last_peered":"2024-04-23T19:04:17.029557+0000","last_clean":"2024-04-23T19:04:17.029557+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:04:17.029557+0000","last_undegraded":"2024-04-23T19:04:17.029557+0000","last_fullsized":"2024-04-23T19:04:17.029557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:17.029366+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:17.029366+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.029366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:37.775720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'138","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.848142+0000","last_change":"2024-04-23T19:04:01.848166+0000","last_active":"2024-04-23T19:04:01.848142+0000","last_peered":"2024-04-23T19:04:01.848142+0000","last_clean":"2024-04-23T19:04:01.848142+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:04:01.848142+0000","last_undegraded":"2024-04-23T19:04:01.848142+0000","last_fullsized":"2024-04-23T19:04:01.848142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.848048+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:05.290229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.371178+0000","last_change":"2024-04-23T19:04:09.371178+0000","last_active":"2024-04-23T19:04:09.371178+0000","last_peered":"2024-04-23T19:04:09.371178+0000","last_clean":"2024-04-23T19:04:09.371178+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:04:09.371178+0000","last_undegraded":"2024-04-23T19:04:09.371178+0000","last_fullsized":"2024-04-23T19:04:09.371178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:09.370889+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:09.370889+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.370889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:57.392811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.052590+0000","last_change":"2024-04-23T19:04:16.052654+0000","last_active":"2024-04-23T19:04:16.052590+0000","last_peered":"2024-04-23T19:04:16.052590+0000","last_clean":"2024-04-23T19:04:16.052590+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:04:16.052590+0000","last_undegraded":"2024-04-23T19:04:16.052590+0000","last_fullsized":"2024-04-23T19:04:16.052590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:16.052402+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:16.052402+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.052402+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:01.687258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"116'2","reported_seq":294,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.974686+0000","last_change":"2024-04-23T19:04:06.974686+0000","last_active":"2024-04-23T19:04:06.974686+0000","last_peered":"2024-04-23T19:04:06.974686+0000","last_clean":"2024-04-23T19:04:06.974686+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:04:06.974686+0000","last_undegraded":"2024-04-23T19:04:06.974686+0000","last_fullsized":"2024-04-23T19:04:06.974686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:06.974385+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.974385+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.974385+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:31.138018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'38","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.221089+0000","last_change":"2024-04-23T19:04:02.221089+0000","last_active":"2024-04-23T19:04:02.221089+0000","last_peered":"2024-04-23T19:04:02.221089+0000","last_clean":"2024-04-23T19:04:02.221089+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:04:02.221089+0000","last_undegraded":"2024-04-23T19:04:02.221089+0000","last_fullsized":"2024-04-23T19:04:02.221089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:02.220813+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:02.220813+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.220813+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:26.384447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.464968+0000","last_change":"2024-04-23T19:04:19.465071+0000","last_active":"2024-04-23T19:04:19.464968+0000","last_peered":"2024-04-23T19:04:19.464968+0000","last_clean":"2024-04-23T19:04:19.464968+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:04:19.464968+0000","last_undegraded":"2024-04-23T19:04:19.464968+0000","last_fullsized":"2024-04-23T19:04:19.464968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.464712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.464712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.464712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:19.055281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.363566+0000","last_change":"2024-04-23T19:04:35.363566+0000","last_active":"2024-04-23T19:04:35.363566+0000","last_peered":"2024-04-23T19:04:35.363566+0000","last_clean":"2024-04-23T19:04:35.363566+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:04:35.363566+0000","last_undegraded":"2024-04-23T19:04:35.363566+0000","last_fullsized":"2024-04-23T19:04:35.363566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-23T19:04:35.363290+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-23T19:04:35.363290+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.363290+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:02.130694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.118471+0000","last_change":"2024-04-23T19:04:22.118471+0000","last_active":"2024-04-23T19:04:22.118471+0000","last_peered":"2024-04-23T19:04:22.118471+0000","last_clean":"2024-04-23T19:04:22.118471+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:04:22.118471+0000","last_undegraded":"2024-04-23T19:04:22.118471+0000","last_fullsized":"2024-04-23T19:04:22.118471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:22.118212+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:22.118212+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.118212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:09.405388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'62","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.016818+0000","last_change":"2024-04-23T19:04:26.016882+0000","last_active":"2024-04-23T19:04:26.016818+0000","last_peered":"2024-04-23T19:04:26.016818+0000","last_clean":"2024-04-23T19:04:26.016818+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:04:26.016818+0000","last_undegraded":"2024-04-23T19:04:26.016818+0000","last_fullsized":"2024-04-23T19:04:26.016818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:26.016607+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:26.016607+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.016607+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:13.303783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.996299+0000","last_change":"2024-04-23T19:04:00.996299+0000","last_active":"2024-04-23T19:04:00.996299+0000","last_peered":"2024-04-23T19:04:00.996299+0000","last_clean":"2024-04-23T19:04:00.996299+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:04:00.996299+0000","last_undegraded":"2024-04-23T19:04:00.996299+0000","last_fullsized":"2024-04-23T19:04:00.996299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.996139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.783439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'23","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.691386+0000","last_change":"2024-04-23T19:04:10.691464+0000","last_active":"2024-04-23T19:04:10.691386+0000","last_peered":"2024-04-23T19:04:10.691386+0000","last_clean":"2024-04-23T19:04:10.691386+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:04:10.691386+0000","last_undegraded":"2024-04-23T19:04:10.691386+0000","last_fullsized":"2024-04-23T19:04:10.691386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:10.691176+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:10.691176+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.691176+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:23.752968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.824414+0000","last_change":"2024-04-23T19:04:05.824493+0000","last_active":"2024-04-23T19:04:05.824414+0000","last_peered":"2024-04-23T19:04:05.824414+0000","last_clean":"2024-04-23T19:04:05.824414+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:04:05.824414+0000","last_undegraded":"2024-04-23T19:04:05.824414+0000","last_fullsized":"2024-04-23T19:04:05.824414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.824218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.824218+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.824218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:51.459074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.131906+0000","last_change":"2024-04-23T19:04:25.131906+0000","last_active":"2024-04-23T19:04:25.131906+0000","last_peered":"2024-04-23T19:04:25.131906+0000","last_clean":"2024-04-23T19:04:25.131906+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:04:25.131906+0000","last_undegraded":"2024-04-23T19:04:25.131906+0000","last_fullsized":"2024-04-23T19:04:25.131906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:25.131656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:25.131656+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.131656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:21.732583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.238150+0000","last_change":"2024-04-23T19:04:04.238150+0000","last_active":"2024-04-23T19:04:04.238150+0000","last_peered":"2024-04-23T19:04:04.238150+0000","last_clean":"2024-04-23T19:04:04.238150+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:04:04.238150+0000","last_undegraded":"2024-04-23T19:04:04.238150+0000","last_fullsized":"2024-04-23T19:04:04.238150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:04.237885+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:04.237885+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.237885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:18.605731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'28","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.030762+0000","last_change":"2024-04-23T19:04:12.030820+0000","last_active":"2024-04-23T19:04:12.030762+0000","last_peered":"2024-04-23T19:04:12.030762+0000","last_clean":"2024-04-23T19:04:12.030762+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:04:12.030762+0000","last_undegraded":"2024-04-23T19:04:12.030762+0000","last_fullsized":"2024-04-23T19:04:12.030762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:12.030567+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:12.030567+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.030567+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:15.472747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.017534+0000","last_change":"2024-04-23T19:04:02.017639+0000","last_active":"2024-04-23T19:04:02.017534+0000","last_peered":"2024-04-23T19:04:02.017534+0000","last_clean":"2024-04-23T19:04:02.017534+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:04:02.017534+0000","last_undegraded":"2024-04-23T19:04:02.017534+0000","last_fullsized":"2024-04-23T19:04:02.017534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.017294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.017294+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.017294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:06.320183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'32","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.053915+0000","last_change":"2024-04-23T19:04:13.053915+0000","last_active":"2024-04-23T19:04:13.053915+0000","last_peered":"2024-04-23T19:04:13.053915+0000","last_clean":"2024-04-23T19:04:13.053915+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:04:13.053915+0000","last_undegraded":"2024-04-23T19:04:13.053915+0000","last_fullsized":"2024-04-23T19:04:13.053915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:13.053625+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:13.053625+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.053625+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:12.306410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'138","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.588692+0000","last_change":"2024-04-23T19:04:19.588841+0000","last_active":"2024-04-23T19:04:19.588692+0000","last_peered":"2024-04-23T19:04:19.588692+0000","last_clean":"2024-04-23T19:04:19.588692+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:04:19.588692+0000","last_undegraded":"2024-04-23T19:04:19.588692+0000","last_fullsized":"2024-04-23T19:04:19.588692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:19.588382+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:19.588382+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.588382+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:26.154620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.400773+0000","last_change":"2024-04-23T19:03:59.400805+0000","last_active":"2024-04-23T19:03:59.400773+0000","last_peered":"2024-04-23T19:03:59.400773+0000","last_clean":"2024-04-23T19:03:59.400773+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:59.400773+0000","last_undegraded":"2024-04-23T19:03:59.400773+0000","last_fullsized":"2024-04-23T19:03:59.400773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_clean_scrub_stamp":"2024-04-23T19:03:59.400658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:02.291518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.720092+0000","last_change":"2024-04-23T19:04:30.720154+0000","last_active":"2024-04-23T19:04:30.720092+0000","last_peered":"2024-04-23T19:04:30.720092+0000","last_clean":"2024-04-23T19:04:30.720092+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:04:30.720092+0000","last_undegraded":"2024-04-23T19:04:30.720092+0000","last_fullsized":"2024-04-23T19:04:30.720092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:30.719802+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:30.719802+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.719802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:36:17.564645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'36","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.354994+0000","last_change":"2024-04-23T19:04:28.355111+0000","last_active":"2024-04-23T19:04:28.354994+0000","last_peered":"2024-04-23T19:04:28.354994+0000","last_clean":"2024-04-23T19:04:28.354994+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:04:28.354994+0000","last_undegraded":"2024-04-23T19:04:28.354994+0000","last_fullsized":"2024-04-23T19:04:28.354994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:28.354697+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:28.354697+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.354697+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:05.234093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.035240+0000","last_change":"2024-04-23T19:04:13.035240+0000","last_active":"2024-04-23T19:04:13.035240+0000","last_peered":"2024-04-23T19:04:13.035240+0000","last_clean":"2024-04-23T19:04:13.035240+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:04:13.035240+0000","last_undegraded":"2024-04-23T19:04:13.035240+0000","last_fullsized":"2024-04-23T19:04:13.035240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:13.034980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:13.034980+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.034980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:35.581669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'40","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.594412+0000","last_change":"2024-04-23T19:04:17.594412+0000","last_active":"2024-04-23T19:04:17.594412+0000","last_peered":"2024-04-23T19:04:17.594412+0000","last_clean":"2024-04-23T19:04:17.594412+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:04:17.594412+0000","last_undegraded":"2024-04-23T19:04:17.594412+0000","last_fullsized":"2024-04-23T19:04:17.594412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:17.594124+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:17.594124+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.594124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:38.141344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.133572+0000","last_change":"2024-04-23T19:04:17.133626+0000","last_active":"2024-04-23T19:04:17.133572+0000","last_peered":"2024-04-23T19:04:17.133572+0000","last_clean":"2024-04-23T19:04:17.133572+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:04:17.133572+0000","last_undegraded":"2024-04-23T19:04:17.133572+0000","last_fullsized":"2024-04-23T19:04:17.133572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.133385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.133385+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.133385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.033787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"116'9","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.432949+0000","last_change":"2024-04-23T19:04:02.432972+0000","last_active":"2024-04-23T19:04:02.432949+0000","last_peered":"2024-04-23T19:04:02.432949+0000","last_clean":"2024-04-23T19:04:02.432949+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:04:02.432949+0000","last_undegraded":"2024-04-23T19:04:02.432949+0000","last_fullsized":"2024-04-23T19:04:02.432949+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'9","last_scrub_stamp":"2024-04-23T19:04:02.432887+0000","last_deep_scrub":"116'9","last_deep_scrub_stamp":"2024-04-23T19:04:02.432887+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.432887+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:38.237620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.068383+0000","last_change":"2024-04-23T19:04:12.068446+0000","last_active":"2024-04-23T19:04:12.068383+0000","last_peered":"2024-04-23T19:04:12.068383+0000","last_clean":"2024-04-23T19:04:12.068383+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:04:12.068383+0000","last_undegraded":"2024-04-23T19:04:12.068383+0000","last_fullsized":"2024-04-23T19:04:12.068383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:12.068159+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:12.068159+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.068159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:42.391569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'42","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.784051+0000","last_change":"2024-04-23T19:04:27.784113+0000","last_active":"2024-04-23T19:04:27.784051+0000","last_peered":"2024-04-23T19:04:27.784051+0000","last_clean":"2024-04-23T19:04:27.784051+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:04:27.784051+0000","last_undegraded":"2024-04-23T19:04:27.784051+0000","last_fullsized":"2024-04-23T19:04:27.784051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:27.783824+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:27.783824+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.783824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:06.468996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.943499+0000","last_change":"2024-04-23T19:04:03.943553+0000","last_active":"2024-04-23T19:04:03.943499+0000","last_peered":"2024-04-23T19:04:03.943499+0000","last_clean":"2024-04-23T19:04:03.943499+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:04:03.943499+0000","last_undegraded":"2024-04-23T19:04:03.943499+0000","last_fullsized":"2024-04-23T19:04:03.943499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.943302+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:33.673299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'26","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.881699+0000","last_change":"2024-04-23T19:04:02.881845+0000","last_active":"2024-04-23T19:04:02.881699+0000","last_peered":"2024-04-23T19:04:02.881699+0000","last_clean":"2024-04-23T19:04:02.881699+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:04:02.881699+0000","last_undegraded":"2024-04-23T19:04:02.881699+0000","last_fullsized":"2024-04-23T19:04:02.881699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:02.881475+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:02.881475+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.881475+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:51.012695+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.751487+0000","last_change":"2024-04-23T19:04:31.751594+0000","last_active":"2024-04-23T19:04:31.751487+0000","last_peered":"2024-04-23T19:04:31.751487+0000","last_clean":"2024-04-23T19:04:31.751487+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:04:31.751487+0000","last_undegraded":"2024-04-23T19:04:31.751487+0000","last_fullsized":"2024-04-23T19:04:31.751487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:31.751264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:31.751264+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.751264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:49.617110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:39.810811+0000","last_change":"2024-04-23T19:04:39.810878+0000","last_active":"2024-04-23T19:04:39.810811+0000","last_peered":"2024-04-23T19:04:39.810811+0000","last_clean":"2024-04-23T19:04:39.810811+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:04:39.810811+0000","last_undegraded":"2024-04-23T19:04:39.810811+0000","last_fullsized":"2024-04-23T19:04:39.810811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'4","last_scrub_stamp":"2024-04-23T19:04:39.810573+0000","last_deep_scrub":"52'4","last_deep_scrub_stamp":"2024-04-23T19:04:39.810573+0000","last_clean_scrub_stamp":"2024-04-23T19:04:39.810573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.163179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.092948+0000","last_change":"2024-04-23T19:04:14.093012+0000","last_active":"2024-04-23T19:04:14.092948+0000","last_peered":"2024-04-23T19:04:14.092948+0000","last_clean":"2024-04-23T19:04:14.092948+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:04:14.092948+0000","last_undegraded":"2024-04-23T19:04:14.092948+0000","last_fullsized":"2024-04-23T19:04:14.092948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:14.092748+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:14.092748+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.092748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:34.839102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'50","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.132101+0000","last_change":"2024-04-23T19:04:13.132101+0000","last_active":"2024-04-23T19:04:13.132101+0000","last_peered":"2024-04-23T19:04:13.132101+0000","last_clean":"2024-04-23T19:04:13.132101+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:04:13.132101+0000","last_undegraded":"2024-04-23T19:04:13.132101+0000","last_fullsized":"2024-04-23T19:04:13.132101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-04-23T19:04:13.131846+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-04-23T19:04:13.131846+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.131846+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:01.263066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.500436+0000","last_change":"2024-04-23T19:04:05.500510+0000","last_active":"2024-04-23T19:04:05.500436+0000","last_peered":"2024-04-23T19:04:05.500436+0000","last_clean":"2024-04-23T19:04:05.500436+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:04:05.500436+0000","last_undegraded":"2024-04-23T19:04:05.500436+0000","last_fullsized":"2024-04-23T19:04:05.500436+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.500207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.500207+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.500207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:54.624476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'35","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.088728+0000","last_change":"2024-04-23T19:04:14.088806+0000","last_active":"2024-04-23T19:04:14.088728+0000","last_peered":"2024-04-23T19:04:14.088728+0000","last_clean":"2024-04-23T19:04:14.088728+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:04:14.088728+0000","last_undegraded":"2024-04-23T19:04:14.088728+0000","last_fullsized":"2024-04-23T19:04:14.088728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'35","last_scrub_stamp":"2024-04-23T19:04:14.088533+0000","last_deep_scrub":"116'35","last_deep_scrub_stamp":"2024-04-23T19:04:14.088533+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.088533+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:22.612491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":146,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":388,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.159473+0000","last_change":"2024-04-23T19:04:16.159540+0000","last_active":"2024-04-23T19:04:16.159473+0000","last_peered":"2024-04-23T19:04:16.159473+0000","last_clean":"2024-04-23T19:04:16.159473+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:04:16.159473+0000","last_undegraded":"2024-04-23T19:04:16.159473+0000","last_fullsized":"2024-04-23T19:04:16.159473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:16.159281+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:16.159281+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.159281+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:48.033509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":163,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.459746+0000","last_change":"2024-04-23T19:04:11.459809+0000","last_active":"2024-04-23T19:04:11.459746+0000","last_peered":"2024-04-23T19:04:11.459746+0000","last_clean":"2024-04-23T19:04:11.459746+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:04:11.459746+0000","last_undegraded":"2024-04-23T19:04:11.459746+0000","last_fullsized":"2024-04-23T19:04:11.459746+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-04-23T19:04:11.459542+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-04-23T19:04:11.459542+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.459542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:08.060469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.983981+0000","last_change":"2024-04-23T19:04:07.984042+0000","last_active":"2024-04-23T19:04:07.983981+0000","last_peered":"2024-04-23T19:04:07.983981+0000","last_clean":"2024-04-23T19:04:07.983981+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:04:07.983981+0000","last_undegraded":"2024-04-23T19:04:07.983981+0000","last_fullsized":"2024-04-23T19:04:07.983981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'8","last_scrub_stamp":"2024-04-23T19:04:07.983769+0000","last_deep_scrub":"57'8","last_deep_scrub_stamp":"2024-04-23T19:04:07.983769+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.983769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:55.287742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'56","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.130031+0000","last_change":"2024-04-23T19:04:25.130031+0000","last_active":"2024-04-23T19:04:25.130031+0000","last_peered":"2024-04-23T19:04:25.130031+0000","last_clean":"2024-04-23T19:04:25.130031+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:04:25.130031+0000","last_undegraded":"2024-04-23T19:04:25.130031+0000","last_fullsized":"2024-04-23T19:04:25.130031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:25.129543+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:25.129543+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.129543+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:45.676763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":388,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.391256+0000","last_change":"2024-04-23T19:04:12.391394+0000","last_active":"2024-04-23T19:04:12.391256+0000","last_peered":"2024-04-23T19:04:12.391256+0000","last_clean":"2024-04-23T19:04:12.391256+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:04:12.391256+0000","last_undegraded":"2024-04-23T19:04:12.391256+0000","last_fullsized":"2024-04-23T19:04:12.391256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-04-23T19:04:12.390988+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-04-23T19:04:12.390988+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.390988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:33.137342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"116'17","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.737886+0000","last_change":"2024-04-23T19:04:08.737961+0000","last_active":"2024-04-23T19:04:08.737886+0000","last_peered":"2024-04-23T19:04:08.737886+0000","last_clean":"2024-04-23T19:04:08.737886+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:04:08.737886+0000","last_undegraded":"2024-04-23T19:04:08.737886+0000","last_fullsized":"2024-04-23T19:04:08.737886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'17","last_scrub_stamp":"2024-04-23T19:04:08.737701+0000","last_deep_scrub":"116'17","last_deep_scrub_stamp":"2024-04-23T19:04:08.737701+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.737701+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.905021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":419,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.174174+0000","last_change":"2024-04-23T19:04:19.174316+0000","last_active":"2024-04-23T19:04:19.174174+0000","last_peered":"2024-04-23T19:04:19.174174+0000","last_clean":"2024-04-23T19:04:19.174174+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:04:19.174174+0000","last_undegraded":"2024-04-23T19:04:19.174174+0000","last_fullsized":"2024-04-23T19:04:19.174174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:19.173947+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:19.173947+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.173947+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:08.298216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.076962+0000","last_change":"2024-04-23T19:04:35.076962+0000","last_active":"2024-04-23T19:04:35.076962+0000","last_peered":"2024-04-23T19:04:35.076962+0000","last_clean":"2024-04-23T19:04:35.076962+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:04:35.076962+0000","last_undegraded":"2024-04-23T19:04:35.076962+0000","last_fullsized":"2024-04-23T19:04:35.076962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:35.076708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:35.076708+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.076708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:13.761880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.459926+0000","last_change":"2024-04-23T19:04:17.459989+0000","last_active":"2024-04-23T19:04:17.459926+0000","last_peered":"2024-04-23T19:04:17.459926+0000","last_clean":"2024-04-23T19:04:17.459926+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:04:17.459926+0000","last_undegraded":"2024-04-23T19:04:17.459926+0000","last_fullsized":"2024-04-23T19:04:17.459926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.459688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.459688+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.459688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:34:01.304683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.824547+0000","last_change":"2024-04-23T19:04:28.824547+0000","last_active":"2024-04-23T19:04:28.824547+0000","last_peered":"2024-04-23T19:04:28.824547+0000","last_clean":"2024-04-23T19:04:28.824547+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:04:28.824547+0000","last_undegraded":"2024-04-23T19:04:28.824547+0000","last_fullsized":"2024-04-23T19:04:28.824547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:28.824270+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:28.824270+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.824270+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:03.922514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.109328+0000","last_change":"2024-04-23T19:04:21.109384+0000","last_active":"2024-04-23T19:04:21.109328+0000","last_peered":"2024-04-23T19:04:21.109328+0000","last_clean":"2024-04-23T19:04:21.109328+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:04:21.109328+0000","last_undegraded":"2024-04-23T19:04:21.109328+0000","last_fullsized":"2024-04-23T19:04:21.109328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.109080+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.109080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:58.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'37","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.384405+0000","last_change":"2024-04-23T19:04:30.384493+0000","last_active":"2024-04-23T19:04:30.384405+0000","last_peered":"2024-04-23T19:04:30.384405+0000","last_clean":"2024-04-23T19:04:30.384405+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:04:30.384405+0000","last_undegraded":"2024-04-23T19:04:30.384405+0000","last_fullsized":"2024-04-23T19:04:30.384405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'37","last_scrub_stamp":"2024-04-23T19:04:30.384199+0000","last_deep_scrub":"116'37","last_deep_scrub_stamp":"2024-04-23T19:04:30.384199+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.384199+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:58.703381+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.234660+0000","last_change":"2024-04-23T19:04:07.234718+0000","last_active":"2024-04-23T19:04:07.234660+0000","last_peered":"2024-04-23T19:04:07.234660+0000","last_clean":"2024-04-23T19:04:07.234660+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:04:07.234660+0000","last_undegraded":"2024-04-23T19:04:07.234660+0000","last_fullsized":"2024-04-23T19:04:07.234660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.234461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.234461+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.234461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:52.151995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.374016+0000","last_change":"2024-04-23T19:04:23.374087+0000","last_active":"2024-04-23T19:04:23.374016+0000","last_peered":"2024-04-23T19:04:23.374016+0000","last_clean":"2024-04-23T19:04:23.374016+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:04:23.374016+0000","last_undegraded":"2024-04-23T19:04:23.374016+0000","last_fullsized":"2024-04-23T19:04:23.374016+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-23T19:04:23.373892+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-23T19:04:23.373892+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.373892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:29.940129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.228280+0000","last_change":"2024-04-23T19:04:08.228280+0000","last_active":"2024-04-23T19:04:08.228280+0000","last_peered":"2024-04-23T19:04:08.228280+0000","last_clean":"2024-04-23T19:04:08.228280+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:04:08.228280+0000","last_undegraded":"2024-04-23T19:04:08.228280+0000","last_fullsized":"2024-04-23T19:04:08.228280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:08.228012+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:08.228012+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.228012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:30.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"116'119","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.960633+0000","last_change":"2024-04-23T19:04:20.960714+0000","last_active":"2024-04-23T19:04:20.960633+0000","last_peered":"2024-04-23T19:04:20.960633+0000","last_clean":"2024-04-23T19:04:20.960633+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:04:20.960633+0000","last_undegraded":"2024-04-23T19:04:20.960633+0000","last_fullsized":"2024-04-23T19:04:20.960633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'119","last_scrub_stamp":"2024-04-23T19:04:20.960444+0000","last_deep_scrub":"116'119","last_deep_scrub_stamp":"2024-04-23T19:04:20.960444+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.960444+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:32.947863+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.351480+0000","last_change":"2024-04-23T19:04:22.351532+0000","last_active":"2024-04-23T19:04:22.351480+0000","last_peered":"2024-04-23T19:04:22.351480+0000","last_clean":"2024-04-23T19:04:22.351480+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:04:22.351480+0000","last_undegraded":"2024-04-23T19:04:22.351480+0000","last_fullsized":"2024-04-23T19:04:22.351480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:22.351291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:22.351291+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.351291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:09.963762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'46","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.852854+0000","last_change":"2024-04-23T19:04:34.852916+0000","last_active":"2024-04-23T19:04:34.852854+0000","last_peered":"2024-04-23T19:04:34.852854+0000","last_clean":"2024-04-23T19:04:34.852854+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:04:34.852854+0000","last_undegraded":"2024-04-23T19:04:34.852854+0000","last_fullsized":"2024-04-23T19:04:34.852854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:34.852656+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:34.852656+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.852656+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:05.376687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.024537+0000","last_change":"2024-04-23T19:04:11.024537+0000","last_active":"2024-04-23T19:04:11.024537+0000","last_peered":"2024-04-23T19:04:11.024537+0000","last_clean":"2024-04-23T19:04:11.024537+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:04:11.024537+0000","last_undegraded":"2024-04-23T19:04:11.024537+0000","last_fullsized":"2024-04-23T19:04:11.024537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:11.024301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:11.024301+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.024301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.562463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'51","reported_seq":276,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.255459+0000","last_change":"2024-04-23T19:04:03.255459+0000","last_active":"2024-04-23T19:04:03.255459+0000","last_peered":"2024-04-23T19:04:03.255459+0000","last_clean":"2024-04-23T19:04:03.255459+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:04:03.255459+0000","last_undegraded":"2024-04-23T19:04:03.255459+0000","last_fullsized":"2024-04-23T19:04:03.255459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'51","last_scrub_stamp":"2024-04-23T19:04:03.255190+0000","last_deep_scrub":"116'51","last_deep_scrub_stamp":"2024-04-23T19:04:03.255190+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.255190+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:56.231137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.469304+0000","last_change":"2024-04-23T19:04:03.469410+0000","last_active":"2024-04-23T19:04:03.469304+0000","last_peered":"2024-04-23T19:04:03.469304+0000","last_clean":"2024-04-23T19:04:03.469304+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:04:03.469304+0000","last_undegraded":"2024-04-23T19:04:03.469304+0000","last_fullsized":"2024-04-23T19:04:03.469304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.469047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.469047+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.469047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:51.490970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.131408+0000","last_change":"2024-04-23T19:04:23.131462+0000","last_active":"2024-04-23T19:04:23.131408+0000","last_peered":"2024-04-23T19:04:23.131408+0000","last_clean":"2024-04-23T19:04:23.131408+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:04:23.131408+0000","last_undegraded":"2024-04-23T19:04:23.131408+0000","last_fullsized":"2024-04-23T19:04:23.131408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:23.131200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:23.131200+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.131200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:08.766056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.606031+0000","last_change":"2024-04-23T19:04:20.606031+0000","last_active":"2024-04-23T19:04:20.606031+0000","last_peered":"2024-04-23T19:04:20.606031+0000","last_clean":"2024-04-23T19:04:20.606031+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:04:20.606031+0000","last_undegraded":"2024-04-23T19:04:20.606031+0000","last_fullsized":"2024-04-23T19:04:20.606031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:20.605740+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:20.605740+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.605740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:27.818753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.961383+0000","last_change":"2024-04-23T19:04:21.961440+0000","last_active":"2024-04-23T19:04:21.961383+0000","last_peered":"2024-04-23T19:04:21.961383+0000","last_clean":"2024-04-23T19:04:21.961383+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:04:21.961383+0000","last_undegraded":"2024-04-23T19:04:21.961383+0000","last_fullsized":"2024-04-23T19:04:21.961383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.961161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.961161+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.961161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:19:09.753334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'64","reported_seq":273,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.591923+0000","last_change":"2024-04-23T19:04:26.591923+0000","last_active":"2024-04-23T19:04:26.591923+0000","last_peered":"2024-04-23T19:04:26.591923+0000","last_clean":"2024-04-23T19:04:26.591923+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:04:26.591923+0000","last_undegraded":"2024-04-23T19:04:26.591923+0000","last_fullsized":"2024-04-23T19:04:26.591923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'64","last_scrub_stamp":"2024-04-23T19:04:26.591668+0000","last_deep_scrub":"116'64","last_deep_scrub_stamp":"2024-04-23T19:04:26.591668+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.591668+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:05.686272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.355462+0000","last_change":"2024-04-23T19:04:16.355462+0000","last_active":"2024-04-23T19:04:16.355462+0000","last_peered":"2024-04-23T19:04:16.355462+0000","last_clean":"2024-04-23T19:04:16.355462+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:04:16.355462+0000","last_undegraded":"2024-04-23T19:04:16.355462+0000","last_fullsized":"2024-04-23T19:04:16.355462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:16.355181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:16.355181+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.355181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:29.416973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'155","reported_seq":470,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.452650+0000","last_change":"2024-04-23T19:04:18.452650+0000","last_active":"2024-04-23T19:04:18.452650+0000","last_peered":"2024-04-23T19:04:18.452650+0000","last_clean":"2024-04-23T19:04:18.452650+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:04:18.452650+0000","last_undegraded":"2024-04-23T19:04:18.452650+0000","last_fullsized":"2024-04-23T19:04:18.452650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'155","last_scrub_stamp":"2024-04-23T19:04:18.452249+0000","last_deep_scrub":"116'155","last_deep_scrub_stamp":"2024-04-23T19:04:18.452249+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.452249+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:26.229526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.057260+0000","last_change":"2024-04-23T19:04:32.057260+0000","last_active":"2024-04-23T19:04:32.057260+0000","last_peered":"2024-04-23T19:04:32.057260+0000","last_clean":"2024-04-23T19:04:32.057260+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:04:32.057260+0000","last_undegraded":"2024-04-23T19:04:32.057260+0000","last_fullsized":"2024-04-23T19:04:32.057260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:32.056885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:32.056885+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.056885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:39.269898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.462170+0000","last_change":"2024-04-23T19:04:21.462234+0000","last_active":"2024-04-23T19:04:21.462170+0000","last_peered":"2024-04-23T19:04:21.462170+0000","last_clean":"2024-04-23T19:04:21.462170+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:04:21.462170+0000","last_undegraded":"2024-04-23T19:04:21.462170+0000","last_fullsized":"2024-04-23T19:04:21.462170+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-23T19:04:21.461933+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-23T19:04:21.461933+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.461933+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:42.009153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.408224+0000","last_change":"2024-04-23T19:04:15.408224+0000","last_active":"2024-04-23T19:04:15.408224+0000","last_peered":"2024-04-23T19:04:15.408224+0000","last_clean":"2024-04-23T19:04:15.408224+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:04:15.408224+0000","last_undegraded":"2024-04-23T19:04:15.408224+0000","last_fullsized":"2024-04-23T19:04:15.408224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-04-23T19:04:15.407932+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-04-23T19:04:15.407932+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.407932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:31.170100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.949922+0000","last_change":"2024-04-23T19:04:04.949922+0000","last_active":"2024-04-23T19:04:04.949922+0000","last_peered":"2024-04-23T19:04:04.949922+0000","last_clean":"2024-04-23T19:04:04.949922+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:04:04.949922+0000","last_undegraded":"2024-04-23T19:04:04.949922+0000","last_fullsized":"2024-04-23T19:04:04.949922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.949681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.949681+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.949681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:07:40.982094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'28","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.421424+0000","last_change":"2024-04-23T19:04:13.421424+0000","last_active":"2024-04-23T19:04:13.421424+0000","last_peered":"2024-04-23T19:04:13.421424+0000","last_clean":"2024-04-23T19:04:13.421424+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:04:13.421424+0000","last_undegraded":"2024-04-23T19:04:13.421424+0000","last_fullsized":"2024-04-23T19:04:13.421424+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:13.420977+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:13.420977+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.420977+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:29.751910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.987211+0000","last_change":"2024-04-23T19:04:02.987211+0000","last_active":"2024-04-23T19:04:02.987211+0000","last_peered":"2024-04-23T19:04:02.987211+0000","last_clean":"2024-04-23T19:04:02.987211+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:04:02.987211+0000","last_undegraded":"2024-04-23T19:04:02.987211+0000","last_fullsized":"2024-04-23T19:04:02.987211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:02.986892+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:02.986892+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.986892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:20:45.106266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'25","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.078509+0000","last_change":"2024-04-23T19:04:29.078509+0000","last_active":"2024-04-23T19:04:29.078509+0000","last_peered":"2024-04-23T19:04:29.078509+0000","last_clean":"2024-04-23T19:04:29.078509+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:04:29.078509+0000","last_undegraded":"2024-04-23T19:04:29.078509+0000","last_fullsized":"2024-04-23T19:04:29.078509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'25","last_scrub_stamp":"2024-04-23T19:04:29.078196+0000","last_deep_scrub":"116'25","last_deep_scrub_stamp":"2024-04-23T19:04:29.078196+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.078196+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:49.625416+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.501448+0000","last_change":"2024-04-23T19:04:06.501448+0000","last_active":"2024-04-23T19:04:06.501448+0000","last_peered":"2024-04-23T19:04:06.501448+0000","last_clean":"2024-04-23T19:04:06.501448+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:04:06.501448+0000","last_undegraded":"2024-04-23T19:04:06.501448+0000","last_fullsized":"2024-04-23T19:04:06.501448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:06.501180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:06.501180+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.501180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:27.247533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:40.853471+0000","last_change":"2024-04-23T19:04:40.853529+0000","last_active":"2024-04-23T19:04:40.853471+0000","last_peered":"2024-04-23T19:04:40.853471+0000","last_clean":"2024-04-23T19:04:40.853471+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:04:40.853471+0000","last_undegraded":"2024-04-23T19:04:40.853471+0000","last_fullsized":"2024-04-23T19:04:40.853471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:40.853234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:40.853234+0000","last_clean_scrub_stamp":"2024-04-23T19:04:40.853234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:59.143729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.480207+0000","last_change":"2024-04-23T19:04:04.480207+0000","last_active":"2024-04-23T19:04:04.480207+0000","last_peered":"2024-04-23T19:04:04.480207+0000","last_clean":"2024-04-23T19:04:04.480207+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:04:04.480207+0000","last_undegraded":"2024-04-23T19:04:04.480207+0000","last_fullsized":"2024-04-23T19:04:04.480207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:04.479918+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:04.479918+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.479918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:51.783891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.326180+0000","last_change":"2024-04-23T19:04:23.326240+0000","last_active":"2024-04-23T19:04:23.326180+0000","last_peered":"2024-04-23T19:04:23.326180+0000","last_clean":"2024-04-23T19:04:23.326180+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:04:23.326180+0000","last_undegraded":"2024-04-23T19:04:23.326180+0000","last_fullsized":"2024-04-23T19:04:23.326180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:23.325991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:23.325991+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.325991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:43.873211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'36","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.089760+0000","last_change":"2024-04-23T19:04:26.089760+0000","last_active":"2024-04-23T19:04:26.089760+0000","last_peered":"2024-04-23T19:04:26.089760+0000","last_clean":"2024-04-23T19:04:26.089760+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:04:26.089760+0000","last_undegraded":"2024-04-23T19:04:26.089760+0000","last_fullsized":"2024-04-23T19:04:26.089760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:26.089464+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:26.089464+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.089464+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:32.271520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"116'2","reported_seq":293,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.510991+0000","last_change":"2024-04-23T19:04:11.510991+0000","last_active":"2024-04-23T19:04:11.510991+0000","last_peered":"2024-04-23T19:04:11.510991+0000","last_clean":"2024-04-23T19:04:11.510991+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:04:11.510991+0000","last_undegraded":"2024-04-23T19:04:11.510991+0000","last_fullsized":"2024-04-23T19:04:11.510991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:11.510730+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.510730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.510730+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:27.272898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"116'18","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.747883+0000","last_change":"2024-04-23T19:04:25.747883+0000","last_active":"2024-04-23T19:04:25.747883+0000","last_peered":"2024-04-23T19:04:25.747883+0000","last_clean":"2024-04-23T19:04:25.747883+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:04:25.747883+0000","last_undegraded":"2024-04-23T19:04:25.747883+0000","last_fullsized":"2024-04-23T19:04:25.747883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-04-23T19:04:25.747605+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-04-23T19:04:25.747605+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.747605+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:08.878174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.114143+0000","last_change":"2024-04-23T19:04:22.114197+0000","last_active":"2024-04-23T19:04:22.114143+0000","last_peered":"2024-04-23T19:04:22.114143+0000","last_clean":"2024-04-23T19:04:22.114143+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:04:22.114143+0000","last_undegraded":"2024-04-23T19:04:22.114143+0000","last_fullsized":"2024-04-23T19:04:22.114143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:22.113937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:22.113937+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.113937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:52.437348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.354036+0000","last_change":"2024-04-23T19:04:37.354100+0000","last_active":"2024-04-23T19:04:37.354036+0000","last_peered":"2024-04-23T19:04:37.354036+0000","last_clean":"2024-04-23T19:04:37.354036+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:04:37.354036+0000","last_undegraded":"2024-04-23T19:04:37.354036+0000","last_fullsized":"2024-04-23T19:04:37.354036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:37.353833+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:37.353833+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.353833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:24.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.474072+0000","last_change":"2024-04-23T19:04:03.474072+0000","last_active":"2024-04-23T19:04:03.474072+0000","last_peered":"2024-04-23T19:04:03.474072+0000","last_clean":"2024-04-23T19:04:03.474072+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:04:03.474072+0000","last_undegraded":"2024-04-23T19:04:03.474072+0000","last_fullsized":"2024-04-23T19:04:03.474072+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.473795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.473795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.473795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:46.953046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.308751+0000","last_change":"2024-04-23T19:04:26.308751+0000","last_active":"2024-04-23T19:04:26.308751+0000","last_peered":"2024-04-23T19:04:26.308751+0000","last_clean":"2024-04-23T19:04:26.308751+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:04:26.308751+0000","last_undegraded":"2024-04-23T19:04:26.308751+0000","last_fullsized":"2024-04-23T19:04:26.308751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:26.308458+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:26.308458+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.308458+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:33.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.435963+0000","last_change":"2024-04-23T19:04:00.435963+0000","last_active":"2024-04-23T19:04:00.435963+0000","last_peered":"2024-04-23T19:04:00.435963+0000","last_clean":"2024-04-23T19:04:00.435963+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:04:00.435963+0000","last_undegraded":"2024-04-23T19:04:00.435963+0000","last_fullsized":"2024-04-23T19:04:00.435963+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.435859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:34.052330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.491378+0000","last_change":"2024-04-23T19:04:09.491378+0000","last_active":"2024-04-23T19:04:09.491378+0000","last_peered":"2024-04-23T19:04:09.491378+0000","last_clean":"2024-04-23T19:04:09.491378+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:04:09.491378+0000","last_undegraded":"2024-04-23T19:04:09.491378+0000","last_fullsized":"2024-04-23T19:04:09.491378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.491110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.491110+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.491110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:25.822043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'46","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.628738+0000","last_change":"2024-04-23T19:04:15.628738+0000","last_active":"2024-04-23T19:04:15.628738+0000","last_peered":"2024-04-23T19:04:15.628738+0000","last_clean":"2024-04-23T19:04:15.628738+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:04:15.628738+0000","last_undegraded":"2024-04-23T19:04:15.628738+0000","last_fullsized":"2024-04-23T19:04:15.628738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:15.628439+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:15.628439+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.628439+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:22.658481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.119300+0000","last_change":"2024-04-23T19:04:33.119300+0000","last_active":"2024-04-23T19:04:33.119300+0000","last_peered":"2024-04-23T19:04:33.119300+0000","last_clean":"2024-04-23T19:04:33.119300+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:04:33.119300+0000","last_undegraded":"2024-04-23T19:04:33.119300+0000","last_fullsized":"2024-04-23T19:04:33.119300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:33.119025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:33.119025+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.119025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:16.249594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.379144+0000","last_change":"2024-04-23T19:04:01.379184+0000","last_active":"2024-04-23T19:04:01.379144+0000","last_peered":"2024-04-23T19:04:01.379144+0000","last_clean":"2024-04-23T19:04:01.379144+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:04:01.379144+0000","last_undegraded":"2024-04-23T19:04:01.379144+0000","last_fullsized":"2024-04-23T19:04:01.379144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.379039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:04.821220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.485633+0000","last_change":"2024-04-23T19:04:08.485633+0000","last_active":"2024-04-23T19:04:08.485633+0000","last_peered":"2024-04-23T19:04:08.485633+0000","last_clean":"2024-04-23T19:04:08.485633+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:04:08.485633+0000","last_undegraded":"2024-04-23T19:04:08.485633+0000","last_fullsized":"2024-04-23T19:04:08.485633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'8","last_scrub_stamp":"2024-04-23T19:04:08.485266+0000","last_deep_scrub":"57'8","last_deep_scrub_stamp":"2024-04-23T19:04:08.485266+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.485266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.652586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'44","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.415163+0000","last_change":"2024-04-23T19:04:22.415163+0000","last_active":"2024-04-23T19:04:22.415163+0000","last_peered":"2024-04-23T19:04:22.415163+0000","last_clean":"2024-04-23T19:04:22.415163+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:04:22.415163+0000","last_undegraded":"2024-04-23T19:04:22.415163+0000","last_fullsized":"2024-04-23T19:04:22.415163+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:22.414779+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:22.414779+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.414779+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:28.596835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.982679+0000","last_change":"2024-04-23T19:04:22.982818+0000","last_active":"2024-04-23T19:04:22.982679+0000","last_peered":"2024-04-23T19:04:22.982679+0000","last_clean":"2024-04-23T19:04:22.982679+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:04:22.982679+0000","last_undegraded":"2024-04-23T19:04:22.982679+0000","last_fullsized":"2024-04-23T19:04:22.982679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:22.982421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:22.982421+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.982421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:19.523444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.221738+0000","last_change":"2024-04-23T19:04:03.221738+0000","last_active":"2024-04-23T19:04:03.221738+0000","last_peered":"2024-04-23T19:04:03.221738+0000","last_clean":"2024-04-23T19:04:03.221738+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:04:03.221738+0000","last_undegraded":"2024-04-23T19:04:03.221738+0000","last_fullsized":"2024-04-23T19:04:03.221738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.221480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.221480+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.221480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:58.768547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"116'21","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.516993+0000","last_change":"2024-04-23T19:04:10.516993+0000","last_active":"2024-04-23T19:04:10.516993+0000","last_peered":"2024-04-23T19:04:10.516993+0000","last_clean":"2024-04-23T19:04:10.516993+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:04:10.516993+0000","last_undegraded":"2024-04-23T19:04:10.516993+0000","last_fullsized":"2024-04-23T19:04:10.516993+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-04-23T19:04:10.516730+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-04-23T19:04:10.516730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.516730+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:31.263084+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'139","reported_seq":375,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.335312+0000","last_change":"2024-04-23T19:04:31.335427+0000","last_active":"2024-04-23T19:04:31.335312+0000","last_peered":"2024-04-23T19:04:31.335312+0000","last_clean":"2024-04-23T19:04:31.335312+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:04:31.335312+0000","last_undegraded":"2024-04-23T19:04:31.335312+0000","last_fullsized":"2024-04-23T19:04:31.335312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-04-23T19:04:31.335042+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-04-23T19:04:31.335042+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.335042+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:14.465611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:38.806834+0000","last_change":"2024-04-23T19:04:38.806896+0000","last_active":"2024-04-23T19:04:38.806834+0000","last_peered":"2024-04-23T19:04:38.806834+0000","last_clean":"2024-04-23T19:04:38.806834+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:04:38.806834+0000","last_undegraded":"2024-04-23T19:04:38.806834+0000","last_fullsized":"2024-04-23T19:04:38.806834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:38.806605+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:38.806605+0000","last_clean_scrub_stamp":"2024-04-23T19:04:38.806605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:15.414879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.722695+0000","last_change":"2024-04-23T19:04:11.722695+0000","last_active":"2024-04-23T19:04:11.722695+0000","last_peered":"2024-04-23T19:04:11.722695+0000","last_clean":"2024-04-23T19:04:11.722695+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:04:11.722695+0000","last_undegraded":"2024-04-23T19:04:11.722695+0000","last_fullsized":"2024-04-23T19:04:11.722695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:11.722335+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.722335+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.722335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:27.484503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'40","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.851818+0000","last_change":"2024-04-23T19:04:31.851818+0000","last_active":"2024-04-23T19:04:31.851818+0000","last_peered":"2024-04-23T19:04:31.851818+0000","last_clean":"2024-04-23T19:04:31.851818+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:04:31.851818+0000","last_undegraded":"2024-04-23T19:04:31.851818+0000","last_fullsized":"2024-04-23T19:04:31.851818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:31.851555+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:31.851555+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.851555+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:19.327284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.437215+0000","last_change":"2024-04-23T19:04:26.437215+0000","last_active":"2024-04-23T19:04:26.437215+0000","last_peered":"2024-04-23T19:04:26.437215+0000","last_clean":"2024-04-23T19:04:26.437215+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:04:26.437215+0000","last_undegraded":"2024-04-23T19:04:26.437215+0000","last_fullsized":"2024-04-23T19:04:26.437215+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:26.436948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:26.436948+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.436948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:03.316343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.140787+0000","last_change":"2024-04-23T19:04:19.140787+0000","last_active":"2024-04-23T19:04:19.140787+0000","last_peered":"2024-04-23T19:04:19.140787+0000","last_clean":"2024-04-23T19:04:19.140787+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:04:19.140787+0000","last_undegraded":"2024-04-23T19:04:19.140787+0000","last_fullsized":"2024-04-23T19:04:19.140787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.140514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.140514+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.140514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:34.902682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"116'15","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.914749+0000","last_change":"2024-04-23T19:04:05.914749+0000","last_active":"2024-04-23T19:04:05.914749+0000","last_peered":"2024-04-23T19:04:05.914749+0000","last_clean":"2024-04-23T19:04:05.914749+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:04:05.914749+0000","last_undegraded":"2024-04-23T19:04:05.914749+0000","last_fullsized":"2024-04-23T19:04:05.914749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:05.914386+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:05.914386+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.914386+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:41.719119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'138","reported_seq":452,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.816660+0000","last_change":"2024-04-23T19:04:03.816660+0000","last_active":"2024-04-23T19:04:03.816660+0000","last_peered":"2024-04-23T19:04:03.816660+0000","last_clean":"2024-04-23T19:04:03.816660+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:04:03.816660+0000","last_undegraded":"2024-04-23T19:04:03.816660+0000","last_fullsized":"2024-04-23T19:04:03.816660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:03.816386+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:03.816386+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.816386+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:51.838308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":131,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.706810+0000","last_change":"2024-04-23T19:04:32.706863+0000","last_active":"2024-04-23T19:04:32.706810+0000","last_peered":"2024-04-23T19:04:32.706810+0000","last_clean":"2024-04-23T19:04:32.706810+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:04:32.706810+0000","last_undegraded":"2024-04-23T19:04:32.706810+0000","last_fullsized":"2024-04-23T19:04:32.706810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:32.706615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:32.706615+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.706615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:20.182344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.155260+0000","last_change":"2024-04-23T19:04:30.155315+0000","last_active":"2024-04-23T19:04:30.155260+0000","last_peered":"2024-04-23T19:04:30.155260+0000","last_clean":"2024-04-23T19:04:30.155260+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:04:30.155260+0000","last_undegraded":"2024-04-23T19:04:30.155260+0000","last_fullsized":"2024-04-23T19:04:30.155260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:30.155040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:30.155040+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.155040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:07.034436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'44","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.623374+0000","last_change":"2024-04-23T19:04:25.623374+0000","last_active":"2024-04-23T19:04:25.623374+0000","last_peered":"2024-04-23T19:04:25.623374+0000","last_clean":"2024-04-23T19:04:25.623374+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:04:25.623374+0000","last_undegraded":"2024-04-23T19:04:25.623374+0000","last_fullsized":"2024-04-23T19:04:25.623374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:25.623097+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:25.623097+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.623097+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:08.753667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.116257+0000","last_change":"2024-04-23T19:04:11.116257+0000","last_active":"2024-04-23T19:04:11.116257+0000","last_peered":"2024-04-23T19:04:11.116257+0000","last_clean":"2024-04-23T19:04:11.116257+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:04:11.116257+0000","last_undegraded":"2024-04-23T19:04:11.116257+0000","last_fullsized":"2024-04-23T19:04:11.116257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:11.115902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:11.115902+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.115902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:03.194983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.801097+0000","last_change":"2024-04-23T19:04:17.801097+0000","last_active":"2024-04-23T19:04:17.801097+0000","last_peered":"2024-04-23T19:04:17.801097+0000","last_clean":"2024-04-23T19:04:17.801097+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:04:17.801097+0000","last_undegraded":"2024-04-23T19:04:17.801097+0000","last_fullsized":"2024-04-23T19:04:17.801097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.800847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.800847+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.800847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:38.348067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'57","reported_seq":283,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.983092+0000","last_change":"2024-04-23T19:04:18.983092+0000","last_active":"2024-04-23T19:04:18.983092+0000","last_peered":"2024-04-23T19:04:18.983092+0000","last_clean":"2024-04-23T19:04:18.983092+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:04:18.983092+0000","last_undegraded":"2024-04-23T19:04:18.983092+0000","last_fullsized":"2024-04-23T19:04:18.983092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'57","last_scrub_stamp":"2024-04-23T19:04:18.982820+0000","last_deep_scrub":"116'57","last_deep_scrub_stamp":"2024-04-23T19:04:18.982820+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.982820+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.150140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.832735+0000","last_change":"2024-04-23T19:04:00.832735+0000","last_active":"2024-04-23T19:04:00.832735+0000","last_peered":"2024-04-23T19:04:00.832735+0000","last_clean":"2024-04-23T19:04:00.832735+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:04:00.832735+0000","last_undegraded":"2024-04-23T19:04:00.832735+0000","last_fullsized":"2024-04-23T19:04:00.832735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.832522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:03.723382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.353779+0000","last_change":"2024-04-23T19:04:36.353834+0000","last_active":"2024-04-23T19:04:36.353779+0000","last_peered":"2024-04-23T19:04:36.353779+0000","last_clean":"2024-04-23T19:04:36.353779+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:04:36.353779+0000","last_undegraded":"2024-04-23T19:04:36.353779+0000","last_fullsized":"2024-04-23T19:04:36.353779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:36.353581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:36.353581+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.353581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:02.273912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.361389+0000","last_change":"2024-04-23T19:04:00.361389+0000","last_active":"2024-04-23T19:04:00.361389+0000","last_peered":"2024-04-23T19:04:00.361389+0000","last_clean":"2024-04-23T19:04:00.361389+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:04:00.361389+0000","last_undegraded":"2024-04-23T19:04:00.361389+0000","last_fullsized":"2024-04-23T19:04:00.361389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.361115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:00.899277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.946543+0000","last_change":"2024-04-23T19:04:06.946608+0000","last_active":"2024-04-23T19:04:06.946543+0000","last_peered":"2024-04-23T19:04:06.946543+0000","last_clean":"2024-04-23T19:04:06.946543+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:04:06.946543+0000","last_undegraded":"2024-04-23T19:04:06.946543+0000","last_fullsized":"2024-04-23T19:04:06.946543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:06.946339+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.946339+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.946339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:50.425590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.157769+0000","last_change":"2024-04-23T19:04:24.157829+0000","last_active":"2024-04-23T19:04:24.157769+0000","last_peered":"2024-04-23T19:04:24.157769+0000","last_clean":"2024-04-23T19:04:24.157769+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:04:24.157769+0000","last_undegraded":"2024-04-23T19:04:24.157769+0000","last_fullsized":"2024-04-23T19:04:24.157769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:24.157583+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:24.157583+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.157583+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:11.770054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.535624+0000","last_change":"2024-04-23T19:04:07.535679+0000","last_active":"2024-04-23T19:04:07.535624+0000","last_peered":"2024-04-23T19:04:07.535624+0000","last_clean":"2024-04-23T19:04:07.535624+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:04:07.535624+0000","last_undegraded":"2024-04-23T19:04:07.535624+0000","last_fullsized":"2024-04-23T19:04:07.535624+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.535419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.535419+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.535419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:29.334892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'26","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.801748+0000","last_change":"2024-04-23T19:04:06.801829+0000","last_active":"2024-04-23T19:04:06.801748+0000","last_peered":"2024-04-23T19:04:06.801748+0000","last_clean":"2024-04-23T19:04:06.801748+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:04:06.801748+0000","last_undegraded":"2024-04-23T19:04:06.801748+0000","last_fullsized":"2024-04-23T19:04:06.801748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:06.801529+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:06.801529+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.801529+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:27.547883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.817729+0000","last_change":"2024-04-23T19:04:02.817782+0000","last_active":"2024-04-23T19:04:02.817729+0000","last_peered":"2024-04-23T19:04:02.817729+0000","last_clean":"2024-04-23T19:04:02.817729+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:04:02.817729+0000","last_undegraded":"2024-04-23T19:04:02.817729+0000","last_fullsized":"2024-04-23T19:04:02.817729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.817544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.817544+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.817544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:02.070329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.728491+0000","last_change":"2024-04-23T19:04:09.728491+0000","last_active":"2024-04-23T19:04:09.728491+0000","last_peered":"2024-04-23T19:04:09.728491+0000","last_clean":"2024-04-23T19:04:09.728491+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:04:09.728491+0000","last_undegraded":"2024-04-23T19:04:09.728491+0000","last_fullsized":"2024-04-23T19:04:09.728491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.728213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.728213+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.728213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:21.715632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.509986+0000","last_change":"2024-04-23T19:04:08.510050+0000","last_active":"2024-04-23T19:04:08.509986+0000","last_peered":"2024-04-23T19:04:08.509986+0000","last_clean":"2024-04-23T19:04:08.509986+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:04:08.509986+0000","last_undegraded":"2024-04-23T19:04:08.509986+0000","last_fullsized":"2024-04-23T19:04:08.509986+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:08.509782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:08.509782+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.509782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:38.833192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'66","reported_seq":274,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.018648+0000","last_change":"2024-04-23T19:04:27.018707+0000","last_active":"2024-04-23T19:04:27.018648+0000","last_peered":"2024-04-23T19:04:27.018648+0000","last_clean":"2024-04-23T19:04:27.018648+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:04:27.018648+0000","last_undegraded":"2024-04-23T19:04:27.018648+0000","last_fullsized":"2024-04-23T19:04:27.018648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'66","last_scrub_stamp":"2024-04-23T19:04:27.018451+0000","last_deep_scrub":"116'66","last_deep_scrub_stamp":"2024-04-23T19:04:27.018451+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.018451+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:34.048493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.821496+0000","last_change":"2024-04-23T19:04:21.821554+0000","last_active":"2024-04-23T19:04:21.821496+0000","last_peered":"2024-04-23T19:04:21.821496+0000","last_clean":"2024-04-23T19:04:21.821496+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:04:21.821496+0000","last_undegraded":"2024-04-23T19:04:21.821496+0000","last_fullsized":"2024-04-23T19:04:21.821496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.821293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.821293+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.821293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:03.297512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"116'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.554308+0000","last_change":"2024-04-23T19:04:13.554379+0000","last_active":"2024-04-23T19:04:13.554308+0000","last_peered":"2024-04-23T19:04:13.554308+0000","last_clean":"2024-04-23T19:04:13.554308+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:04:13.554308+0000","last_undegraded":"2024-04-23T19:04:13.554308+0000","last_fullsized":"2024-04-23T19:04:13.554308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'13","last_scrub_stamp":"2024-04-23T19:04:13.554081+0000","last_deep_scrub":"116'13","last_deep_scrub_stamp":"2024-04-23T19:04:13.554081+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.554081+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:57.399076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.952994+0000","last_change":"2024-04-23T19:04:02.953047+0000","last_active":"2024-04-23T19:04:02.952994+0000","last_peered":"2024-04-23T19:04:02.952994+0000","last_clean":"2024-04-23T19:04:02.952994+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:04:02.952994+0000","last_undegraded":"2024-04-23T19:04:02.952994+0000","last_fullsized":"2024-04-23T19:04:02.952994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.952795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.952795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.952795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:30.524113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":131,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.751809+0000","last_change":"2024-04-23T19:04:33.751867+0000","last_active":"2024-04-23T19:04:33.751809+0000","last_peered":"2024-04-23T19:04:33.751809+0000","last_clean":"2024-04-23T19:04:33.751809+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:04:33.751809+0000","last_undegraded":"2024-04-23T19:04:33.751809+0000","last_fullsized":"2024-04-23T19:04:33.751809+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:33.751598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:33.751598+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.751598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:36.996632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.737501+0000","last_change":"2024-04-23T19:04:13.737569+0000","last_active":"2024-04-23T19:04:13.737501+0000","last_peered":"2024-04-23T19:04:13.737501+0000","last_clean":"2024-04-23T19:04:13.737501+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:04:13.737501+0000","last_undegraded":"2024-04-23T19:04:13.737501+0000","last_fullsized":"2024-04-23T19:04:13.737501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:13.737281+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:13.737281+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.737281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.217889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'48","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.335181+0000","last_change":"2024-04-23T19:04:21.335249+0000","last_active":"2024-04-23T19:04:21.335181+0000","last_peered":"2024-04-23T19:04:21.335181+0000","last_clean":"2024-04-23T19:04:21.335181+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:04:21.335181+0000","last_undegraded":"2024-04-23T19:04:21.335181+0000","last_fullsized":"2024-04-23T19:04:21.335181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:21.334981+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:21.334981+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.334981+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:28.365024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.950146+0000","last_change":"2024-04-23T19:04:04.950205+0000","last_active":"2024-04-23T19:04:04.950146+0000","last_peered":"2024-04-23T19:04:04.950146+0000","last_clean":"2024-04-23T19:04:04.950146+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:04:04.950146+0000","last_undegraded":"2024-04-23T19:04:04.950146+0000","last_fullsized":"2024-04-23T19:04:04.950146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.949925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.949925+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.949925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:39.148380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'29","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.832997+0000","last_change":"2024-04-23T19:04:04.833084+0000","last_active":"2024-04-23T19:04:04.832997+0000","last_peered":"2024-04-23T19:04:04.832997+0000","last_clean":"2024-04-23T19:04:04.832997+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:04:04.832997+0000","last_undegraded":"2024-04-23T19:04:04.832997+0000","last_fullsized":"2024-04-23T19:04:04.832997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'29","last_scrub_stamp":"2024-04-23T19:04:04.832764+0000","last_deep_scrub":"116'29","last_deep_scrub_stamp":"2024-04-23T19:04:04.832764+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.832764+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:35.156175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.154379+0000","last_change":"2024-04-23T19:04:21.154432+0000","last_active":"2024-04-23T19:04:21.154379+0000","last_peered":"2024-04-23T19:04:21.154379+0000","last_clean":"2024-04-23T19:04:21.154379+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:04:21.154379+0000","last_undegraded":"2024-04-23T19:04:21.154379+0000","last_fullsized":"2024-04-23T19:04:21.154379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.154185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.154185+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.154185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:09.176108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.380053+0000","last_change":"2024-04-23T19:04:32.380112+0000","last_active":"2024-04-23T19:04:32.380053+0000","last_peered":"2024-04-23T19:04:32.380053+0000","last_clean":"2024-04-23T19:04:32.380053+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:04:32.380053+0000","last_undegraded":"2024-04-23T19:04:32.380053+0000","last_fullsized":"2024-04-23T19:04:32.380053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'4","last_scrub_stamp":"2024-04-23T19:04:32.379856+0000","last_deep_scrub":"52'4","last_deep_scrub_stamp":"2024-04-23T19:04:32.379856+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.379856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:23.287703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:41.866853+0000","last_change":"2024-04-23T19:04:41.866913+0000","last_active":"2024-04-23T19:04:41.866853+0000","last_peered":"2024-04-23T19:04:41.866853+0000","last_clean":"2024-04-23T19:04:41.866853+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:04:41.866853+0000","last_undegraded":"2024-04-23T19:04:41.866853+0000","last_fullsized":"2024-04-23T19:04:41.866853+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'4","last_scrub_stamp":"2024-04-23T19:04:41.866639+0000","last_deep_scrub":"52'4","last_deep_scrub_stamp":"2024-04-23T19:04:41.866639+0000","last_clean_scrub_stamp":"2024-04-23T19:04:41.866639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:59.633026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'56","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.637296+0000","last_change":"2024-04-23T19:04:27.637357+0000","last_active":"2024-04-23T19:04:27.637296+0000","last_peered":"2024-04-23T19:04:27.637296+0000","last_clean":"2024-04-23T19:04:27.637296+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:04:27.637296+0000","last_undegraded":"2024-04-23T19:04:27.637296+0000","last_fullsized":"2024-04-23T19:04:27.637296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:27.637096+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:27.637096+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.637096+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:27.088430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.260129+0000","last_change":"2024-04-23T19:04:02.260185+0000","last_active":"2024-04-23T19:04:02.260129+0000","last_peered":"2024-04-23T19:04:02.260129+0000","last_clean":"2024-04-23T19:04:02.260129+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:04:02.260129+0000","last_undegraded":"2024-04-23T19:04:02.260129+0000","last_fullsized":"2024-04-23T19:04:02.260129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.259941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.259941+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.259941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:34:34.827166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'23","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.024612+0000","last_change":"2024-04-23T19:04:15.024704+0000","last_active":"2024-04-23T19:04:15.024612+0000","last_peered":"2024-04-23T19:04:15.024612+0000","last_clean":"2024-04-23T19:04:15.024612+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:04:15.024612+0000","last_undegraded":"2024-04-23T19:04:15.024612+0000","last_fullsized":"2024-04-23T19:04:15.024612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:15.024424+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:15.024424+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.024424+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:47.959153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.504042+0000","last_change":"2024-04-23T19:04:04.504098+0000","last_active":"2024-04-23T19:04:04.504042+0000","last_peered":"2024-04-23T19:04:04.504042+0000","last_clean":"2024-04-23T19:04:04.504042+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:04:04.504042+0000","last_undegraded":"2024-04-23T19:04:04.504042+0000","last_fullsized":"2024-04-23T19:04:04.504042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.503808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.503808+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.503808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:34.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.150384+0000","last_change":"2024-04-23T19:04:10.150384+0000","last_active":"2024-04-23T19:04:10.150384+0000","last_peered":"2024-04-23T19:04:10.150384+0000","last_clean":"2024-04-23T19:04:10.150384+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:04:10.150384+0000","last_undegraded":"2024-04-23T19:04:10.150384+0000","last_fullsized":"2024-04-23T19:04:10.150384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:10.150112+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:10.150112+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.150112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:37.721431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'40","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:56.263597+0000","last_change":"2024-04-23T19:01:39.311078+0000","last_active":"2024-04-23T19:03:56.263597+0000","last_peered":"2024-04-23T19:03:56.263597+0000","last_clean":"2024-04-23T19:03:56.263597+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:03:56.263597+0000","last_undegraded":"2024-04-23T19:03:56.263597+0000","last_fullsized":"2024-04-23T19:03:56.263597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:00:14.219725+0000","last_clean_scrub_stamp":"2024-04-23T19:00:14.219725+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.486506+0000","last_change":"2024-04-23T19:04:07.486506+0000","last_active":"2024-04-23T19:04:07.486506+0000","last_peered":"2024-04-23T19:04:07.486506+0000","last_clean":"2024-04-23T19:04:07.486506+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:04:07.486506+0000","last_undegraded":"2024-04-23T19:04:07.486506+0000","last_fullsized":"2024-04-23T19:04:07.486506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.486252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.486252+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.486252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:04.087179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'41","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.373550+0000","last_change":"2024-04-23T19:04:28.373623+0000","last_active":"2024-04-23T19:04:28.373550+0000","last_peered":"2024-04-23T19:04:28.373550+0000","last_clean":"2024-04-23T19:04:28.373550+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:04:28.373550+0000","last_undegraded":"2024-04-23T19:04:28.373550+0000","last_fullsized":"2024-04-23T19:04:28.373550+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'41","last_scrub_stamp":"2024-04-23T19:04:28.373411+0000","last_deep_scrub":"116'41","last_deep_scrub_stamp":"2024-04-23T19:04:28.373411+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.373411+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:52.850973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.266763+0000","last_change":"2024-04-23T19:04:04.266816+0000","last_active":"2024-04-23T19:04:04.266763+0000","last_peered":"2024-04-23T19:04:04.266763+0000","last_clean":"2024-04-23T19:04:04.266763+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:04:04.266763+0000","last_undegraded":"2024-04-23T19:04:04.266763+0000","last_fullsized":"2024-04-23T19:04:04.266763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.266571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.266571+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.266571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:40.071305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.778824+0000","last_change":"2024-04-23T19:04:37.778883+0000","last_active":"2024-04-23T19:04:37.778824+0000","last_peered":"2024-04-23T19:04:37.778824+0000","last_clean":"2024-04-23T19:04:37.778824+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:04:37.778824+0000","last_undegraded":"2024-04-23T19:04:37.778824+0000","last_fullsized":"2024-04-23T19:04:37.778824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:37.778607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:37.778607+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.778607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:02.222724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.598248+0000","last_change":"2024-04-23T19:04:14.598248+0000","last_active":"2024-04-23T19:04:14.598248+0000","last_peered":"2024-04-23T19:04:14.598248+0000","last_clean":"2024-04-23T19:04:14.598248+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:04:14.598248+0000","last_undegraded":"2024-04-23T19:04:14.598248+0000","last_fullsized":"2024-04-23T19:04:14.598248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-23T19:04:14.597970+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-23T19:04:14.597970+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.597970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:22.375247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'60","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.455836+0000","last_change":"2024-04-23T19:04:14.455903+0000","last_active":"2024-04-23T19:04:14.455836+0000","last_peered":"2024-04-23T19:04:14.455836+0000","last_clean":"2024-04-23T19:04:14.455836+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:04:14.455836+0000","last_undegraded":"2024-04-23T19:04:14.455836+0000","last_fullsized":"2024-04-23T19:04:14.455836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-04-23T19:04:14.455632+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-04-23T19:04:14.455632+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.455632+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:27.517424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.277395+0000","last_change":"2024-04-23T19:04:05.277395+0000","last_active":"2024-04-23T19:04:05.277395+0000","last_peered":"2024-04-23T19:04:05.277395+0000","last_clean":"2024-04-23T19:04:05.277395+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:04:05.277395+0000","last_undegraded":"2024-04-23T19:04:05.277395+0000","last_fullsized":"2024-04-23T19:04:05.277395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.277117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.277117+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.277117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:16.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.009170+0000","last_change":"2024-04-23T19:04:04.009319+0000","last_active":"2024-04-23T19:04:04.009170+0000","last_peered":"2024-04-23T19:04:04.009170+0000","last_clean":"2024-04-23T19:04:04.009170+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:04:04.009170+0000","last_undegraded":"2024-04-23T19:04:04.009170+0000","last_fullsized":"2024-04-23T19:04:04.009170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-04-23T19:04:04.008931+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-04-23T19:04:04.008931+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.008931+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:35.883159+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.420062+0000","last_change":"2024-04-23T19:04:20.420114+0000","last_active":"2024-04-23T19:04:20.420062+0000","last_peered":"2024-04-23T19:04:20.420062+0000","last_clean":"2024-04-23T19:04:20.420062+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:04:20.420062+0000","last_undegraded":"2024-04-23T19:04:20.420062+0000","last_fullsized":"2024-04-23T19:04:20.420062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.419859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.419859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.419859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:49.249375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.095336+0000","last_change":"2024-04-23T19:04:24.095444+0000","last_active":"2024-04-23T19:04:24.095336+0000","last_peered":"2024-04-23T19:04:24.095336+0000","last_clean":"2024-04-23T19:04:24.095336+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:04:24.095336+0000","last_undegraded":"2024-04-23T19:04:24.095336+0000","last_fullsized":"2024-04-23T19:04:24.095336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:24.095079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:24.095079+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.095079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:44.841432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.785503+0000","last_change":"2024-04-23T19:04:16.785628+0000","last_active":"2024-04-23T19:04:16.785503+0000","last_peered":"2024-04-23T19:04:16.785503+0000","last_clean":"2024-04-23T19:04:16.785503+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:04:16.785503+0000","last_undegraded":"2024-04-23T19:04:16.785503+0000","last_fullsized":"2024-04-23T19:04:16.785503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:16.785232+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:16.785232+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.785232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:04.397703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.109201+0000","last_change":"2024-04-23T19:04:23.109267+0000","last_active":"2024-04-23T19:04:23.109201+0000","last_peered":"2024-04-23T19:04:23.109201+0000","last_clean":"2024-04-23T19:04:23.109201+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:04:23.109201+0000","last_undegraded":"2024-04-23T19:04:23.109201+0000","last_fullsized":"2024-04-23T19:04:23.109201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:23.108994+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:23.108994+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.108994+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:30.139036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.160699+0000","last_change":"2024-04-23T19:04:17.160846+0000","last_active":"2024-04-23T19:04:17.160699+0000","last_peered":"2024-04-23T19:04:17.160699+0000","last_clean":"2024-04-23T19:04:17.160699+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:04:17.160699+0000","last_undegraded":"2024-04-23T19:04:17.160699+0000","last_fullsized":"2024-04-23T19:04:17.160699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.160447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.160447+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.160447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:29.147866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'28","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.753432+0000","last_change":"2024-04-23T19:04:07.753432+0000","last_active":"2024-04-23T19:04:07.753432+0000","last_peered":"2024-04-23T19:04:07.753432+0000","last_clean":"2024-04-23T19:04:07.753432+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:04:07.753432+0000","last_undegraded":"2024-04-23T19:04:07.753432+0000","last_fullsized":"2024-04-23T19:04:07.753432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:07.753180+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:07.753180+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.753180+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:04.354107+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":162,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.426361+0000","last_change":"2024-04-23T19:04:01.426361+0000","last_active":"2024-04-23T19:04:01.426361+0000","last_peered":"2024-04-23T19:04:01.426361+0000","last_clean":"2024-04-23T19:04:01.426361+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:04:01.426361+0000","last_undegraded":"2024-04-23T19:04:01.426361+0000","last_fullsized":"2024-04-23T19:04:01.426361+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.426273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:06.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"116'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.379098+0000","last_change":"2024-04-23T19:04:33.379162+0000","last_active":"2024-04-23T19:04:33.379098+0000","last_peered":"2024-04-23T19:04:33.379098+0000","last_clean":"2024-04-23T19:04:33.379098+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:04:33.379098+0000","last_undegraded":"2024-04-23T19:04:33.379098+0000","last_fullsized":"2024-04-23T19:04:33.379098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'12","last_scrub_stamp":"2024-04-23T19:04:33.378851+0000","last_deep_scrub":"116'12","last_deep_scrub_stamp":"2024-04-23T19:04:33.378851+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.378851+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:12.064023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.951782+0000","last_change":"2024-04-23T19:04:09.951849+0000","last_active":"2024-04-23T19:04:09.951782+0000","last_peered":"2024-04-23T19:04:09.951782+0000","last_clean":"2024-04-23T19:04:09.951782+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:04:09.951782+0000","last_undegraded":"2024-04-23T19:04:09.951782+0000","last_fullsized":"2024-04-23T19:04:09.951782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:09.951567+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:09.951567+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.951567+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:21.339434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'40","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.742321+0000","last_change":"2024-04-23T19:04:35.742382+0000","last_active":"2024-04-23T19:04:35.742321+0000","last_peered":"2024-04-23T19:04:35.742321+0000","last_clean":"2024-04-23T19:04:35.742321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:04:35.742321+0000","last_undegraded":"2024-04-23T19:04:35.742321+0000","last_fullsized":"2024-04-23T19:04:35.742321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:35.742116+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:35.742116+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.742116+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:48.863411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.512313+0000","last_change":"2024-04-23T19:04:06.512368+0000","last_active":"2024-04-23T19:04:06.512313+0000","last_peered":"2024-04-23T19:04:06.512313+0000","last_clean":"2024-04-23T19:04:06.512313+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:04:06.512313+0000","last_undegraded":"2024-04-23T19:04:06.512313+0000","last_fullsized":"2024-04-23T19:04:06.512313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:06.512135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:06.512135+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.512135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:05.764920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'15","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.845493+0000","last_change":"2024-04-23T19:04:01.845493+0000","last_active":"2024-04-23T19:04:01.845493+0000","last_peered":"2024-04-23T19:04:01.845493+0000","last_clean":"2024-04-23T19:04:01.845493+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:04:01.845493+0000","last_undegraded":"2024-04-23T19:04:01.845493+0000","last_fullsized":"2024-04-23T19:04:01.845493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.845084+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:36.043539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":402,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.196194+0000","last_change":"2024-04-23T19:04:09.196194+0000","last_active":"2024-04-23T19:04:09.196194+0000","last_peered":"2024-04-23T19:04:09.196194+0000","last_clean":"2024-04-23T19:04:09.196194+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:04:09.196194+0000","last_undegraded":"2024-04-23T19:04:09.196194+0000","last_fullsized":"2024-04-23T19:04:09.196194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:09.195905+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:09.195905+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.195905+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:00:54.108731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.045848+0000","last_change":"2024-04-23T19:04:33.045902+0000","last_active":"2024-04-23T19:04:33.045848+0000","last_peered":"2024-04-23T19:04:33.045848+0000","last_clean":"2024-04-23T19:04:33.045848+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:04:33.045848+0000","last_undegraded":"2024-04-23T19:04:33.045848+0000","last_fullsized":"2024-04-23T19:04:33.045848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:33.045618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:33.045618+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.045618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:14.521837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.187110+0000","last_change":"2024-04-23T19:04:18.187164+0000","last_active":"2024-04-23T19:04:18.187110+0000","last_peered":"2024-04-23T19:04:18.187110+0000","last_clean":"2024-04-23T19:04:18.187110+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:04:18.187110+0000","last_undegraded":"2024-04-23T19:04:18.187110+0000","last_fullsized":"2024-04-23T19:04:18.187110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.186906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.186906+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.186906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:31.248698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'42","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.364925+0000","last_change":"2024-04-23T19:04:19.364986+0000","last_active":"2024-04-23T19:04:19.364925+0000","last_peered":"2024-04-23T19:04:19.364925+0000","last_clean":"2024-04-23T19:04:19.364925+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:04:19.364925+0000","last_undegraded":"2024-04-23T19:04:19.364925+0000","last_fullsized":"2024-04-23T19:04:19.364925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:19.364730+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:19.364730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.364730+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:34:03.209726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.033520+0000","last_change":"2024-04-23T19:04:09.033574+0000","last_active":"2024-04-23T19:04:09.033520+0000","last_peered":"2024-04-23T19:04:09.033520+0000","last_clean":"2024-04-23T19:04:09.033520+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:04:09.033520+0000","last_undegraded":"2024-04-23T19:04:09.033520+0000","last_fullsized":"2024-04-23T19:04:09.033520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.033307+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:57.556321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'32","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.307389+0000","last_change":"2024-04-23T19:04:05.307497+0000","last_active":"2024-04-23T19:04:05.307389+0000","last_peered":"2024-04-23T19:04:05.307389+0000","last_clean":"2024-04-23T19:04:05.307389+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:04:05.307389+0000","last_undegraded":"2024-04-23T19:04:05.307389+0000","last_fullsized":"2024-04-23T19:04:05.307389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:05.307144+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:05.307144+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.307144+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:54.457438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.582678+0000","last_change":"2024-04-23T19:04:21.582732+0000","last_active":"2024-04-23T19:04:21.582678+0000","last_peered":"2024-04-23T19:04:21.582678+0000","last_clean":"2024-04-23T19:04:21.582678+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:04:21.582678+0000","last_undegraded":"2024-04-23T19:04:21.582678+0000","last_fullsized":"2024-04-23T19:04:21.582678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.582488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.582488+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.582488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:10:46.474465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.023421+0000","last_change":"2024-04-23T19:04:34.023480+0000","last_active":"2024-04-23T19:04:34.023421+0000","last_peered":"2024-04-23T19:04:34.023421+0000","last_clean":"2024-04-23T19:04:34.023421+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:04:34.023421+0000","last_undegraded":"2024-04-23T19:04:34.023421+0000","last_fullsized":"2024-04-23T19:04:34.023421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:34.023216+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:34.023216+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.023216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:10.902611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.144746+0000","last_change":"2024-04-23T19:04:16.144806+0000","last_active":"2024-04-23T19:04:16.144746+0000","last_peered":"2024-04-23T19:04:16.144746+0000","last_clean":"2024-04-23T19:04:16.144746+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:04:16.144746+0000","last_undegraded":"2024-04-23T19:04:16.144746+0000","last_fullsized":"2024-04-23T19:04:16.144746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-23T19:04:16.144522+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-23T19:04:16.144522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.144522+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:08.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.080984+0000","last_change":"2024-04-23T19:04:19.081131+0000","last_active":"2024-04-23T19:04:19.080984+0000","last_peered":"2024-04-23T19:04:19.080984+0000","last_clean":"2024-04-23T19:04:19.080984+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:04:19.080984+0000","last_undegraded":"2024-04-23T19:04:19.080984+0000","last_fullsized":"2024-04-23T19:04:19.080984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:19.080702+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:19.080702+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.080702+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:43.244336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.348448+0000","last_change":"2024-04-23T19:04:20.348505+0000","last_active":"2024-04-23T19:04:20.348448+0000","last_peered":"2024-04-23T19:04:20.348448+0000","last_clean":"2024-04-23T19:04:20.348448+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:04:20.348448+0000","last_undegraded":"2024-04-23T19:04:20.348448+0000","last_fullsized":"2024-04-23T19:04:20.348448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.348220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.348220+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.348220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:28.125498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'24","reported_seq":155,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:38.695118+0000","last_change":"2024-04-23T19:04:38.695193+0000","last_active":"2024-04-23T19:04:38.695118+0000","last_peered":"2024-04-23T19:04:38.695118+0000","last_clean":"2024-04-23T19:04:38.695118+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:04:38.695118+0000","last_undegraded":"2024-04-23T19:04:38.695118+0000","last_fullsized":"2024-04-23T19:04:38.695118+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-04-23T19:04:38.694895+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-04-23T19:04:38.694895+0000","last_clean_scrub_stamp":"2024-04-23T19:04:38.694895+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:25.009105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.143021+0000","last_change":"2024-04-23T19:04:20.143077+0000","last_active":"2024-04-23T19:04:20.143021+0000","last_peered":"2024-04-23T19:04:20.143021+0000","last_clean":"2024-04-23T19:04:20.143021+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:04:20.143021+0000","last_undegraded":"2024-04-23T19:04:20.143021+0000","last_fullsized":"2024-04-23T19:04:20.143021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.142757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.142757+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.142757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:42.252737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.823428+0000","last_change":"2024-04-23T19:04:36.823491+0000","last_active":"2024-04-23T19:04:36.823428+0000","last_peered":"2024-04-23T19:04:36.823428+0000","last_clean":"2024-04-23T19:04:36.823428+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:04:36.823428+0000","last_undegraded":"2024-04-23T19:04:36.823428+0000","last_fullsized":"2024-04-23T19:04:36.823428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:36.823230+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:36.823230+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.823230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:32.948185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.760403+0000","last_change":"2024-04-23T19:04:18.760497+0000","last_active":"2024-04-23T19:04:18.760403+0000","last_peered":"2024-04-23T19:04:18.760403+0000","last_clean":"2024-04-23T19:04:18.760403+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:04:18.760403+0000","last_undegraded":"2024-04-23T19:04:18.760403+0000","last_fullsized":"2024-04-23T19:04:18.760403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-23T19:04:18.760211+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-23T19:04:18.760211+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.760211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:24.942267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.856752+0000","last_change":"2024-04-23T19:04:30.856816+0000","last_active":"2024-04-23T19:04:30.856752+0000","last_peered":"2024-04-23T19:04:30.856752+0000","last_clean":"2024-04-23T19:04:30.856752+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:04:30.856752+0000","last_undegraded":"2024-04-23T19:04:30.856752+0000","last_fullsized":"2024-04-23T19:04:30.856752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:30.856559+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:30.856559+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.856559+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:56.776890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.167372+0000","last_change":"2024-04-23T19:04:31.167492+0000","last_active":"2024-04-23T19:04:31.167372+0000","last_peered":"2024-04-23T19:04:31.167372+0000","last_clean":"2024-04-23T19:04:31.167372+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:04:31.167372+0000","last_undegraded":"2024-04-23T19:04:31.167372+0000","last_fullsized":"2024-04-23T19:04:31.167372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:31.167154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:31.167154+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.167154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:55.838722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'20","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.833743+0000","last_change":"2024-04-23T19:04:35.833807+0000","last_active":"2024-04-23T19:04:35.833743+0000","last_peered":"2024-04-23T19:04:35.833743+0000","last_clean":"2024-04-23T19:04:35.833743+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:04:35.833743+0000","last_undegraded":"2024-04-23T19:04:35.833743+0000","last_fullsized":"2024-04-23T19:04:35.833743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-04-23T19:04:35.833559+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-04-23T19:04:35.833559+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.833559+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:28:00.180355+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.128152+0000","last_change":"2024-04-23T19:04:32.128207+0000","last_active":"2024-04-23T19:04:32.128152+0000","last_peered":"2024-04-23T19:04:32.128152+0000","last_clean":"2024-04-23T19:04:32.128152+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:04:32.128152+0000","last_undegraded":"2024-04-23T19:04:32.128152+0000","last_fullsized":"2024-04-23T19:04:32.128152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:32.127955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:32.127955+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.127955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:00.447137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.981908+0000","last_change":"2024-04-23T19:04:34.981962+0000","last_active":"2024-04-23T19:04:34.981908+0000","last_peered":"2024-04-23T19:04:34.981908+0000","last_clean":"2024-04-23T19:04:34.981908+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:04:34.981908+0000","last_undegraded":"2024-04-23T19:04:34.981908+0000","last_fullsized":"2024-04-23T19:04:34.981908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:34.981709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:34.981709+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.981709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:59.653277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.092992+0000","last_change":"2024-04-23T19:04:13.093062+0000","last_active":"2024-04-23T19:04:13.092992+0000","last_peered":"2024-04-23T19:04:13.092992+0000","last_clean":"2024-04-23T19:04:13.092992+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:04:13.092992+0000","last_undegraded":"2024-04-23T19:04:13.092992+0000","last_fullsized":"2024-04-23T19:04:13.092992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:13.092795+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:13.092795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.092795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:58.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'50","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.709926+0000","last_change":"2024-04-23T19:04:37.709987+0000","last_active":"2024-04-23T19:04:37.709926+0000","last_peered":"2024-04-23T19:04:37.709926+0000","last_clean":"2024-04-23T19:04:37.709926+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:04:37.709926+0000","last_undegraded":"2024-04-23T19:04:37.709926+0000","last_fullsized":"2024-04-23T19:04:37.709926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-04-23T19:04:37.709712+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-04-23T19:04:37.709712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.709712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:33.834667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":171,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.418968+0000","last_change":"2024-04-23T19:04:12.419040+0000","last_active":"2024-04-23T19:04:12.418968+0000","last_peered":"2024-04-23T19:04:12.418968+0000","last_clean":"2024-04-23T19:04:12.418968+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:04:12.418968+0000","last_undegraded":"2024-04-23T19:04:12.418968+0000","last_fullsized":"2024-04-23T19:04:12.418968+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:12.418765+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:12.418765+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.418765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:04.586084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'24","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.916796+0000","last_change":"2024-04-23T19:04:04.916870+0000","last_active":"2024-04-23T19:04:04.916796+0000","last_peered":"2024-04-23T19:04:04.916796+0000","last_clean":"2024-04-23T19:04:04.916796+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:04:04.916796+0000","last_undegraded":"2024-04-23T19:04:04.916796+0000","last_fullsized":"2024-04-23T19:04:04.916796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-04-23T19:04:04.916613+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-04-23T19:04:04.916613+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.916613+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:10.168421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.425047+0000","last_change":"2024-04-23T19:04:02.425096+0000","last_active":"2024-04-23T19:04:02.425047+0000","last_peered":"2024-04-23T19:04:02.425047+0000","last_clean":"2024-04-23T19:04:02.425047+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:04:02.425047+0000","last_undegraded":"2024-04-23T19:04:02.425047+0000","last_fullsized":"2024-04-23T19:04:02.425047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.424719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.424719+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.424719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:01.677504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.074105+0000","last_change":"2024-04-23T19:04:37.074161+0000","last_active":"2024-04-23T19:04:37.074105+0000","last_peered":"2024-04-23T19:04:37.074105+0000","last_clean":"2024-04-23T19:04:37.074105+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:04:37.074105+0000","last_undegraded":"2024-04-23T19:04:37.074105+0000","last_fullsized":"2024-04-23T19:04:37.074105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:37.073905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:37.073905+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.073905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:03.841310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.416833+0000","last_change":"2024-04-23T19:04:27.416833+0000","last_active":"2024-04-23T19:04:27.416833+0000","last_peered":"2024-04-23T19:04:27.416833+0000","last_clean":"2024-04-23T19:04:27.416833+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:04:27.416833+0000","last_undegraded":"2024-04-23T19:04:27.416833+0000","last_fullsized":"2024-04-23T19:04:27.416833+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:27.416453+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:27.416453+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.416453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:59.194612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'58","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.171448+0000","last_change":"2024-04-23T19:04:26.171448+0000","last_active":"2024-04-23T19:04:26.171448+0000","last_peered":"2024-04-23T19:04:26.171448+0000","last_clean":"2024-04-23T19:04:26.171448+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:04:26.171448+0000","last_undegraded":"2024-04-23T19:04:26.171448+0000","last_fullsized":"2024-04-23T19:04:26.171448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:26.171073+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:26.171073+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.171073+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.338392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.413349+0000","last_change":"2024-04-23T19:04:25.413349+0000","last_active":"2024-04-23T19:04:25.413349+0000","last_peered":"2024-04-23T19:04:25.413349+0000","last_clean":"2024-04-23T19:04:25.413349+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:04:25.413349+0000","last_undegraded":"2024-04-23T19:04:25.413349+0000","last_fullsized":"2024-04-23T19:04:25.413349+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:25.413068+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:25.413068+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.413068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:10:50.305044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.936359+0000","last_change":"2024-04-23T19:04:05.936359+0000","last_active":"2024-04-23T19:04:05.936359+0000","last_peered":"2024-04-23T19:04:05.936359+0000","last_clean":"2024-04-23T19:04:05.936359+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:04:05.936359+0000","last_undegraded":"2024-04-23T19:04:05.936359+0000","last_fullsized":"2024-04-23T19:04:05.936359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:05.936104+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:05.936104+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.936104+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:09:25.295580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.348911+0000","last_change":"2024-04-23T19:04:07.348911+0000","last_active":"2024-04-23T19:04:07.348911+0000","last_peered":"2024-04-23T19:04:07.348911+0000","last_clean":"2024-04-23T19:04:07.348911+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:04:07.348911+0000","last_undegraded":"2024-04-23T19:04:07.348911+0000","last_fullsized":"2024-04-23T19:04:07.348911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:07.348615+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:07.348615+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.348615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:56.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'34","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.338926+0000","last_change":"2024-04-23T19:04:29.338987+0000","last_active":"2024-04-23T19:04:29.338926+0000","last_peered":"2024-04-23T19:04:29.338926+0000","last_clean":"2024-04-23T19:04:29.338926+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:04:29.338926+0000","last_undegraded":"2024-04-23T19:04:29.338926+0000","last_fullsized":"2024-04-23T19:04:29.338926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-04-23T19:04:29.338719+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-04-23T19:04:29.338719+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.338719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:54.010287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.414331+0000","last_change":"2024-04-23T19:04:16.414331+0000","last_active":"2024-04-23T19:04:16.414331+0000","last_peered":"2024-04-23T19:04:16.414331+0000","last_clean":"2024-04-23T19:04:16.414331+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:04:16.414331+0000","last_undegraded":"2024-04-23T19:04:16.414331+0000","last_fullsized":"2024-04-23T19:04:16.414331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'12","last_scrub_stamp":"2024-04-23T19:04:16.413901+0000","last_deep_scrub":"98'12","last_deep_scrub_stamp":"2024-04-23T19:04:16.413901+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.413901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.356368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'42","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.706593+0000","last_change":"2024-04-23T19:04:36.706657+0000","last_active":"2024-04-23T19:04:36.706593+0000","last_peered":"2024-04-23T19:04:36.706593+0000","last_clean":"2024-04-23T19:04:36.706593+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:04:36.706593+0000","last_undegraded":"2024-04-23T19:04:36.706593+0000","last_fullsized":"2024-04-23T19:04:36.706593+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:36.706392+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:36.706392+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.706392+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:44.109818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.791685+0000","last_change":"2024-04-23T19:04:22.791685+0000","last_active":"2024-04-23T19:04:22.791685+0000","last_peered":"2024-04-23T19:04:22.791685+0000","last_clean":"2024-04-23T19:04:22.791685+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:04:22.791685+0000","last_undegraded":"2024-04-23T19:04:22.791685+0000","last_fullsized":"2024-04-23T19:04:22.791685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-23T19:04:22.791401+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-23T19:04:22.791401+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.791401+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:59.670797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'46","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.766463+0000","last_change":"2024-04-23T19:04:24.766463+0000","last_active":"2024-04-23T19:04:24.766463+0000","last_peered":"2024-04-23T19:04:24.766463+0000","last_clean":"2024-04-23T19:04:24.766463+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:04:24.766463+0000","last_undegraded":"2024-04-23T19:04:24.766463+0000","last_fullsized":"2024-04-23T19:04:24.766463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:24.766174+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:24.766174+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.766174+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:53.085356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.975592+0000","last_change":"2024-04-23T19:04:08.975592+0000","last_active":"2024-04-23T19:04:08.975592+0000","last_peered":"2024-04-23T19:04:08.975592+0000","last_clean":"2024-04-23T19:04:08.975592+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:04:08.975592+0000","last_undegraded":"2024-04-23T19:04:08.975592+0000","last_fullsized":"2024-04-23T19:04:08.975592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:08.975323+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:08.975323+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.975323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:58.099593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'68","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.334087+0000","last_change":"2024-04-23T19:04:29.334087+0000","last_active":"2024-04-23T19:04:29.334087+0000","last_peered":"2024-04-23T19:04:29.334087+0000","last_clean":"2024-04-23T19:04:29.334087+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:04:29.334087+0000","last_undegraded":"2024-04-23T19:04:29.334087+0000","last_fullsized":"2024-04-23T19:04:29.334087+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'68","last_scrub_stamp":"2024-04-23T19:04:29.333653+0000","last_deep_scrub":"116'68","last_deep_scrub_stamp":"2024-04-23T19:04:29.333653+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.333653+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:12.464223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.723412+0000","last_change":"2024-04-23T19:04:14.723412+0000","last_active":"2024-04-23T19:04:14.723412+0000","last_peered":"2024-04-23T19:04:14.723412+0000","last_clean":"2024-04-23T19:04:14.723412+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:04:14.723412+0000","last_undegraded":"2024-04-23T19:04:14.723412+0000","last_fullsized":"2024-04-23T19:04:14.723412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:14.723146+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:14.723146+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.723146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:02.010322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'52","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.085353+0000","last_change":"2024-04-23T19:04:15.085353+0000","last_active":"2024-04-23T19:04:15.085353+0000","last_peered":"2024-04-23T19:04:15.085353+0000","last_clean":"2024-04-23T19:04:15.085353+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:04:15.085353+0000","last_undegraded":"2024-04-23T19:04:15.085353+0000","last_fullsized":"2024-04-23T19:04:15.085353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:15.085072+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:15.085072+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.085072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:20.336880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.199400+0000","last_change":"2024-04-23T19:04:18.199400+0000","last_active":"2024-04-23T19:04:18.199400+0000","last_peered":"2024-04-23T19:04:18.199400+0000","last_clean":"2024-04-23T19:04:18.199400+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:04:18.199400+0000","last_undegraded":"2024-04-23T19:04:18.199400+0000","last_fullsized":"2024-04-23T19:04:18.199400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:18.199141+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:18.199141+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.199141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:22:05.503114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.789867+0000","last_change":"2024-04-23T19:04:26.789867+0000","last_active":"2024-04-23T19:04:26.789867+0000","last_peered":"2024-04-23T19:04:26.789867+0000","last_clean":"2024-04-23T19:04:26.789867+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:04:26.789867+0000","last_undegraded":"2024-04-23T19:04:26.789867+0000","last_fullsized":"2024-04-23T19:04:26.789867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:26.789515+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:26.789515+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.789515+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:17.697362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.520943+0000","last_change":"2024-04-23T19:04:12.521002+0000","last_active":"2024-04-23T19:04:12.520943+0000","last_peered":"2024-04-23T19:04:12.520943+0000","last_clean":"2024-04-23T19:04:12.520943+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:04:12.520943+0000","last_undegraded":"2024-04-23T19:04:12.520943+0000","last_fullsized":"2024-04-23T19:04:12.520943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:12.520732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:12.520732+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.520732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:49.463199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'56","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.351192+0000","last_change":"2024-04-23T19:04:25.351192+0000","last_active":"2024-04-23T19:04:25.351192+0000","last_peered":"2024-04-23T19:04:25.351192+0000","last_clean":"2024-04-23T19:04:25.351192+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:04:25.351192+0000","last_undegraded":"2024-04-23T19:04:25.351192+0000","last_fullsized":"2024-04-23T19:04:25.351192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:25.350900+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:25.350900+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.350900+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:35.569014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12,"num_write":96,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":242,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.093666+0000","last_change":"2024-04-23T19:04:28.093724+0000","last_active":"2024-04-23T19:04:28.093666+0000","last_peered":"2024-04-23T19:04:28.093666+0000","last_clean":"2024-04-23T19:04:28.093666+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:04:28.093666+0000","last_undegraded":"2024-04-23T19:04:28.093666+0000","last_fullsized":"2024-04-23T19:04:28.093666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'12","last_scrub_stamp":"2024-04-23T19:04:28.093465+0000","last_deep_scrub":"89'12","last_deep_scrub_stamp":"2024-04-23T19:04:28.093465+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.093465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:35.306478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'58","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.874234+0000","last_change":"2024-04-23T19:04:32.874297+0000","last_active":"2024-04-23T19:04:32.874234+0000","last_peered":"2024-04-23T19:04:32.874234+0000","last_clean":"2024-04-23T19:04:32.874234+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:04:32.874234+0000","last_undegraded":"2024-04-23T19:04:32.874234+0000","last_fullsized":"2024-04-23T19:04:32.874234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:32.874024+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:32.874024+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.874024+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:36.119058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.958009+0000","last_change":"2024-04-23T19:04:10.958072+0000","last_active":"2024-04-23T19:04:10.958009+0000","last_peered":"2024-04-23T19:04:10.958009+0000","last_clean":"2024-04-23T19:04:10.958009+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:04:10.958009+0000","last_undegraded":"2024-04-23T19:04:10.958009+0000","last_fullsized":"2024-04-23T19:04:10.958009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-23T19:04:10.957802+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-23T19:04:10.957802+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.957802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:32.529640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'62","reported_seq":272,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.348098+0000","last_change":"2024-04-23T19:04:15.348157+0000","last_active":"2024-04-23T19:04:15.348098+0000","last_peered":"2024-04-23T19:04:15.348098+0000","last_clean":"2024-04-23T19:04:15.348098+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:04:15.348098+0000","last_undegraded":"2024-04-23T19:04:15.348098+0000","last_fullsized":"2024-04-23T19:04:15.348098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:15.347904+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:15.347904+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.347904+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:31.678837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.017909+0000","last_change":"2024-04-23T19:04:11.018039+0000","last_active":"2024-04-23T19:04:11.017909+0000","last_peered":"2024-04-23T19:04:11.017909+0000","last_clean":"2024-04-23T19:04:11.017909+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:04:11.017909+0000","last_undegraded":"2024-04-23T19:04:11.017909+0000","last_fullsized":"2024-04-23T19:04:11.017909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:11.017650+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.017650+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.017650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:32.817124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'42","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.686911+0000","last_change":"2024-04-23T19:04:28.686978+0000","last_active":"2024-04-23T19:04:28.686911+0000","last_peered":"2024-04-23T19:04:28.686911+0000","last_clean":"2024-04-23T19:04:28.686911+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:04:28.686911+0000","last_undegraded":"2024-04-23T19:04:28.686911+0000","last_fullsized":"2024-04-23T19:04:28.686911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:28.686712+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:28.686712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.686712+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:26.624601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.989609+0000","last_change":"2024-04-23T19:04:35.989674+0000","last_active":"2024-04-23T19:04:35.989609+0000","last_peered":"2024-04-23T19:04:35.989609+0000","last_clean":"2024-04-23T19:04:35.989609+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:04:35.989609+0000","last_undegraded":"2024-04-23T19:04:35.989609+0000","last_fullsized":"2024-04-23T19:04:35.989609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:35.989398+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:35.989398+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.989398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:04.308580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'44","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.087637+0000","last_change":"2024-04-23T19:04:14.087778+0000","last_active":"2024-04-23T19:04:14.087637+0000","last_peered":"2024-04-23T19:04:14.087637+0000","last_clean":"2024-04-23T19:04:14.087637+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:04:14.087637+0000","last_undegraded":"2024-04-23T19:04:14.087637+0000","last_fullsized":"2024-04-23T19:04:14.087637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:14.087323+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:14.087323+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.087323+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:47.703794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.593055+0000","last_change":"2024-04-23T19:04:18.593111+0000","last_active":"2024-04-23T19:04:18.593055+0000","last_peered":"2024-04-23T19:04:18.593055+0000","last_clean":"2024-04-23T19:04:18.593055+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:04:18.593055+0000","last_undegraded":"2024-04-23T19:04:18.593055+0000","last_fullsized":"2024-04-23T19:04:18.593055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.592844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.592844+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.592844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:24.774900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'44","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.994046+0000","last_change":"2024-04-23T19:04:19.994110+0000","last_active":"2024-04-23T19:04:19.994046+0000","last_peered":"2024-04-23T19:04:19.994046+0000","last_clean":"2024-04-23T19:04:19.994046+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:04:19.994046+0000","last_undegraded":"2024-04-23T19:04:19.994046+0000","last_fullsized":"2024-04-23T19:04:19.994046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:19.993852+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:19.993852+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.993852+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:54.257079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.754037+0000","last_change":"2024-04-23T19:04:12.754099+0000","last_active":"2024-04-23T19:04:12.754037+0000","last_peered":"2024-04-23T19:04:12.754037+0000","last_clean":"2024-04-23T19:04:12.754037+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:04:12.754037+0000","last_undegraded":"2024-04-23T19:04:12.754037+0000","last_fullsized":"2024-04-23T19:04:12.754037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'10","last_scrub_stamp":"2024-04-23T19:04:12.753839+0000","last_deep_scrub":"98'10","last_deep_scrub_stamp":"2024-04-23T19:04:12.753839+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.753839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:31.406847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'36","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.980720+0000","last_change":"2024-04-23T19:04:06.980779+0000","last_active":"2024-04-23T19:04:06.980720+0000","last_peered":"2024-04-23T19:04:06.980720+0000","last_clean":"2024-04-23T19:04:06.980720+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:04:06.980720+0000","last_undegraded":"2024-04-23T19:04:06.980720+0000","last_fullsized":"2024-04-23T19:04:06.980720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:06.980512+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:06.980512+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.980512+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:37.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.967890+0000","last_change":"2024-04-23T19:04:05.967890+0000","last_active":"2024-04-23T19:04:05.967890+0000","last_peered":"2024-04-23T19:04:05.967890+0000","last_clean":"2024-04-23T19:04:05.967890+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:04:05.967890+0000","last_undegraded":"2024-04-23T19:04:05.967890+0000","last_fullsized":"2024-04-23T19:04:05.967890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:05.967627+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:05.967627+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.967627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:11:16.102311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'56","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.117953+0000","last_change":"2024-04-23T19:04:18.118087+0000","last_active":"2024-04-23T19:04:18.117953+0000","last_peered":"2024-04-23T19:04:18.117953+0000","last_clean":"2024-04-23T19:04:18.117953+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:04:18.117953+0000","last_undegraded":"2024-04-23T19:04:18.117953+0000","last_fullsized":"2024-04-23T19:04:18.117953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:18.117705+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:18.117705+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.117705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:11:28.252389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"116'44","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.368699+0000","last_change":"2024-04-23T19:04:24.368761+0000","last_active":"2024-04-23T19:04:24.368699+0000","last_peered":"2024-04-23T19:04:24.368699+0000","last_clean":"2024-04-23T19:04:24.368699+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:04:24.368699+0000","last_undegraded":"2024-04-23T19:04:24.368699+0000","last_fullsized":"2024-04-23T19:04:24.368699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:24.368496+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:24.368496+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.368496+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:30.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.467416+0000","last_change":"2024-04-23T19:04:10.467478+0000","last_active":"2024-04-23T19:04:10.467416+0000","last_peered":"2024-04-23T19:04:10.467416+0000","last_clean":"2024-04-23T19:04:10.467416+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:04:10.467416+0000","last_undegraded":"2024-04-23T19:04:10.467416+0000","last_fullsized":"2024-04-23T19:04:10.467416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:10.467210+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:10.467210+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.467210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:23.529002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'56","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.375827+0000","last_change":"2024-04-23T19:04:24.375890+0000","last_active":"2024-04-23T19:04:24.375827+0000","last_peered":"2024-04-23T19:04:24.375827+0000","last_clean":"2024-04-23T19:04:24.375827+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:04:24.375827+0000","last_undegraded":"2024-04-23T19:04:24.375827+0000","last_fullsized":"2024-04-23T19:04:24.375827+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:24.375634+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:24.375634+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.375634+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:31.588647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.338075+0000","last_change":"2024-04-23T19:04:08.338197+0000","last_active":"2024-04-23T19:04:08.338075+0000","last_peered":"2024-04-23T19:04:08.338075+0000","last_clean":"2024-04-23T19:04:08.338075+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:04:08.338075+0000","last_undegraded":"2024-04-23T19:04:08.338075+0000","last_fullsized":"2024-04-23T19:04:08.338075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-23T19:04:08.337843+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-23T19:04:08.337843+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.337843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:07.590628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1070,"num_read_kb":1553,"num_write":547,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37328,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334512,"statfs":{"total":96636764160,"available":96598540288,"internally_reserved":0,"allocated":2039808,"data_stored":1406946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36720,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":1417216,"data_stored":815907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1462272,"data_stored":815753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1433600,"data_stored":815702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":1437696,"data_stored":815992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37304,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334536,"statfs":{"total":96636764160,"available":96598564864,"internally_reserved":0,"allocated":2015232,"data_stored":1405784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:04:43.767 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T19:00:14.219725+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=0, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=19, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T19:04:43.768 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T19:05:03.769 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T19:05:04.123 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-23T19:05:04.130 INFO:teuthology.orchestra.run.smithi169.stderr:dumped all 2024-04-23T19:05:04.146 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-23T19:05:04.042508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627974,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5019,"num_read_kb":3922,"num_write":4431,"num_write_kb":6187922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":81789258,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5699,"ondisk_log_size":5699,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295000,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754679720,"statfs":{"total":773094113280,"available":772792033280,"internally_reserved":0,"allocated":12607488,"data_stored":7704972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006740"},"pg_stats":[{"pgid":"3.3f","version":"116'56","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.008233+0000","last_change":"2024-04-23T19:04:18.008233+0000","last_active":"2024-04-23T19:04:18.008233+0000","last_peered":"2024-04-23T19:04:18.008233+0000","last_clean":"2024-04-23T19:04:18.008233+0000","last_became_active":"2024-04-23T19:00:15.280453+0000","last_became_peered":"2024-04-23T19:00:15.280453+0000","last_unstale":"2024-04-23T19:04:18.008233+0000","last_undegraded":"2024-04-23T19:04:18.008233+0000","last_fullsized":"2024-04-23T19:04:18.008233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:18.007961+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:18.007961+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.007961+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:14.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"53'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.393969+0000","last_change":"2024-04-23T19:04:13.394029+0000","last_active":"2024-04-23T19:04:13.393969+0000","last_peered":"2024-04-23T19:04:13.393969+0000","last_clean":"2024-04-23T19:04:13.393969+0000","last_became_active":"2024-04-23T19:00:17.292666+0000","last_became_peered":"2024-04-23T19:00:17.292666+0000","last_unstale":"2024-04-23T19:04:13.393969+0000","last_undegraded":"2024-04-23T19:04:13.393969+0000","last_fullsized":"2024-04-23T19:04:13.393969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:13.393767+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:13.393767+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.393767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:09.994694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'48","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.544313+0000","last_change":"2024-04-23T19:04:09.544313+0000","last_active":"2024-04-23T19:04:09.544313+0000","last_peered":"2024-04-23T19:04:09.544313+0000","last_clean":"2024-04-23T19:04:09.544313+0000","last_became_active":"2024-04-23T19:03:32.290599+0000","last_became_peered":"2024-04-23T19:03:32.290599+0000","last_unstale":"2024-04-23T19:04:09.544313+0000","last_undegraded":"2024-04-23T19:04:09.544313+0000","last_fullsized":"2024-04-23T19:04:09.544313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:09.544061+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:09.544061+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.544061+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:55.178917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.018460+0000","last_change":"2024-04-23T19:04:10.018488+0000","last_active":"2024-04-23T19:04:10.018460+0000","last_peered":"2024-04-23T19:04:10.018460+0000","last_clean":"2024-04-23T19:04:10.018460+0000","last_became_active":"2024-04-23T19:00:17.297218+0000","last_became_peered":"2024-04-23T19:00:17.297218+0000","last_unstale":"2024-04-23T19:04:10.018460+0000","last_undegraded":"2024-04-23T19:04:10.018460+0000","last_fullsized":"2024-04-23T19:04:10.018460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:10.018359+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:10.018359+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.018359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:59.168653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.619501+0000","last_change":"2024-04-23T19:04:23.619501+0000","last_active":"2024-04-23T19:04:23.619501+0000","last_peered":"2024-04-23T19:04:23.619501+0000","last_clean":"2024-04-23T19:04:23.619501+0000","last_became_active":"2024-04-23T19:00:15.256091+0000","last_became_peered":"2024-04-23T19:00:15.256091+0000","last_unstale":"2024-04-23T19:04:23.619501+0000","last_undegraded":"2024-04-23T19:04:23.619501+0000","last_fullsized":"2024-04-23T19:04:23.619501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:23.619219+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:23.619219+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.619219+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:55.397378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"57'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.149512+0000","last_change":"2024-04-23T19:04:20.149659+0000","last_active":"2024-04-23T19:04:20.149512+0000","last_peered":"2024-04-23T19:04:20.149512+0000","last_clean":"2024-04-23T19:04:20.149512+0000","last_became_active":"2024-04-23T19:00:17.305378+0000","last_became_peered":"2024-04-23T19:00:17.305378+0000","last_unstale":"2024-04-23T19:04:20.149512+0000","last_undegraded":"2024-04-23T19:04:20.149512+0000","last_fullsized":"2024-04-23T19:04:20.149512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:20.149253+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:20.149253+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.149253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:38.802261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'52","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.342086+0000","last_change":"2024-04-23T19:04:27.342148+0000","last_active":"2024-04-23T19:04:27.342086+0000","last_peered":"2024-04-23T19:04:27.342086+0000","last_clean":"2024-04-23T19:04:27.342086+0000","last_became_active":"2024-04-23T19:00:15.267457+0000","last_became_peered":"2024-04-23T19:00:15.267457+0000","last_unstale":"2024-04-23T19:04:27.342086+0000","last_undegraded":"2024-04-23T19:04:27.342086+0000","last_fullsized":"2024-04-23T19:04:27.342086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:27.341819+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:27.341819+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.341819+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:08.818038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"53'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.630515+0000","last_change":"2024-04-23T19:04:22.630581+0000","last_active":"2024-04-23T19:04:22.630515+0000","last_peered":"2024-04-23T19:04:22.630515+0000","last_clean":"2024-04-23T19:04:22.630515+0000","last_became_active":"2024-04-23T19:00:17.295661+0000","last_became_peered":"2024-04-23T19:00:17.295661+0000","last_unstale":"2024-04-23T19:04:22.630515+0000","last_undegraded":"2024-04-23T19:04:22.630515+0000","last_fullsized":"2024-04-23T19:04:22.630515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:22.630304+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:22.630304+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.630304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:59.509699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'44","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.067888+0000","last_change":"2024-04-23T19:04:28.067950+0000","last_active":"2024-04-23T19:04:28.067888+0000","last_peered":"2024-04-23T19:04:28.067888+0000","last_clean":"2024-04-23T19:04:28.067888+0000","last_became_active":"2024-04-23T19:00:15.280516+0000","last_became_peered":"2024-04-23T19:00:15.280516+0000","last_unstale":"2024-04-23T19:04:28.067888+0000","last_undegraded":"2024-04-23T19:04:28.067888+0000","last_fullsized":"2024-04-23T19:04:28.067888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:28.067658+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:28.067658+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.067658+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:56.897173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"53'8","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.250723+0000","last_change":"2024-04-23T19:04:06.250723+0000","last_active":"2024-04-23T19:04:06.250723+0000","last_peered":"2024-04-23T19:04:06.250723+0000","last_clean":"2024-04-23T19:04:06.250723+0000","last_became_active":"2024-04-23T19:00:17.319315+0000","last_became_peered":"2024-04-23T19:00:17.319315+0000","last_unstale":"2024-04-23T19:04:06.250723+0000","last_undegraded":"2024-04-23T19:04:06.250723+0000","last_fullsized":"2024-04-23T19:04:06.250723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:06.250456+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:06.250456+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.250456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:41:22.388683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'38","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.379228+0000","last_change":"2024-04-23T19:04:17.379293+0000","last_active":"2024-04-23T19:04:17.379228+0000","last_peered":"2024-04-23T19:04:17.379228+0000","last_clean":"2024-04-23T19:04:17.379228+0000","last_became_active":"2024-04-23T19:00:15.276649+0000","last_became_peered":"2024-04-23T19:00:15.276649+0000","last_unstale":"2024-04-23T19:04:17.379228+0000","last_undegraded":"2024-04-23T19:04:17.379228+0000","last_fullsized":"2024-04-23T19:04:17.379228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:17.379035+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:17.379035+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.379035+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:33.141203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'10","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.005603+0000","last_change":"2024-04-23T19:04:10.005603+0000","last_active":"2024-04-23T19:04:10.005603+0000","last_peered":"2024-04-23T19:04:10.005603+0000","last_clean":"2024-04-23T19:04:10.005603+0000","last_became_active":"2024-04-23T19:00:17.313750+0000","last_became_peered":"2024-04-23T19:00:17.313750+0000","last_unstale":"2024-04-23T19:04:10.005603+0000","last_undegraded":"2024-04-23T19:04:10.005603+0000","last_fullsized":"2024-04-23T19:04:10.005603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-04-23T19:04:10.005426+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-04-23T19:04:10.005426+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.005426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:09.258211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.009279+0000","last_change":"2024-04-23T19:04:24.009346+0000","last_active":"2024-04-23T19:04:24.009279+0000","last_peered":"2024-04-23T19:04:24.009279+0000","last_clean":"2024-04-23T19:04:24.009279+0000","last_became_active":"2024-04-23T19:00:15.268894+0000","last_became_peered":"2024-04-23T19:00:15.268894+0000","last_unstale":"2024-04-23T19:04:24.009279+0000","last_undegraded":"2024-04-23T19:04:24.009279+0000","last_fullsized":"2024-04-23T19:04:24.009279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-04-23T19:04:24.009055+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-04-23T19:04:24.009055+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.009055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:42.662063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"98'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.384687+0000","last_change":"2024-04-23T19:04:11.384687+0000","last_active":"2024-04-23T19:04:11.384687+0000","last_peered":"2024-04-23T19:04:11.384687+0000","last_clean":"2024-04-23T19:04:11.384687+0000","last_became_active":"2024-04-23T19:00:17.297943+0000","last_became_peered":"2024-04-23T19:00:17.297943+0000","last_unstale":"2024-04-23T19:04:11.384687+0000","last_undegraded":"2024-04-23T19:04:11.384687+0000","last_fullsized":"2024-04-23T19:04:11.384687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-23T19:04:11.384413+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.384413+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.384413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:57.019269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'48","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.863240+0000","last_change":"2024-04-23T19:04:33.863300+0000","last_active":"2024-04-23T19:04:33.863240+0000","last_peered":"2024-04-23T19:04:33.863240+0000","last_clean":"2024-04-23T19:04:33.863240+0000","last_became_active":"2024-04-23T19:00:15.277449+0000","last_became_peered":"2024-04-23T19:00:15.277449+0000","last_unstale":"2024-04-23T19:04:33.863240+0000","last_undegraded":"2024-04-23T19:04:33.863240+0000","last_fullsized":"2024-04-23T19:04:33.863240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:33.863050+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:33.863050+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.863050+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:05.508145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"89'8","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.974603+0000","last_change":"2024-04-23T19:04:08.974603+0000","last_active":"2024-04-23T19:04:08.974603+0000","last_peered":"2024-04-23T19:04:08.974603+0000","last_clean":"2024-04-23T19:04:08.974603+0000","last_became_active":"2024-04-23T19:00:17.294076+0000","last_became_peered":"2024-04-23T19:00:17.294076+0000","last_unstale":"2024-04-23T19:04:08.974603+0000","last_undegraded":"2024-04-23T19:04:08.974603+0000","last_fullsized":"2024-04-23T19:04:08.974603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'8","last_scrub_stamp":"2024-04-23T19:04:08.974238+0000","last_deep_scrub":"89'8","last_deep_scrub_stamp":"2024-04-23T19:04:08.974238+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.974238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:23.342084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.112170+0000","last_change":"2024-04-23T19:04:29.112170+0000","last_active":"2024-04-23T19:04:29.112170+0000","last_peered":"2024-04-23T19:04:29.112170+0000","last_clean":"2024-04-23T19:04:29.112170+0000","last_became_active":"2024-04-23T19:00:17.297609+0000","last_became_peered":"2024-04-23T19:00:17.297609+0000","last_unstale":"2024-04-23T19:04:29.112170+0000","last_undegraded":"2024-04-23T19:04:29.112170+0000","last_fullsized":"2024-04-23T19:04:29.112170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'8","last_scrub_stamp":"2024-04-23T19:04:29.111878+0000","last_deep_scrub":"75'8","last_deep_scrub_stamp":"2024-04-23T19:04:29.111878+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.111878+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:10.588097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.008010+0000","last_change":"2024-04-23T19:04:14.008071+0000","last_active":"2024-04-23T19:04:14.008010+0000","last_peered":"2024-04-23T19:04:14.008010+0000","last_clean":"2024-04-23T19:04:14.008010+0000","last_became_active":"2024-04-23T19:00:15.292679+0000","last_became_peered":"2024-04-23T19:00:15.292679+0000","last_unstale":"2024-04-23T19:04:14.008010+0000","last_undegraded":"2024-04-23T19:04:14.008010+0000","last_fullsized":"2024-04-23T19:04:14.008010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:14.007823+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:14.007823+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.007823+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:02.029745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"52'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.014365+0000","last_change":"2024-04-23T19:04:08.014365+0000","last_active":"2024-04-23T19:04:08.014365+0000","last_peered":"2024-04-23T19:04:08.014365+0000","last_clean":"2024-04-23T19:04:08.014365+0000","last_became_active":"2024-04-23T19:00:17.300045+0000","last_became_peered":"2024-04-23T19:00:17.300045+0000","last_unstale":"2024-04-23T19:04:08.014365+0000","last_undegraded":"2024-04-23T19:04:08.014365+0000","last_fullsized":"2024-04-23T19:04:08.014365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:08.014057+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:08.014057+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.014057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:00.990004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'40","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.160560+0000","last_change":"2024-04-23T19:04:17.160620+0000","last_active":"2024-04-23T19:04:17.160560+0000","last_peered":"2024-04-23T19:04:17.160560+0000","last_clean":"2024-04-23T19:04:17.160560+0000","last_became_active":"2024-04-23T19:00:15.278555+0000","last_became_peered":"2024-04-23T19:00:15.278555+0000","last_unstale":"2024-04-23T19:04:17.160560+0000","last_undegraded":"2024-04-23T19:04:17.160560+0000","last_fullsized":"2024-04-23T19:04:17.160560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:17.160373+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:17.160373+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.160373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:06.310668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"57'14","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.362013+0000","last_change":"2024-04-23T19:04:10.362013+0000","last_active":"2024-04-23T19:04:10.362013+0000","last_peered":"2024-04-23T19:04:10.362013+0000","last_clean":"2024-04-23T19:04:10.362013+0000","last_became_active":"2024-04-23T19:00:17.313402+0000","last_became_peered":"2024-04-23T19:00:17.313402+0000","last_unstale":"2024-04-23T19:04:10.362013+0000","last_undegraded":"2024-04-23T19:04:10.362013+0000","last_fullsized":"2024-04-23T19:04:10.362013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'14","last_scrub_stamp":"2024-04-23T19:04:10.361754+0000","last_deep_scrub":"57'14","last_deep_scrub_stamp":"2024-04-23T19:04:10.361754+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.361754+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:40.685164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'58","reported_seq":266,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.131762+0000","last_change":"2024-04-23T19:04:16.131822+0000","last_active":"2024-04-23T19:04:16.131762+0000","last_peered":"2024-04-23T19:04:16.131762+0000","last_clean":"2024-04-23T19:04:16.131762+0000","last_became_active":"2024-04-23T19:00:15.277977+0000","last_became_peered":"2024-04-23T19:00:15.277977+0000","last_unstale":"2024-04-23T19:04:16.131762+0000","last_undegraded":"2024-04-23T19:04:16.131762+0000","last_fullsized":"2024-04-23T19:04:16.131762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:16.131570+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:16.131570+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.131570+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:12.862429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"53'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.940073+0000","last_change":"2024-04-23T19:04:07.940142+0000","last_active":"2024-04-23T19:04:07.940073+0000","last_peered":"2024-04-23T19:04:07.940073+0000","last_clean":"2024-04-23T19:04:07.940073+0000","last_became_active":"2024-04-23T19:00:17.289466+0000","last_became_peered":"2024-04-23T19:00:17.289466+0000","last_unstale":"2024-04-23T19:04:07.940073+0000","last_undegraded":"2024-04-23T19:04:07.940073+0000","last_fullsized":"2024-04-23T19:04:07.940073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:07.939845+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:07.939845+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.939845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:54.688217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'32","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.104264+0000","last_change":"2024-04-23T19:04:27.104324+0000","last_active":"2024-04-23T19:04:27.104264+0000","last_peered":"2024-04-23T19:04:27.104264+0000","last_clean":"2024-04-23T19:04:27.104264+0000","last_became_active":"2024-04-23T19:00:15.272525+0000","last_became_peered":"2024-04-23T19:00:15.272525+0000","last_unstale":"2024-04-23T19:04:27.104264+0000","last_undegraded":"2024-04-23T19:04:27.104264+0000","last_fullsized":"2024-04-23T19:04:27.104264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:27.104061+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:27.104061+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.104061+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:37.322176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"53'8","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.007622+0000","last_change":"2024-04-23T19:04:12.007691+0000","last_active":"2024-04-23T19:04:12.007622+0000","last_peered":"2024-04-23T19:04:12.007622+0000","last_clean":"2024-04-23T19:04:12.007622+0000","last_became_active":"2024-04-23T19:00:17.304629+0000","last_became_peered":"2024-04-23T19:00:17.304629+0000","last_unstale":"2024-04-23T19:04:12.007622+0000","last_undegraded":"2024-04-23T19:04:12.007622+0000","last_fullsized":"2024-04-23T19:04:12.007622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:12.007381+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:12.007381+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.007381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:56.924916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'54","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.869165+0000","last_change":"2024-04-23T19:04:29.869227+0000","last_active":"2024-04-23T19:04:29.869165+0000","last_peered":"2024-04-23T19:04:29.869165+0000","last_clean":"2024-04-23T19:04:29.869165+0000","last_became_active":"2024-04-23T19:00:15.262795+0000","last_became_peered":"2024-04-23T19:00:15.262795+0000","last_unstale":"2024-04-23T19:04:29.869165+0000","last_undegraded":"2024-04-23T19:04:29.869165+0000","last_fullsized":"2024-04-23T19:04:29.869165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'54","last_scrub_stamp":"2024-04-23T19:04:29.868971+0000","last_deep_scrub":"116'54","last_deep_scrub_stamp":"2024-04-23T19:04:29.868971+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.868971+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:22:56.636376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"75'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.101587+0000","last_change":"2024-04-23T19:04:15.101729+0000","last_active":"2024-04-23T19:04:15.101587+0000","last_peered":"2024-04-23T19:04:15.101587+0000","last_clean":"2024-04-23T19:04:15.101587+0000","last_became_active":"2024-04-23T19:00:17.325476+0000","last_became_peered":"2024-04-23T19:00:17.325476+0000","last_unstale":"2024-04-23T19:04:15.101587+0000","last_undegraded":"2024-04-23T19:04:15.101587+0000","last_fullsized":"2024-04-23T19:04:15.101587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-04-23T19:04:15.101352+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-04-23T19:04:15.101352+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.101352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:11.702279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'38","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.657423+0000","last_change":"2024-04-23T19:04:24.657423+0000","last_active":"2024-04-23T19:04:24.657423+0000","last_peered":"2024-04-23T19:04:24.657423+0000","last_clean":"2024-04-23T19:04:24.657423+0000","last_became_active":"2024-04-23T19:00:15.261559+0000","last_became_peered":"2024-04-23T19:00:15.261559+0000","last_unstale":"2024-04-23T19:04:24.657423+0000","last_undegraded":"2024-04-23T19:04:24.657423+0000","last_fullsized":"2024-04-23T19:04:24.657423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:24.657123+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:24.657123+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.657123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:52.976305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:38.061703+0000","last_change":"2024-04-23T19:04:38.061755+0000","last_active":"2024-04-23T19:04:38.061703+0000","last_peered":"2024-04-23T19:04:38.061703+0000","last_clean":"2024-04-23T19:04:38.061703+0000","last_became_active":"2024-04-23T19:00:25.349716+0000","last_became_peered":"2024-04-23T19:00:25.349716+0000","last_unstale":"2024-04-23T19:04:38.061703+0000","last_undegraded":"2024-04-23T19:04:38.061703+0000","last_fullsized":"2024-04-23T19:04:38.061703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:38.061503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:38.061503+0000","last_clean_scrub_stamp":"2024-04-23T19:04:38.061503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:03.981833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.850307+0000","last_change":"2024-04-23T19:04:20.850307+0000","last_active":"2024-04-23T19:04:20.850307+0000","last_peered":"2024-04-23T19:04:20.850307+0000","last_clean":"2024-04-23T19:04:20.850307+0000","last_became_active":"2024-04-23T19:00:17.293505+0000","last_became_peered":"2024-04-23T19:00:17.293505+0000","last_unstale":"2024-04-23T19:04:20.850307+0000","last_undegraded":"2024-04-23T19:04:20.850307+0000","last_fullsized":"2024-04-23T19:04:20.850307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.850014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.850014+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.850014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:28.063027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'48","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.052830+0000","last_change":"2024-04-23T19:04:20.052963+0000","last_active":"2024-04-23T19:04:20.052830+0000","last_peered":"2024-04-23T19:04:20.052830+0000","last_clean":"2024-04-23T19:04:20.052830+0000","last_became_active":"2024-04-23T19:00:55.482732+0000","last_became_peered":"2024-04-23T19:00:55.482732+0000","last_unstale":"2024-04-23T19:04:20.052830+0000","last_undegraded":"2024-04-23T19:04:20.052830+0000","last_fullsized":"2024-04-23T19:04:20.052830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:20.052592+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:20.052592+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.052592+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:13.028540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.377530+0000","last_change":"2024-04-23T19:04:18.377587+0000","last_active":"2024-04-23T19:04:18.377530+0000","last_peered":"2024-04-23T19:04:18.377530+0000","last_clean":"2024-04-23T19:04:18.377530+0000","last_became_active":"2024-04-23T19:00:19.295956+0000","last_became_peered":"2024-04-23T19:00:19.295956+0000","last_unstale":"2024-04-23T19:04:18.377530+0000","last_undegraded":"2024-04-23T19:04:18.377530+0000","last_fullsized":"2024-04-23T19:04:18.377530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.377330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.377330+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.377330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:55.319797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'26","reported_seq":155,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.784301+0000","last_change":"2024-04-23T19:04:34.784378+0000","last_active":"2024-04-23T19:04:34.784301+0000","last_peered":"2024-04-23T19:04:34.784301+0000","last_clean":"2024-04-23T19:04:34.784301+0000","last_became_active":"2024-04-23T19:01:39.097532+0000","last_became_peered":"2024-04-23T19:01:39.097532+0000","last_unstale":"2024-04-23T19:04:34.784301+0000","last_undegraded":"2024-04-23T19:04:34.784301+0000","last_fullsized":"2024-04-23T19:04:34.784301+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:34.784105+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:34.784105+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.784105+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:06.429200+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.047670+0000","last_change":"2024-04-23T19:04:30.047731+0000","last_active":"2024-04-23T19:04:30.047670+0000","last_peered":"2024-04-23T19:04:30.047670+0000","last_clean":"2024-04-23T19:04:30.047670+0000","last_became_active":"2024-04-23T19:00:23.328321+0000","last_became_peered":"2024-04-23T19:00:23.328321+0000","last_unstale":"2024-04-23T19:04:30.047670+0000","last_undegraded":"2024-04-23T19:04:30.047670+0000","last_fullsized":"2024-04-23T19:04:30.047670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:30.047439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:30.047439+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.047439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:36.229495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"116'49","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.382752+0000","last_change":"2024-04-23T19:04:34.382824+0000","last_active":"2024-04-23T19:04:34.382752+0000","last_peered":"2024-04-23T19:04:34.382752+0000","last_clean":"2024-04-23T19:04:34.382752+0000","last_became_active":"2024-04-23T19:00:25.332071+0000","last_became_peered":"2024-04-23T19:00:25.332071+0000","last_unstale":"2024-04-23T19:04:34.382752+0000","last_undegraded":"2024-04-23T19:04:34.382752+0000","last_fullsized":"2024-04-23T19:04:34.382752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'49","last_scrub_stamp":"2024-04-23T19:04:34.382560+0000","last_deep_scrub":"116'49","last_deep_scrub_stamp":"2024-04-23T19:04:34.382560+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.382560+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:09.480804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"75'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.304934+0000","last_change":"2024-04-23T19:04:06.304994+0000","last_active":"2024-04-23T19:04:06.304934+0000","last_peered":"2024-04-23T19:04:06.304934+0000","last_clean":"2024-04-23T19:04:06.304934+0000","last_became_active":"2024-04-23T19:00:17.316475+0000","last_became_peered":"2024-04-23T19:00:17.316475+0000","last_unstale":"2024-04-23T19:04:06.304934+0000","last_undegraded":"2024-04-23T19:04:06.304934+0000","last_fullsized":"2024-04-23T19:04:06.304934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:06.304698+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.304698+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.304698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:53.608671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'62","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.673936+0000","last_change":"2024-04-23T19:04:29.673936+0000","last_active":"2024-04-23T19:04:29.673936+0000","last_peered":"2024-04-23T19:04:29.673936+0000","last_clean":"2024-04-23T19:04:29.673936+0000","last_became_active":"2024-04-23T19:00:15.277266+0000","last_became_peered":"2024-04-23T19:00:15.277266+0000","last_unstale":"2024-04-23T19:04:29.673936+0000","last_undegraded":"2024-04-23T19:04:29.673936+0000","last_fullsized":"2024-04-23T19:04:29.673936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:29.673572+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:29.673572+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.673572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:22:56.440977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.799631+0000","last_change":"2024-04-23T19:04:23.799631+0000","last_active":"2024-04-23T19:04:23.799631+0000","last_peered":"2024-04-23T19:04:23.799631+0000","last_clean":"2024-04-23T19:04:23.799631+0000","last_became_active":"2024-04-23T19:00:19.310135+0000","last_became_peered":"2024-04-23T19:00:19.310135+0000","last_unstale":"2024-04-23T19:04:23.799631+0000","last_undegraded":"2024-04-23T19:04:23.799631+0000","last_fullsized":"2024-04-23T19:04:23.799631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:23.799380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:23.799380+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.799380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:48.470948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"116'9","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.865860+0000","last_change":"2024-04-23T19:04:03.865928+0000","last_active":"2024-04-23T19:04:03.865860+0000","last_peered":"2024-04-23T19:04:03.865860+0000","last_clean":"2024-04-23T19:04:03.865860+0000","last_became_active":"2024-04-23T19:00:21.300300+0000","last_became_peered":"2024-04-23T19:00:21.300300+0000","last_unstale":"2024-04-23T19:04:03.865860+0000","last_undegraded":"2024-04-23T19:04:03.865860+0000","last_fullsized":"2024-04-23T19:04:03.865860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'9","last_scrub_stamp":"2024-04-23T19:04:03.865681+0000","last_deep_scrub":"116'9","last_deep_scrub_stamp":"2024-04-23T19:04:03.865681+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.865681+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:37.482152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.120813+0000","last_change":"2024-04-23T19:04:34.120879+0000","last_active":"2024-04-23T19:04:34.120813+0000","last_peered":"2024-04-23T19:04:34.120813+0000","last_clean":"2024-04-23T19:04:34.120813+0000","last_became_active":"2024-04-23T19:00:23.333499+0000","last_became_peered":"2024-04-23T19:00:23.333499+0000","last_unstale":"2024-04-23T19:04:34.120813+0000","last_undegraded":"2024-04-23T19:04:34.120813+0000","last_fullsized":"2024-04-23T19:04:34.120813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:34.120596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:34.120596+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.120596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:25.028442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.538570+0000","last_change":"2024-04-23T19:04:05.538628+0000","last_active":"2024-04-23T19:04:05.538570+0000","last_peered":"2024-04-23T19:04:05.538570+0000","last_clean":"2024-04-23T19:04:05.538570+0000","last_became_active":"2024-04-23T19:00:25.341233+0000","last_became_peered":"2024-04-23T19:00:25.341233+0000","last_unstale":"2024-04-23T19:04:05.538570+0000","last_undegraded":"2024-04-23T19:04:05.538570+0000","last_fullsized":"2024-04-23T19:04:05.538570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.538348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.538348+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.538348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:51.173204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"53'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.634767+0000","last_change":"2024-04-23T19:04:16.634937+0000","last_active":"2024-04-23T19:04:16.634767+0000","last_peered":"2024-04-23T19:04:16.634767+0000","last_clean":"2024-04-23T19:04:16.634767+0000","last_became_active":"2024-04-23T19:00:17.302616+0000","last_became_peered":"2024-04-23T19:00:17.302616+0000","last_unstale":"2024-04-23T19:04:16.634767+0000","last_undegraded":"2024-04-23T19:04:16.634767+0000","last_fullsized":"2024-04-23T19:04:16.634767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:16.634534+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:16.634534+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.634534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:45.464050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'44","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.994260+0000","last_change":"2024-04-23T19:04:24.994260+0000","last_active":"2024-04-23T19:04:24.994260+0000","last_peered":"2024-04-23T19:04:24.994260+0000","last_clean":"2024-04-23T19:04:24.994260+0000","last_became_active":"2024-04-23T19:00:15.278537+0000","last_became_peered":"2024-04-23T19:00:15.278537+0000","last_unstale":"2024-04-23T19:04:24.994260+0000","last_undegraded":"2024-04-23T19:04:24.994260+0000","last_fullsized":"2024-04-23T19:04:24.994260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:24.993985+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:24.993985+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.993985+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:02.474594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.805997+0000","last_change":"2024-04-23T19:04:19.806052+0000","last_active":"2024-04-23T19:04:19.805997+0000","last_peered":"2024-04-23T19:04:19.805997+0000","last_clean":"2024-04-23T19:04:19.805997+0000","last_became_active":"2024-04-23T19:00:19.299994+0000","last_became_peered":"2024-04-23T19:00:19.299994+0000","last_unstale":"2024-04-23T19:04:19.805997+0000","last_undegraded":"2024-04-23T19:04:19.805997+0000","last_fullsized":"2024-04-23T19:04:19.805997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.805796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.805796+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.805796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:30.023911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"116'15","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.130096+0000","last_change":"2024-04-23T19:04:15.130096+0000","last_active":"2024-04-23T19:04:15.130096+0000","last_peered":"2024-04-23T19:04:15.130096+0000","last_clean":"2024-04-23T19:04:15.130096+0000","last_became_active":"2024-04-23T19:00:21.308760+0000","last_became_peered":"2024-04-23T19:00:21.308760+0000","last_unstale":"2024-04-23T19:04:15.130096+0000","last_undegraded":"2024-04-23T19:04:15.130096+0000","last_fullsized":"2024-04-23T19:04:15.130096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:15.129819+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:15.129819+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.129819+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:27.829926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'139","reported_seq":372,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.061402+0000","last_change":"2024-04-23T19:04:31.061479+0000","last_active":"2024-04-23T19:04:31.061402+0000","last_peered":"2024-04-23T19:04:31.061402+0000","last_clean":"2024-04-23T19:04:31.061402+0000","last_became_active":"2024-04-23T19:00:23.337375+0000","last_became_peered":"2024-04-23T19:00:23.337375+0000","last_unstale":"2024-04-23T19:04:31.061402+0000","last_undegraded":"2024-04-23T19:04:31.061402+0000","last_fullsized":"2024-04-23T19:04:31.061402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-04-23T19:04:31.061202+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-04-23T19:04:31.061202+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.061202+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:37.627440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'4","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.034399+0000","last_change":"2024-04-23T19:04:36.034459+0000","last_active":"2024-04-23T19:04:36.034399+0000","last_peered":"2024-04-23T19:04:36.034399+0000","last_clean":"2024-04-23T19:04:36.034399+0000","last_became_active":"2024-04-23T19:00:25.331393+0000","last_became_peered":"2024-04-23T19:00:25.331393+0000","last_unstale":"2024-04-23T19:04:36.034399+0000","last_undegraded":"2024-04-23T19:04:36.034399+0000","last_fullsized":"2024-04-23T19:04:36.034399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-04-23T19:04:36.034201+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-04-23T19:04:36.034201+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.034201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:11.132445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"52'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.748940+0000","last_change":"2024-04-23T19:04:15.749006+0000","last_active":"2024-04-23T19:04:15.748940+0000","last_peered":"2024-04-23T19:04:15.748940+0000","last_clean":"2024-04-23T19:04:15.748940+0000","last_became_active":"2024-04-23T19:00:17.304226+0000","last_became_peered":"2024-04-23T19:00:17.304226+0000","last_unstale":"2024-04-23T19:04:15.748940+0000","last_undegraded":"2024-04-23T19:04:15.748940+0000","last_fullsized":"2024-04-23T19:04:15.748940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:15.748737+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:15.748737+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.748737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:22.778779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'48","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.100847+0000","last_change":"2024-04-23T19:04:12.100847+0000","last_active":"2024-04-23T19:04:12.100847+0000","last_peered":"2024-04-23T19:04:12.100847+0000","last_clean":"2024-04-23T19:04:12.100847+0000","last_became_active":"2024-04-23T19:00:15.260186+0000","last_became_peered":"2024-04-23T19:00:15.260186+0000","last_unstale":"2024-04-23T19:04:12.100847+0000","last_undegraded":"2024-04-23T19:04:12.100847+0000","last_fullsized":"2024-04-23T19:04:12.100847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:12.100585+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:12.100585+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.100585+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:46.299040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.366651+0000","last_change":"2024-04-23T19:04:14.366705+0000","last_active":"2024-04-23T19:04:14.366651+0000","last_peered":"2024-04-23T19:04:14.366651+0000","last_clean":"2024-04-23T19:04:14.366651+0000","last_became_active":"2024-04-23T19:00:19.286185+0000","last_became_peered":"2024-04-23T19:00:19.286185+0000","last_unstale":"2024-04-23T19:04:14.366651+0000","last_undegraded":"2024-04-23T19:04:14.366651+0000","last_fullsized":"2024-04-23T19:04:14.366651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:14.366452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:14.366452+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.366452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:06.533771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'23","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.029557+0000","last_change":"2024-04-23T19:04:17.029633+0000","last_active":"2024-04-23T19:04:17.029557+0000","last_peered":"2024-04-23T19:04:17.029557+0000","last_clean":"2024-04-23T19:04:17.029557+0000","last_became_active":"2024-04-23T19:00:21.306691+0000","last_became_peered":"2024-04-23T19:00:21.306691+0000","last_unstale":"2024-04-23T19:04:17.029557+0000","last_undegraded":"2024-04-23T19:04:17.029557+0000","last_fullsized":"2024-04-23T19:04:17.029557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:17.029366+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:17.029366+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.029366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:37.775720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'138","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.848142+0000","last_change":"2024-04-23T19:04:01.848166+0000","last_active":"2024-04-23T19:04:01.848142+0000","last_peered":"2024-04-23T19:04:01.848142+0000","last_clean":"2024-04-23T19:04:01.848142+0000","last_became_active":"2024-04-23T19:00:23.340067+0000","last_became_peered":"2024-04-23T19:00:23.340067+0000","last_unstale":"2024-04-23T19:04:01.848142+0000","last_undegraded":"2024-04-23T19:04:01.848142+0000","last_fullsized":"2024-04-23T19:04:01.848142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:01.848048+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.848048+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:05.290229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"52'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.371178+0000","last_change":"2024-04-23T19:04:09.371178+0000","last_active":"2024-04-23T19:04:09.371178+0000","last_peered":"2024-04-23T19:04:09.371178+0000","last_clean":"2024-04-23T19:04:09.371178+0000","last_became_active":"2024-04-23T19:00:17.314068+0000","last_became_peered":"2024-04-23T19:00:17.314068+0000","last_unstale":"2024-04-23T19:04:09.371178+0000","last_undegraded":"2024-04-23T19:04:09.371178+0000","last_fullsized":"2024-04-23T19:04:09.371178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:09.370889+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:09.370889+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.370889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:57.392811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'58","reported_seq":267,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.052654+0000","last_change":"2024-04-23T19:04:16.052654+0000","last_active":"2024-04-23T19:04:16.052654+0000","last_peered":"2024-04-23T19:04:16.052654+0000","last_clean":"2024-04-23T19:04:16.052654+0000","last_became_active":"2024-04-23T19:00:15.287786+0000","last_became_peered":"2024-04-23T19:00:15.287786+0000","last_unstale":"2024-04-23T19:04:16.052654+0000","last_undegraded":"2024-04-23T19:04:16.052654+0000","last_fullsized":"2024-04-23T19:04:16.052654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:16.052402+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:16.052402+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.052402+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:01.687258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"116'2","reported_seq":294,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.974686+0000","last_change":"2024-04-23T19:04:06.974686+0000","last_active":"2024-04-23T19:04:06.974686+0000","last_peered":"2024-04-23T19:04:06.974686+0000","last_clean":"2024-04-23T19:04:06.974686+0000","last_became_active":"2024-04-23T19:00:19.308561+0000","last_became_peered":"2024-04-23T19:00:19.308561+0000","last_unstale":"2024-04-23T19:04:06.974686+0000","last_undegraded":"2024-04-23T19:04:06.974686+0000","last_fullsized":"2024-04-23T19:04:06.974686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:06.974385+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.974385+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.974385+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:31.138018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'38","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.221089+0000","last_change":"2024-04-23T19:04:02.221089+0000","last_active":"2024-04-23T19:04:02.221089+0000","last_peered":"2024-04-23T19:04:02.221089+0000","last_clean":"2024-04-23T19:04:02.221089+0000","last_became_active":"2024-04-23T19:00:21.319962+0000","last_became_peered":"2024-04-23T19:00:21.319962+0000","last_unstale":"2024-04-23T19:04:02.221089+0000","last_undegraded":"2024-04-23T19:04:02.221089+0000","last_fullsized":"2024-04-23T19:04:02.221089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'38","last_scrub_stamp":"2024-04-23T19:04:02.220813+0000","last_deep_scrub":"116'38","last_deep_scrub_stamp":"2024-04-23T19:04:02.220813+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.220813+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:26.384447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.465071+0000","last_change":"2024-04-23T19:04:19.465071+0000","last_active":"2024-04-23T19:04:19.465071+0000","last_peered":"2024-04-23T19:04:19.465071+0000","last_clean":"2024-04-23T19:04:19.465071+0000","last_became_active":"2024-04-23T19:00:23.321961+0000","last_became_peered":"2024-04-23T19:00:23.321961+0000","last_unstale":"2024-04-23T19:04:19.465071+0000","last_undegraded":"2024-04-23T19:04:19.465071+0000","last_fullsized":"2024-04-23T19:04:19.465071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.464712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.464712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.464712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:19.055281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"53'6","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.363566+0000","last_change":"2024-04-23T19:04:35.363566+0000","last_active":"2024-04-23T19:04:35.363566+0000","last_peered":"2024-04-23T19:04:35.363566+0000","last_clean":"2024-04-23T19:04:35.363566+0000","last_became_active":"2024-04-23T19:00:25.333549+0000","last_became_peered":"2024-04-23T19:00:25.333549+0000","last_unstale":"2024-04-23T19:04:35.363566+0000","last_undegraded":"2024-04-23T19:04:35.363566+0000","last_fullsized":"2024-04-23T19:04:35.363566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-23T19:04:35.363290+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-23T19:04:35.363290+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.363290+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:02.130694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.118471+0000","last_change":"2024-04-23T19:04:22.118471+0000","last_active":"2024-04-23T19:04:22.118471+0000","last_peered":"2024-04-23T19:04:22.118471+0000","last_clean":"2024-04-23T19:04:22.118471+0000","last_became_active":"2024-04-23T19:00:17.300327+0000","last_became_peered":"2024-04-23T19:00:17.300327+0000","last_unstale":"2024-04-23T19:04:22.118471+0000","last_undegraded":"2024-04-23T19:04:22.118471+0000","last_fullsized":"2024-04-23T19:04:22.118471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:22.118212+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:22.118212+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.118212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:09.405388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'62","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.016882+0000","last_change":"2024-04-23T19:04:26.016882+0000","last_active":"2024-04-23T19:04:26.016882+0000","last_peered":"2024-04-23T19:04:26.016882+0000","last_clean":"2024-04-23T19:04:26.016882+0000","last_became_active":"2024-04-23T19:00:15.278952+0000","last_became_peered":"2024-04-23T19:00:15.278952+0000","last_unstale":"2024-04-23T19:04:26.016882+0000","last_undegraded":"2024-04-23T19:04:26.016882+0000","last_fullsized":"2024-04-23T19:04:26.016882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:26.016607+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:26.016607+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.016607+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:13.303783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.996299+0000","last_change":"2024-04-23T19:04:00.996299+0000","last_active":"2024-04-23T19:04:00.996299+0000","last_peered":"2024-04-23T19:04:00.996299+0000","last_clean":"2024-04-23T19:04:00.996299+0000","last_became_active":"2024-04-23T19:00:19.301938+0000","last_became_peered":"2024-04-23T19:00:19.301938+0000","last_unstale":"2024-04-23T19:04:00.996299+0000","last_undegraded":"2024-04-23T19:04:00.996299+0000","last_fullsized":"2024-04-23T19:04:00.996299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.996139+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.996139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:28.783439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'23","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.691464+0000","last_change":"2024-04-23T19:04:10.691464+0000","last_active":"2024-04-23T19:04:10.691464+0000","last_peered":"2024-04-23T19:04:10.691464+0000","last_clean":"2024-04-23T19:04:10.691464+0000","last_became_active":"2024-04-23T19:00:21.303685+0000","last_became_peered":"2024-04-23T19:00:21.303685+0000","last_unstale":"2024-04-23T19:04:10.691464+0000","last_undegraded":"2024-04-23T19:04:10.691464+0000","last_fullsized":"2024-04-23T19:04:10.691464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:10.691176+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:10.691176+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.691176+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:23.752968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.824493+0000","last_change":"2024-04-23T19:04:05.824493+0000","last_active":"2024-04-23T19:04:05.824493+0000","last_peered":"2024-04-23T19:04:05.824493+0000","last_clean":"2024-04-23T19:04:05.824493+0000","last_became_active":"2024-04-23T19:00:23.340176+0000","last_became_peered":"2024-04-23T19:00:23.340176+0000","last_unstale":"2024-04-23T19:04:05.824493+0000","last_undegraded":"2024-04-23T19:04:05.824493+0000","last_fullsized":"2024-04-23T19:04:05.824493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.824218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.824218+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.824218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:51.459074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.131906+0000","last_change":"2024-04-23T19:04:25.131906+0000","last_active":"2024-04-23T19:04:25.131906+0000","last_peered":"2024-04-23T19:04:25.131906+0000","last_clean":"2024-04-23T19:04:25.131906+0000","last_became_active":"2024-04-23T19:00:25.344145+0000","last_became_peered":"2024-04-23T19:00:25.344145+0000","last_unstale":"2024-04-23T19:04:25.131906+0000","last_undegraded":"2024-04-23T19:04:25.131906+0000","last_fullsized":"2024-04-23T19:04:25.131906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:25.131656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:25.131656+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.131656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:21.732583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"53'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.238150+0000","last_change":"2024-04-23T19:04:04.238150+0000","last_active":"2024-04-23T19:04:04.238150+0000","last_peered":"2024-04-23T19:04:04.238150+0000","last_clean":"2024-04-23T19:04:04.238150+0000","last_became_active":"2024-04-23T19:00:17.319465+0000","last_became_peered":"2024-04-23T19:00:17.319465+0000","last_unstale":"2024-04-23T19:04:04.238150+0000","last_undegraded":"2024-04-23T19:04:04.238150+0000","last_fullsized":"2024-04-23T19:04:04.238150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-23T19:04:04.237885+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-23T19:04:04.237885+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.237885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:18.605731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'28","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.030820+0000","last_change":"2024-04-23T19:04:12.030820+0000","last_active":"2024-04-23T19:04:12.030820+0000","last_peered":"2024-04-23T19:04:12.030820+0000","last_clean":"2024-04-23T19:04:12.030820+0000","last_became_active":"2024-04-23T19:00:15.292873+0000","last_became_peered":"2024-04-23T19:00:15.292873+0000","last_unstale":"2024-04-23T19:04:12.030820+0000","last_undegraded":"2024-04-23T19:04:12.030820+0000","last_fullsized":"2024-04-23T19:04:12.030820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:12.030567+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:12.030567+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.030567+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:15.472747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.017639+0000","last_change":"2024-04-23T19:04:02.017639+0000","last_active":"2024-04-23T19:04:02.017639+0000","last_peered":"2024-04-23T19:04:02.017639+0000","last_clean":"2024-04-23T19:04:02.017639+0000","last_became_active":"2024-04-23T19:00:19.300232+0000","last_became_peered":"2024-04-23T19:00:19.300232+0000","last_unstale":"2024-04-23T19:04:02.017639+0000","last_undegraded":"2024-04-23T19:04:02.017639+0000","last_fullsized":"2024-04-23T19:04:02.017639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.017294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.017294+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.017294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:06.320183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'32","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.053915+0000","last_change":"2024-04-23T19:04:13.053915+0000","last_active":"2024-04-23T19:04:13.053915+0000","last_peered":"2024-04-23T19:04:13.053915+0000","last_clean":"2024-04-23T19:04:13.053915+0000","last_became_active":"2024-04-23T19:00:21.305583+0000","last_became_peered":"2024-04-23T19:00:21.305583+0000","last_unstale":"2024-04-23T19:04:13.053915+0000","last_undegraded":"2024-04-23T19:04:13.053915+0000","last_fullsized":"2024-04-23T19:04:13.053915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:13.053625+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:13.053625+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.053625+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:12.306410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'138","reported_seq":374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.588841+0000","last_change":"2024-04-23T19:04:19.588841+0000","last_active":"2024-04-23T19:04:19.588841+0000","last_peered":"2024-04-23T19:04:19.588841+0000","last_clean":"2024-04-23T19:04:19.588841+0000","last_became_active":"2024-04-23T19:00:23.326462+0000","last_became_peered":"2024-04-23T19:00:23.326462+0000","last_unstale":"2024-04-23T19:04:19.588841+0000","last_undegraded":"2024-04-23T19:04:19.588841+0000","last_fullsized":"2024-04-23T19:04:19.588841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:19.588382+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:19.588382+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.588382+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:26.154620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"89'9","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:03:59.400805+0000","last_change":"2024-04-23T19:03:59.400805+0000","last_active":"2024-04-23T19:03:59.400805+0000","last_peered":"2024-04-23T19:03:59.400805+0000","last_clean":"2024-04-23T19:03:59.400805+0000","last_became_active":"2024-04-23T19:00:25.322780+0000","last_became_peered":"2024-04-23T19:00:25.322780+0000","last_unstale":"2024-04-23T19:03:59.400805+0000","last_undegraded":"2024-04-23T19:03:59.400805+0000","last_fullsized":"2024-04-23T19:03:59.400805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'9","last_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_deep_scrub":"89'9","last_deep_scrub_stamp":"2024-04-23T19:03:59.400658+0000","last_clean_scrub_stamp":"2024-04-23T19:03:59.400658+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:02.291518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'6","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.720154+0000","last_change":"2024-04-23T19:04:30.720154+0000","last_active":"2024-04-23T19:04:30.720154+0000","last_peered":"2024-04-23T19:04:30.720154+0000","last_clean":"2024-04-23T19:04:30.720154+0000","last_became_active":"2024-04-23T19:00:17.295295+0000","last_became_peered":"2024-04-23T19:00:17.295295+0000","last_unstale":"2024-04-23T19:04:30.720154+0000","last_undegraded":"2024-04-23T19:04:30.720154+0000","last_fullsized":"2024-04-23T19:04:30.720154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:30.719802+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:30.719802+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.719802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:36:17.564645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'36","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.355111+0000","last_change":"2024-04-23T19:04:28.355111+0000","last_active":"2024-04-23T19:04:28.355111+0000","last_peered":"2024-04-23T19:04:28.355111+0000","last_clean":"2024-04-23T19:04:28.355111+0000","last_became_active":"2024-04-23T19:00:15.265943+0000","last_became_peered":"2024-04-23T19:00:15.265943+0000","last_unstale":"2024-04-23T19:04:28.355111+0000","last_undegraded":"2024-04-23T19:04:28.355111+0000","last_fullsized":"2024-04-23T19:04:28.355111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:28.354697+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:28.354697+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.354697+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:05.234093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.035240+0000","last_change":"2024-04-23T19:04:13.035240+0000","last_active":"2024-04-23T19:04:13.035240+0000","last_peered":"2024-04-23T19:04:13.035240+0000","last_clean":"2024-04-23T19:04:13.035240+0000","last_became_active":"2024-04-23T19:00:19.303146+0000","last_became_peered":"2024-04-23T19:00:19.303146+0000","last_unstale":"2024-04-23T19:04:13.035240+0000","last_undegraded":"2024-04-23T19:04:13.035240+0000","last_fullsized":"2024-04-23T19:04:13.035240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:13.034980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:13.034980+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.034980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:35.581669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'40","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.594412+0000","last_change":"2024-04-23T19:04:17.594412+0000","last_active":"2024-04-23T19:04:17.594412+0000","last_peered":"2024-04-23T19:04:17.594412+0000","last_clean":"2024-04-23T19:04:17.594412+0000","last_became_active":"2024-04-23T19:00:21.323052+0000","last_became_peered":"2024-04-23T19:00:21.323052+0000","last_unstale":"2024-04-23T19:04:17.594412+0000","last_undegraded":"2024-04-23T19:04:17.594412+0000","last_fullsized":"2024-04-23T19:04:17.594412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:17.594124+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:17.594124+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.594124+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:38.141344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.133626+0000","last_change":"2024-04-23T19:04:17.133626+0000","last_active":"2024-04-23T19:04:17.133626+0000","last_peered":"2024-04-23T19:04:17.133626+0000","last_clean":"2024-04-23T19:04:17.133626+0000","last_became_active":"2024-04-23T19:00:23.339712+0000","last_became_peered":"2024-04-23T19:00:23.339712+0000","last_unstale":"2024-04-23T19:04:17.133626+0000","last_undegraded":"2024-04-23T19:04:17.133626+0000","last_fullsized":"2024-04-23T19:04:17.133626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.133385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.133385+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.133385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.033787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"116'9","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.432949+0000","last_change":"2024-04-23T19:04:02.432972+0000","last_active":"2024-04-23T19:04:02.432949+0000","last_peered":"2024-04-23T19:04:02.432949+0000","last_clean":"2024-04-23T19:04:02.432949+0000","last_became_active":"2024-04-23T19:03:32.295125+0000","last_became_peered":"2024-04-23T19:03:32.295125+0000","last_unstale":"2024-04-23T19:04:02.432949+0000","last_undegraded":"2024-04-23T19:04:02.432949+0000","last_fullsized":"2024-04-23T19:04:02.432949+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'9","last_scrub_stamp":"2024-04-23T19:04:02.432887+0000","last_deep_scrub":"116'9","last_deep_scrub_stamp":"2024-04-23T19:04:02.432887+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.432887+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:38.237620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":61,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'4","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.068446+0000","last_change":"2024-04-23T19:04:12.068446+0000","last_active":"2024-04-23T19:04:12.068446+0000","last_peered":"2024-04-23T19:04:12.068446+0000","last_clean":"2024-04-23T19:04:12.068446+0000","last_became_active":"2024-04-23T19:00:17.308448+0000","last_became_peered":"2024-04-23T19:00:17.308448+0000","last_unstale":"2024-04-23T19:04:12.068446+0000","last_undegraded":"2024-04-23T19:04:12.068446+0000","last_fullsized":"2024-04-23T19:04:12.068446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:12.068159+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:12.068159+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.068159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:42.391569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'42","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.784113+0000","last_change":"2024-04-23T19:04:27.784113+0000","last_active":"2024-04-23T19:04:27.784113+0000","last_peered":"2024-04-23T19:04:27.784113+0000","last_clean":"2024-04-23T19:04:27.784113+0000","last_became_active":"2024-04-23T19:00:15.259440+0000","last_became_peered":"2024-04-23T19:00:15.259440+0000","last_unstale":"2024-04-23T19:04:27.784113+0000","last_undegraded":"2024-04-23T19:04:27.784113+0000","last_fullsized":"2024-04-23T19:04:27.784113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:27.783824+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:27.783824+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.783824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:06.468996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.943553+0000","last_change":"2024-04-23T19:04:03.943553+0000","last_active":"2024-04-23T19:04:03.943553+0000","last_peered":"2024-04-23T19:04:03.943553+0000","last_clean":"2024-04-23T19:04:03.943553+0000","last_became_active":"2024-04-23T19:00:19.297143+0000","last_became_peered":"2024-04-23T19:00:19.297143+0000","last_unstale":"2024-04-23T19:04:03.943553+0000","last_undegraded":"2024-04-23T19:04:03.943553+0000","last_fullsized":"2024-04-23T19:04:03.943553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.943302+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:33.673299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'26","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.881845+0000","last_change":"2024-04-23T19:04:02.881845+0000","last_active":"2024-04-23T19:04:02.881845+0000","last_peered":"2024-04-23T19:04:02.881845+0000","last_clean":"2024-04-23T19:04:02.881845+0000","last_became_active":"2024-04-23T19:00:21.305232+0000","last_became_peered":"2024-04-23T19:00:21.305232+0000","last_unstale":"2024-04-23T19:04:02.881845+0000","last_undegraded":"2024-04-23T19:04:02.881845+0000","last_fullsized":"2024-04-23T19:04:02.881845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:02.881475+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:02.881475+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.881475+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:51.012695+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.751594+0000","last_change":"2024-04-23T19:04:31.751594+0000","last_active":"2024-04-23T19:04:31.751594+0000","last_peered":"2024-04-23T19:04:31.751594+0000","last_clean":"2024-04-23T19:04:31.751594+0000","last_became_active":"2024-04-23T19:00:23.327302+0000","last_became_peered":"2024-04-23T19:00:23.327302+0000","last_unstale":"2024-04-23T19:04:31.751594+0000","last_undegraded":"2024-04-23T19:04:31.751594+0000","last_fullsized":"2024-04-23T19:04:31.751594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:31.751264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:31.751264+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.751264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:49.617110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"52'4","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:39.810811+0000","last_change":"2024-04-23T19:04:39.810878+0000","last_active":"2024-04-23T19:04:39.810811+0000","last_peered":"2024-04-23T19:04:39.810811+0000","last_clean":"2024-04-23T19:04:39.810811+0000","last_became_active":"2024-04-23T19:00:25.348207+0000","last_became_peered":"2024-04-23T19:00:25.348207+0000","last_unstale":"2024-04-23T19:04:39.810811+0000","last_undegraded":"2024-04-23T19:04:39.810811+0000","last_fullsized":"2024-04-23T19:04:39.810811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'4","last_scrub_stamp":"2024-04-23T19:04:39.810573+0000","last_deep_scrub":"52'4","last_deep_scrub_stamp":"2024-04-23T19:04:39.810573+0000","last_clean_scrub_stamp":"2024-04-23T19:04:39.810573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.163179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"57'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.093012+0000","last_change":"2024-04-23T19:04:14.093012+0000","last_active":"2024-04-23T19:04:14.093012+0000","last_peered":"2024-04-23T19:04:14.093012+0000","last_clean":"2024-04-23T19:04:14.093012+0000","last_became_active":"2024-04-23T19:00:17.309150+0000","last_became_peered":"2024-04-23T19:00:17.309150+0000","last_unstale":"2024-04-23T19:04:14.093012+0000","last_undegraded":"2024-04-23T19:04:14.093012+0000","last_fullsized":"2024-04-23T19:04:14.093012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:14.092748+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:14.092748+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.092748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:34.839102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'50","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.132101+0000","last_change":"2024-04-23T19:04:13.132101+0000","last_active":"2024-04-23T19:04:13.132101+0000","last_peered":"2024-04-23T19:04:13.132101+0000","last_clean":"2024-04-23T19:04:13.132101+0000","last_became_active":"2024-04-23T19:00:15.263389+0000","last_became_peered":"2024-04-23T19:00:15.263389+0000","last_unstale":"2024-04-23T19:04:13.132101+0000","last_undegraded":"2024-04-23T19:04:13.132101+0000","last_fullsized":"2024-04-23T19:04:13.132101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-04-23T19:04:13.131846+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-04-23T19:04:13.131846+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.131846+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:01.263066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.500436+0000","last_change":"2024-04-23T19:04:05.500510+0000","last_active":"2024-04-23T19:04:05.500436+0000","last_peered":"2024-04-23T19:04:05.500436+0000","last_clean":"2024-04-23T19:04:05.500436+0000","last_became_active":"2024-04-23T19:03:32.286243+0000","last_became_peered":"2024-04-23T19:03:32.286243+0000","last_unstale":"2024-04-23T19:04:05.500436+0000","last_undegraded":"2024-04-23T19:04:05.500436+0000","last_fullsized":"2024-04-23T19:04:05.500436+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.500207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.500207+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.500207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:54.624476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'35","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.088806+0000","last_change":"2024-04-23T19:04:14.088806+0000","last_active":"2024-04-23T19:04:14.088806+0000","last_peered":"2024-04-23T19:04:14.088806+0000","last_clean":"2024-04-23T19:04:14.088806+0000","last_became_active":"2024-04-23T19:00:21.294962+0000","last_became_peered":"2024-04-23T19:00:21.294962+0000","last_unstale":"2024-04-23T19:04:14.088806+0000","last_undegraded":"2024-04-23T19:04:14.088806+0000","last_fullsized":"2024-04-23T19:04:14.088806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'35","last_scrub_stamp":"2024-04-23T19:04:14.088533+0000","last_deep_scrub":"116'35","last_deep_scrub_stamp":"2024-04-23T19:04:14.088533+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.088533+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:22.612491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":146,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'138","reported_seq":389,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.159540+0000","last_change":"2024-04-23T19:04:16.159540+0000","last_active":"2024-04-23T19:04:16.159540+0000","last_peered":"2024-04-23T19:04:16.159540+0000","last_clean":"2024-04-23T19:04:16.159540+0000","last_became_active":"2024-04-23T19:00:23.310155+0000","last_became_peered":"2024-04-23T19:00:23.310155+0000","last_unstale":"2024-04-23T19:04:16.159540+0000","last_undegraded":"2024-04-23T19:04:16.159540+0000","last_fullsized":"2024-04-23T19:04:16.159540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:16.159281+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:16.159281+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.159281+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:48.033509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'4","reported_seq":163,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.459746+0000","last_change":"2024-04-23T19:04:11.459809+0000","last_active":"2024-04-23T19:04:11.459746+0000","last_peered":"2024-04-23T19:04:11.459746+0000","last_clean":"2024-04-23T19:04:11.459746+0000","last_became_active":"2024-04-23T19:03:32.290003+0000","last_became_peered":"2024-04-23T19:03:32.290003+0000","last_unstale":"2024-04-23T19:04:11.459746+0000","last_undegraded":"2024-04-23T19:04:11.459746+0000","last_fullsized":"2024-04-23T19:04:11.459746+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-04-23T19:04:11.459542+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-04-23T19:04:11.459542+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.459542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:08.060469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"57'8","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.984042+0000","last_change":"2024-04-23T19:04:07.984042+0000","last_active":"2024-04-23T19:04:07.984042+0000","last_peered":"2024-04-23T19:04:07.984042+0000","last_clean":"2024-04-23T19:04:07.984042+0000","last_became_active":"2024-04-23T19:00:17.323588+0000","last_became_peered":"2024-04-23T19:00:17.323588+0000","last_unstale":"2024-04-23T19:04:07.984042+0000","last_undegraded":"2024-04-23T19:04:07.984042+0000","last_fullsized":"2024-04-23T19:04:07.984042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'8","last_scrub_stamp":"2024-04-23T19:04:07.983769+0000","last_deep_scrub":"57'8","last_deep_scrub_stamp":"2024-04-23T19:04:07.983769+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.983769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:55.287742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'56","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.130031+0000","last_change":"2024-04-23T19:04:25.130031+0000","last_active":"2024-04-23T19:04:25.130031+0000","last_peered":"2024-04-23T19:04:25.130031+0000","last_clean":"2024-04-23T19:04:25.130031+0000","last_became_active":"2024-04-23T19:00:15.272414+0000","last_became_peered":"2024-04-23T19:00:15.272414+0000","last_unstale":"2024-04-23T19:04:25.130031+0000","last_undegraded":"2024-04-23T19:04:25.130031+0000","last_fullsized":"2024-04-23T19:04:25.130031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:25.129543+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:25.129543+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.129543+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:45.676763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":389,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.391394+0000","last_change":"2024-04-23T19:04:12.391394+0000","last_active":"2024-04-23T19:04:12.391394+0000","last_peered":"2024-04-23T19:04:12.391394+0000","last_clean":"2024-04-23T19:04:12.391394+0000","last_became_active":"2024-04-23T19:00:19.284449+0000","last_became_peered":"2024-04-23T19:00:19.284449+0000","last_unstale":"2024-04-23T19:04:12.391394+0000","last_undegraded":"2024-04-23T19:04:12.391394+0000","last_fullsized":"2024-04-23T19:04:12.391394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-04-23T19:04:12.390988+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-04-23T19:04:12.390988+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.390988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:33.137342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"116'17","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.737961+0000","last_change":"2024-04-23T19:04:08.737961+0000","last_active":"2024-04-23T19:04:08.737961+0000","last_peered":"2024-04-23T19:04:08.737961+0000","last_clean":"2024-04-23T19:04:08.737961+0000","last_became_active":"2024-04-23T19:00:21.309248+0000","last_became_peered":"2024-04-23T19:00:21.309248+0000","last_unstale":"2024-04-23T19:04:08.737961+0000","last_undegraded":"2024-04-23T19:04:08.737961+0000","last_fullsized":"2024-04-23T19:04:08.737961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'17","last_scrub_stamp":"2024-04-23T19:04:08.737701+0000","last_deep_scrub":"116'17","last_deep_scrub_stamp":"2024-04-23T19:04:08.737701+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.737701+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.905021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'138","reported_seq":420,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.174316+0000","last_change":"2024-04-23T19:04:19.174316+0000","last_active":"2024-04-23T19:04:19.174316+0000","last_peered":"2024-04-23T19:04:19.174316+0000","last_clean":"2024-04-23T19:04:19.174316+0000","last_became_active":"2024-04-23T19:00:23.325801+0000","last_became_peered":"2024-04-23T19:00:23.325801+0000","last_unstale":"2024-04-23T19:04:19.174316+0000","last_undegraded":"2024-04-23T19:04:19.174316+0000","last_fullsized":"2024-04-23T19:04:19.174316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:19.173947+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:19.173947+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.173947+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:08.298216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.076962+0000","last_change":"2024-04-23T19:04:35.076962+0000","last_active":"2024-04-23T19:04:35.076962+0000","last_peered":"2024-04-23T19:04:35.076962+0000","last_clean":"2024-04-23T19:04:35.076962+0000","last_became_active":"2024-04-23T19:00:25.331265+0000","last_became_peered":"2024-04-23T19:00:25.331265+0000","last_unstale":"2024-04-23T19:04:35.076962+0000","last_undegraded":"2024-04-23T19:04:35.076962+0000","last_fullsized":"2024-04-23T19:04:35.076962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:35.076708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:35.076708+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.076708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:13.761880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.459989+0000","last_change":"2024-04-23T19:04:17.459989+0000","last_active":"2024-04-23T19:04:17.459989+0000","last_peered":"2024-04-23T19:04:17.459989+0000","last_clean":"2024-04-23T19:04:17.459989+0000","last_became_active":"2024-04-23T19:00:17.305950+0000","last_became_peered":"2024-04-23T19:00:17.305950+0000","last_unstale":"2024-04-23T19:04:17.459989+0000","last_undegraded":"2024-04-23T19:04:17.459989+0000","last_fullsized":"2024-04-23T19:04:17.459989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.459688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.459688+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.459688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:34:01.304683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'48","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.824547+0000","last_change":"2024-04-23T19:04:28.824547+0000","last_active":"2024-04-23T19:04:28.824547+0000","last_peered":"2024-04-23T19:04:28.824547+0000","last_clean":"2024-04-23T19:04:28.824547+0000","last_became_active":"2024-04-23T19:00:15.261111+0000","last_became_peered":"2024-04-23T19:00:15.261111+0000","last_unstale":"2024-04-23T19:04:28.824547+0000","last_undegraded":"2024-04-23T19:04:28.824547+0000","last_fullsized":"2024-04-23T19:04:28.824547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:28.824270+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:28.824270+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.824270+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:39:03.922514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.109384+0000","last_change":"2024-04-23T19:04:21.109384+0000","last_active":"2024-04-23T19:04:21.109384+0000","last_peered":"2024-04-23T19:04:21.109384+0000","last_clean":"2024-04-23T19:04:21.109384+0000","last_became_active":"2024-04-23T19:00:19.291728+0000","last_became_peered":"2024-04-23T19:00:19.291728+0000","last_unstale":"2024-04-23T19:04:21.109384+0000","last_undegraded":"2024-04-23T19:04:21.109384+0000","last_fullsized":"2024-04-23T19:04:21.109384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.109080+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.109080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:58.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'37","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.384493+0000","last_change":"2024-04-23T19:04:30.384493+0000","last_active":"2024-04-23T19:04:30.384493+0000","last_peered":"2024-04-23T19:04:30.384493+0000","last_clean":"2024-04-23T19:04:30.384493+0000","last_became_active":"2024-04-23T19:00:21.311832+0000","last_became_peered":"2024-04-23T19:00:21.311832+0000","last_unstale":"2024-04-23T19:04:30.384493+0000","last_undegraded":"2024-04-23T19:04:30.384493+0000","last_fullsized":"2024-04-23T19:04:30.384493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'37","last_scrub_stamp":"2024-04-23T19:04:30.384199+0000","last_deep_scrub":"116'37","last_deep_scrub_stamp":"2024-04-23T19:04:30.384199+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.384199+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:58.703381+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.234718+0000","last_change":"2024-04-23T19:04:07.234718+0000","last_active":"2024-04-23T19:04:07.234718+0000","last_peered":"2024-04-23T19:04:07.234718+0000","last_clean":"2024-04-23T19:04:07.234718+0000","last_became_active":"2024-04-23T19:00:23.319384+0000","last_became_peered":"2024-04-23T19:00:23.319384+0000","last_unstale":"2024-04-23T19:04:07.234718+0000","last_undegraded":"2024-04-23T19:04:07.234718+0000","last_fullsized":"2024-04-23T19:04:07.234718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.234461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.234461+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.234461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:52.151995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"53'3","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.374016+0000","last_change":"2024-04-23T19:04:23.374087+0000","last_active":"2024-04-23T19:04:23.374016+0000","last_peered":"2024-04-23T19:04:23.374016+0000","last_clean":"2024-04-23T19:04:23.374016+0000","last_became_active":"2024-04-23T19:03:32.301278+0000","last_became_peered":"2024-04-23T19:03:32.301278+0000","last_unstale":"2024-04-23T19:04:23.374016+0000","last_undegraded":"2024-04-23T19:04:23.374016+0000","last_fullsized":"2024-04-23T19:04:23.374016+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-23T19:04:23.373892+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-23T19:04:23.373892+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.373892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:29.940129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'4","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.228280+0000","last_change":"2024-04-23T19:04:08.228280+0000","last_active":"2024-04-23T19:04:08.228280+0000","last_peered":"2024-04-23T19:04:08.228280+0000","last_clean":"2024-04-23T19:04:08.228280+0000","last_became_active":"2024-04-23T19:00:17.312574+0000","last_became_peered":"2024-04-23T19:00:17.312574+0000","last_unstale":"2024-04-23T19:04:08.228280+0000","last_undegraded":"2024-04-23T19:04:08.228280+0000","last_fullsized":"2024-04-23T19:04:08.228280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:08.228012+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:08.228012+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.228012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:30.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"116'119","reported_seq":373,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.960633+0000","last_change":"2024-04-23T19:04:20.960714+0000","last_active":"2024-04-23T19:04:20.960633+0000","last_peered":"2024-04-23T19:04:20.960633+0000","last_clean":"2024-04-23T19:04:20.960633+0000","last_became_active":"2024-04-23T19:00:03.632752+0000","last_became_peered":"2024-04-23T19:00:03.632752+0000","last_unstale":"2024-04-23T19:04:20.960633+0000","last_undegraded":"2024-04-23T19:04:20.960633+0000","last_fullsized":"2024-04-23T19:04:20.960633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'119","last_scrub_stamp":"2024-04-23T19:04:20.960444+0000","last_deep_scrub":"116'119","last_deep_scrub_stamp":"2024-04-23T19:04:20.960444+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.960444+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:32.947863+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.351480+0000","last_change":"2024-04-23T19:04:22.351532+0000","last_active":"2024-04-23T19:04:22.351480+0000","last_peered":"2024-04-23T19:04:22.351480+0000","last_clean":"2024-04-23T19:04:22.351480+0000","last_became_active":"2024-04-23T19:00:09.193280+0000","last_became_peered":"2024-04-23T19:00:09.193280+0000","last_unstale":"2024-04-23T19:04:22.351480+0000","last_undegraded":"2024-04-23T19:04:22.351480+0000","last_fullsized":"2024-04-23T19:04:22.351480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:22.351291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:22.351291+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.351291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:09.963762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'46","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.852854+0000","last_change":"2024-04-23T19:04:34.852916+0000","last_active":"2024-04-23T19:04:34.852854+0000","last_peered":"2024-04-23T19:04:34.852854+0000","last_clean":"2024-04-23T19:04:34.852854+0000","last_became_active":"2024-04-23T19:00:15.278931+0000","last_became_peered":"2024-04-23T19:00:15.278931+0000","last_unstale":"2024-04-23T19:04:34.852854+0000","last_undegraded":"2024-04-23T19:04:34.852854+0000","last_fullsized":"2024-04-23T19:04:34.852854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:34.852656+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:34.852656+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.852656+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:05.376687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.024537+0000","last_change":"2024-04-23T19:04:11.024537+0000","last_active":"2024-04-23T19:04:11.024537+0000","last_peered":"2024-04-23T19:04:11.024537+0000","last_clean":"2024-04-23T19:04:11.024537+0000","last_became_active":"2024-04-23T19:00:19.311630+0000","last_became_peered":"2024-04-23T19:00:19.311630+0000","last_unstale":"2024-04-23T19:04:11.024537+0000","last_undegraded":"2024-04-23T19:04:11.024537+0000","last_fullsized":"2024-04-23T19:04:11.024537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:11.024301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:11.024301+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.024301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.562463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'51","reported_seq":276,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.255459+0000","last_change":"2024-04-23T19:04:03.255459+0000","last_active":"2024-04-23T19:04:03.255459+0000","last_peered":"2024-04-23T19:04:03.255459+0000","last_clean":"2024-04-23T19:04:03.255459+0000","last_became_active":"2024-04-23T19:00:21.316362+0000","last_became_peered":"2024-04-23T19:00:21.316362+0000","last_unstale":"2024-04-23T19:04:03.255459+0000","last_undegraded":"2024-04-23T19:04:03.255459+0000","last_fullsized":"2024-04-23T19:04:03.255459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'51","last_scrub_stamp":"2024-04-23T19:04:03.255190+0000","last_deep_scrub":"116'51","last_deep_scrub_stamp":"2024-04-23T19:04:03.255190+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.255190+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:56.231137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.469410+0000","last_change":"2024-04-23T19:04:03.469410+0000","last_active":"2024-04-23T19:04:03.469410+0000","last_peered":"2024-04-23T19:04:03.469410+0000","last_clean":"2024-04-23T19:04:03.469410+0000","last_became_active":"2024-04-23T19:00:23.335052+0000","last_became_peered":"2024-04-23T19:00:23.335052+0000","last_unstale":"2024-04-23T19:04:03.469410+0000","last_undegraded":"2024-04-23T19:04:03.469410+0000","last_fullsized":"2024-04-23T19:04:03.469410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.469047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.469047+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.469047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:51.490970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.131462+0000","last_change":"2024-04-23T19:04:23.131462+0000","last_active":"2024-04-23T19:04:23.131462+0000","last_peered":"2024-04-23T19:04:23.131462+0000","last_clean":"2024-04-23T19:04:23.131462+0000","last_became_active":"2024-04-23T19:00:25.325506+0000","last_became_peered":"2024-04-23T19:00:25.325506+0000","last_unstale":"2024-04-23T19:04:23.131462+0000","last_undegraded":"2024-04-23T19:04:23.131462+0000","last_fullsized":"2024-04-23T19:04:23.131462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:23.131200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:23.131200+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.131200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:08.766056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"53'2","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.606031+0000","last_change":"2024-04-23T19:04:20.606031+0000","last_active":"2024-04-23T19:04:20.606031+0000","last_peered":"2024-04-23T19:04:20.606031+0000","last_clean":"2024-04-23T19:04:20.606031+0000","last_became_active":"2024-04-23T19:00:17.300877+0000","last_became_peered":"2024-04-23T19:00:17.300877+0000","last_unstale":"2024-04-23T19:04:20.606031+0000","last_undegraded":"2024-04-23T19:04:20.606031+0000","last_fullsized":"2024-04-23T19:04:20.606031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:20.605740+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:20.605740+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.605740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:27.818753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.961383+0000","last_change":"2024-04-23T19:04:21.961440+0000","last_active":"2024-04-23T19:04:21.961383+0000","last_peered":"2024-04-23T19:04:21.961383+0000","last_clean":"2024-04-23T19:04:21.961383+0000","last_became_active":"2024-04-23T19:00:09.198334+0000","last_became_peered":"2024-04-23T19:00:09.198334+0000","last_unstale":"2024-04-23T19:04:21.961383+0000","last_undegraded":"2024-04-23T19:04:21.961383+0000","last_fullsized":"2024-04-23T19:04:21.961383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.961161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.961161+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.961161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:19:09.753334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'64","reported_seq":273,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.591923+0000","last_change":"2024-04-23T19:04:26.591923+0000","last_active":"2024-04-23T19:04:26.591923+0000","last_peered":"2024-04-23T19:04:26.591923+0000","last_clean":"2024-04-23T19:04:26.591923+0000","last_became_active":"2024-04-23T19:00:15.275393+0000","last_became_peered":"2024-04-23T19:00:15.275393+0000","last_unstale":"2024-04-23T19:04:26.591923+0000","last_undegraded":"2024-04-23T19:04:26.591923+0000","last_fullsized":"2024-04-23T19:04:26.591923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'64","last_scrub_stamp":"2024-04-23T19:04:26.591668+0000","last_deep_scrub":"116'64","last_deep_scrub_stamp":"2024-04-23T19:04:26.591668+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.591668+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:05.686272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.355462+0000","last_change":"2024-04-23T19:04:16.355462+0000","last_active":"2024-04-23T19:04:16.355462+0000","last_peered":"2024-04-23T19:04:16.355462+0000","last_clean":"2024-04-23T19:04:16.355462+0000","last_became_active":"2024-04-23T19:00:19.295767+0000","last_became_peered":"2024-04-23T19:00:19.295767+0000","last_unstale":"2024-04-23T19:04:16.355462+0000","last_undegraded":"2024-04-23T19:04:16.355462+0000","last_fullsized":"2024-04-23T19:04:16.355462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:16.355181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:16.355181+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.355181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:29.416973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'155","reported_seq":470,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.452650+0000","last_change":"2024-04-23T19:04:18.452650+0000","last_active":"2024-04-23T19:04:18.452650+0000","last_peered":"2024-04-23T19:04:18.452650+0000","last_clean":"2024-04-23T19:04:18.452650+0000","last_became_active":"2024-04-23T19:00:21.322032+0000","last_became_peered":"2024-04-23T19:00:21.322032+0000","last_unstale":"2024-04-23T19:04:18.452650+0000","last_undegraded":"2024-04-23T19:04:18.452650+0000","last_fullsized":"2024-04-23T19:04:18.452650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'155","last_scrub_stamp":"2024-04-23T19:04:18.452249+0000","last_deep_scrub":"116'155","last_deep_scrub_stamp":"2024-04-23T19:04:18.452249+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.452249+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:26.229526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.057260+0000","last_change":"2024-04-23T19:04:32.057260+0000","last_active":"2024-04-23T19:04:32.057260+0000","last_peered":"2024-04-23T19:04:32.057260+0000","last_clean":"2024-04-23T19:04:32.057260+0000","last_became_active":"2024-04-23T19:00:23.343305+0000","last_became_peered":"2024-04-23T19:00:23.343305+0000","last_unstale":"2024-04-23T19:04:32.057260+0000","last_undegraded":"2024-04-23T19:04:32.057260+0000","last_fullsized":"2024-04-23T19:04:32.057260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:32.056885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:32.056885+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.056885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:39.269898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"53'3","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.462170+0000","last_change":"2024-04-23T19:04:21.462234+0000","last_active":"2024-04-23T19:04:21.462170+0000","last_peered":"2024-04-23T19:04:21.462170+0000","last_clean":"2024-04-23T19:04:21.462170+0000","last_became_active":"2024-04-23T19:03:32.286212+0000","last_became_peered":"2024-04-23T19:03:32.286212+0000","last_unstale":"2024-04-23T19:04:21.462170+0000","last_undegraded":"2024-04-23T19:04:21.462170+0000","last_fullsized":"2024-04-23T19:04:21.462170+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-23T19:04:21.461933+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-23T19:04:21.461933+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.461933+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:42.009153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'10","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.408224+0000","last_change":"2024-04-23T19:04:15.408224+0000","last_active":"2024-04-23T19:04:15.408224+0000","last_peered":"2024-04-23T19:04:15.408224+0000","last_clean":"2024-04-23T19:04:15.408224+0000","last_became_active":"2024-04-23T19:00:17.299105+0000","last_became_peered":"2024-04-23T19:00:17.299105+0000","last_unstale":"2024-04-23T19:04:15.408224+0000","last_undegraded":"2024-04-23T19:04:15.408224+0000","last_fullsized":"2024-04-23T19:04:15.408224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-04-23T19:04:15.407932+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-04-23T19:04:15.407932+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.407932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:31.170100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.949922+0000","last_change":"2024-04-23T19:04:04.949922+0000","last_active":"2024-04-23T19:04:04.949922+0000","last_peered":"2024-04-23T19:04:04.949922+0000","last_clean":"2024-04-23T19:04:04.949922+0000","last_became_active":"2024-04-23T19:00:09.194924+0000","last_became_peered":"2024-04-23T19:00:09.194924+0000","last_unstale":"2024-04-23T19:04:04.949922+0000","last_undegraded":"2024-04-23T19:04:04.949922+0000","last_fullsized":"2024-04-23T19:04:04.949922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.949681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.949681+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.949681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:07:40.982094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'28","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.421424+0000","last_change":"2024-04-23T19:04:13.421424+0000","last_active":"2024-04-23T19:04:13.421424+0000","last_peered":"2024-04-23T19:04:13.421424+0000","last_clean":"2024-04-23T19:04:13.421424+0000","last_became_active":"2024-04-23T19:03:32.289928+0000","last_became_peered":"2024-04-23T19:03:32.289928+0000","last_unstale":"2024-04-23T19:04:13.421424+0000","last_undegraded":"2024-04-23T19:04:13.421424+0000","last_fullsized":"2024-04-23T19:04:13.421424+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:13.420977+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:13.420977+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.420977+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:29.751910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.987211+0000","last_change":"2024-04-23T19:04:02.987211+0000","last_active":"2024-04-23T19:04:02.987211+0000","last_peered":"2024-04-23T19:04:02.987211+0000","last_clean":"2024-04-23T19:04:02.987211+0000","last_became_active":"2024-04-23T19:00:19.302061+0000","last_became_peered":"2024-04-23T19:00:19.302061+0000","last_unstale":"2024-04-23T19:04:02.987211+0000","last_undegraded":"2024-04-23T19:04:02.987211+0000","last_fullsized":"2024-04-23T19:04:02.987211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:02.986892+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:02.986892+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.986892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:20:45.106266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'25","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.078509+0000","last_change":"2024-04-23T19:04:29.078509+0000","last_active":"2024-04-23T19:04:29.078509+0000","last_peered":"2024-04-23T19:04:29.078509+0000","last_clean":"2024-04-23T19:04:29.078509+0000","last_became_active":"2024-04-23T19:00:21.313071+0000","last_became_peered":"2024-04-23T19:00:21.313071+0000","last_unstale":"2024-04-23T19:04:29.078509+0000","last_undegraded":"2024-04-23T19:04:29.078509+0000","last_fullsized":"2024-04-23T19:04:29.078509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'25","last_scrub_stamp":"2024-04-23T19:04:29.078196+0000","last_deep_scrub":"116'25","last_deep_scrub_stamp":"2024-04-23T19:04:29.078196+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.078196+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:49.625416+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.501448+0000","last_change":"2024-04-23T19:04:06.501448+0000","last_active":"2024-04-23T19:04:06.501448+0000","last_peered":"2024-04-23T19:04:06.501448+0000","last_clean":"2024-04-23T19:04:06.501448+0000","last_became_active":"2024-04-23T19:00:23.329171+0000","last_became_peered":"2024-04-23T19:00:23.329171+0000","last_unstale":"2024-04-23T19:04:06.501448+0000","last_undegraded":"2024-04-23T19:04:06.501448+0000","last_fullsized":"2024-04-23T19:04:06.501448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:06.501180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:06.501180+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.501180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:27.247533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:40.853529+0000","last_change":"2024-04-23T19:04:40.853529+0000","last_active":"2024-04-23T19:04:40.853529+0000","last_peered":"2024-04-23T19:04:40.853529+0000","last_clean":"2024-04-23T19:04:40.853529+0000","last_became_active":"2024-04-23T19:00:25.351950+0000","last_became_peered":"2024-04-23T19:00:25.351950+0000","last_unstale":"2024-04-23T19:04:40.853529+0000","last_undegraded":"2024-04-23T19:04:40.853529+0000","last_fullsized":"2024-04-23T19:04:40.853529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:40.853234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:40.853234+0000","last_clean_scrub_stamp":"2024-04-23T19:04:40.853234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:59.143729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"75'2","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.480207+0000","last_change":"2024-04-23T19:04:04.480207+0000","last_active":"2024-04-23T19:04:04.480207+0000","last_peered":"2024-04-23T19:04:04.480207+0000","last_clean":"2024-04-23T19:04:04.480207+0000","last_became_active":"2024-04-23T19:03:32.290579+0000","last_became_peered":"2024-04-23T19:03:32.290579+0000","last_unstale":"2024-04-23T19:04:04.480207+0000","last_undegraded":"2024-04-23T19:04:04.480207+0000","last_fullsized":"2024-04-23T19:04:04.480207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-04-23T19:04:04.479918+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-04-23T19:04:04.479918+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.479918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:51.783891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.326180+0000","last_change":"2024-04-23T19:04:23.326240+0000","last_active":"2024-04-23T19:04:23.326180+0000","last_peered":"2024-04-23T19:04:23.326180+0000","last_clean":"2024-04-23T19:04:23.326180+0000","last_became_active":"2024-04-23T19:00:09.200556+0000","last_became_peered":"2024-04-23T19:00:09.200556+0000","last_unstale":"2024-04-23T19:04:23.326180+0000","last_undegraded":"2024-04-23T19:04:23.326180+0000","last_fullsized":"2024-04-23T19:04:23.326180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:23.325991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:23.325991+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.325991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:43.873211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'36","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.089760+0000","last_change":"2024-04-23T19:04:26.089760+0000","last_active":"2024-04-23T19:04:26.089760+0000","last_peered":"2024-04-23T19:04:26.089760+0000","last_clean":"2024-04-23T19:04:26.089760+0000","last_became_active":"2024-04-23T19:00:15.272625+0000","last_became_peered":"2024-04-23T19:00:15.272625+0000","last_unstale":"2024-04-23T19:04:26.089760+0000","last_undegraded":"2024-04-23T19:04:26.089760+0000","last_fullsized":"2024-04-23T19:04:26.089760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:26.089464+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:26.089464+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.089464+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:32.271520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"116'2","reported_seq":293,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.510991+0000","last_change":"2024-04-23T19:04:11.510991+0000","last_active":"2024-04-23T19:04:11.510991+0000","last_peered":"2024-04-23T19:04:11.510991+0000","last_clean":"2024-04-23T19:04:11.510991+0000","last_became_active":"2024-04-23T19:00:19.305953+0000","last_became_peered":"2024-04-23T19:00:19.305953+0000","last_unstale":"2024-04-23T19:04:11.510991+0000","last_undegraded":"2024-04-23T19:04:11.510991+0000","last_fullsized":"2024-04-23T19:04:11.510991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:11.510730+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.510730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.510730+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:27.272898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"116'18","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.747883+0000","last_change":"2024-04-23T19:04:25.747883+0000","last_active":"2024-04-23T19:04:25.747883+0000","last_peered":"2024-04-23T19:04:25.747883+0000","last_clean":"2024-04-23T19:04:25.747883+0000","last_became_active":"2024-04-23T19:00:21.301182+0000","last_became_peered":"2024-04-23T19:00:21.301182+0000","last_unstale":"2024-04-23T19:04:25.747883+0000","last_undegraded":"2024-04-23T19:04:25.747883+0000","last_fullsized":"2024-04-23T19:04:25.747883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-04-23T19:04:25.747605+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-04-23T19:04:25.747605+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.747605+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:08.878174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.114197+0000","last_change":"2024-04-23T19:04:22.114197+0000","last_active":"2024-04-23T19:04:22.114197+0000","last_peered":"2024-04-23T19:04:22.114197+0000","last_clean":"2024-04-23T19:04:22.114197+0000","last_became_active":"2024-04-23T19:00:23.333626+0000","last_became_peered":"2024-04-23T19:00:23.333626+0000","last_unstale":"2024-04-23T19:04:22.114197+0000","last_undegraded":"2024-04-23T19:04:22.114197+0000","last_fullsized":"2024-04-23T19:04:22.114197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:22.113937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:22.113937+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.113937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:52.437348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"98'6","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.354100+0000","last_change":"2024-04-23T19:04:37.354100+0000","last_active":"2024-04-23T19:04:37.354100+0000","last_peered":"2024-04-23T19:04:37.354100+0000","last_clean":"2024-04-23T19:04:37.354100+0000","last_became_active":"2024-04-23T19:00:25.337375+0000","last_became_peered":"2024-04-23T19:00:25.337375+0000","last_unstale":"2024-04-23T19:04:37.354100+0000","last_undegraded":"2024-04-23T19:04:37.354100+0000","last_fullsized":"2024-04-23T19:04:37.354100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:37.353833+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:37.353833+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.353833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:24.829562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.474072+0000","last_change":"2024-04-23T19:04:03.474072+0000","last_active":"2024-04-23T19:04:03.474072+0000","last_peered":"2024-04-23T19:04:03.474072+0000","last_clean":"2024-04-23T19:04:03.474072+0000","last_became_active":"2024-04-23T19:03:32.290155+0000","last_became_peered":"2024-04-23T19:03:32.290155+0000","last_unstale":"2024-04-23T19:04:03.474072+0000","last_undegraded":"2024-04-23T19:04:03.474072+0000","last_fullsized":"2024-04-23T19:04:03.474072+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.473795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.473795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.473795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:46.953046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.308751+0000","last_change":"2024-04-23T19:04:26.308751+0000","last_active":"2024-04-23T19:04:26.308751+0000","last_peered":"2024-04-23T19:04:26.308751+0000","last_clean":"2024-04-23T19:04:26.308751+0000","last_became_active":"2024-04-23T19:00:15.266072+0000","last_became_peered":"2024-04-23T19:00:15.266072+0000","last_unstale":"2024-04-23T19:04:26.308751+0000","last_undegraded":"2024-04-23T19:04:26.308751+0000","last_fullsized":"2024-04-23T19:04:26.308751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:26.308458+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:26.308458+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.308458+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:33.521471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.435963+0000","last_change":"2024-04-23T19:04:00.435963+0000","last_active":"2024-04-23T19:04:00.435963+0000","last_peered":"2024-04-23T19:04:00.435963+0000","last_clean":"2024-04-23T19:04:00.435963+0000","last_became_active":"2024-04-23T19:03:32.289863+0000","last_became_peered":"2024-04-23T19:03:32.289863+0000","last_unstale":"2024-04-23T19:04:00.435963+0000","last_undegraded":"2024-04-23T19:04:00.435963+0000","last_fullsized":"2024-04-23T19:04:00.435963+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.435859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.435859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:34.052330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.491378+0000","last_change":"2024-04-23T19:04:09.491378+0000","last_active":"2024-04-23T19:04:09.491378+0000","last_peered":"2024-04-23T19:04:09.491378+0000","last_clean":"2024-04-23T19:04:09.491378+0000","last_became_active":"2024-04-23T19:00:19.304208+0000","last_became_peered":"2024-04-23T19:00:19.304208+0000","last_unstale":"2024-04-23T19:04:09.491378+0000","last_undegraded":"2024-04-23T19:04:09.491378+0000","last_fullsized":"2024-04-23T19:04:09.491378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.491110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.491110+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.491110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:25.822043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'46","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.628738+0000","last_change":"2024-04-23T19:04:15.628738+0000","last_active":"2024-04-23T19:04:15.628738+0000","last_peered":"2024-04-23T19:04:15.628738+0000","last_clean":"2024-04-23T19:04:15.628738+0000","last_became_active":"2024-04-23T19:00:21.316378+0000","last_became_peered":"2024-04-23T19:00:21.316378+0000","last_unstale":"2024-04-23T19:04:15.628738+0000","last_undegraded":"2024-04-23T19:04:15.628738+0000","last_fullsized":"2024-04-23T19:04:15.628738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:15.628439+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:15.628439+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.628439+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:22.658481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.119300+0000","last_change":"2024-04-23T19:04:33.119300+0000","last_active":"2024-04-23T19:04:33.119300+0000","last_peered":"2024-04-23T19:04:33.119300+0000","last_clean":"2024-04-23T19:04:33.119300+0000","last_became_active":"2024-04-23T19:00:23.322286+0000","last_became_peered":"2024-04-23T19:00:23.322286+0000","last_unstale":"2024-04-23T19:04:33.119300+0000","last_undegraded":"2024-04-23T19:04:33.119300+0000","last_fullsized":"2024-04-23T19:04:33.119300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:33.119025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:33.119025+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.119025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:16.249594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"53'4","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.379184+0000","last_change":"2024-04-23T19:04:01.379184+0000","last_active":"2024-04-23T19:04:01.379184+0000","last_peered":"2024-04-23T19:04:01.379184+0000","last_clean":"2024-04-23T19:04:01.379184+0000","last_became_active":"2024-04-23T19:00:25.324797+0000","last_became_peered":"2024-04-23T19:00:25.324797+0000","last_unstale":"2024-04-23T19:04:01.379184+0000","last_undegraded":"2024-04-23T19:04:01.379184+0000","last_fullsized":"2024-04-23T19:04:01.379184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:01.379039+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.379039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:04.821220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"57'8","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.485633+0000","last_change":"2024-04-23T19:04:08.485633+0000","last_active":"2024-04-23T19:04:08.485633+0000","last_peered":"2024-04-23T19:04:08.485633+0000","last_clean":"2024-04-23T19:04:08.485633+0000","last_became_active":"2024-04-23T19:00:17.317317+0000","last_became_peered":"2024-04-23T19:00:17.317317+0000","last_unstale":"2024-04-23T19:04:08.485633+0000","last_undegraded":"2024-04-23T19:04:08.485633+0000","last_fullsized":"2024-04-23T19:04:08.485633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'8","last_scrub_stamp":"2024-04-23T19:04:08.485266+0000","last_deep_scrub":"57'8","last_deep_scrub_stamp":"2024-04-23T19:04:08.485266+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.485266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:00.652586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'44","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.415163+0000","last_change":"2024-04-23T19:04:22.415163+0000","last_active":"2024-04-23T19:04:22.415163+0000","last_peered":"2024-04-23T19:04:22.415163+0000","last_clean":"2024-04-23T19:04:22.415163+0000","last_became_active":"2024-04-23T19:03:32.300907+0000","last_became_peered":"2024-04-23T19:03:32.300907+0000","last_unstale":"2024-04-23T19:04:22.415163+0000","last_undegraded":"2024-04-23T19:04:22.415163+0000","last_fullsized":"2024-04-23T19:04:22.415163+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:22.414779+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:22.414779+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.414779+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:28.596835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.982679+0000","last_change":"2024-04-23T19:04:22.982818+0000","last_active":"2024-04-23T19:04:22.982679+0000","last_peered":"2024-04-23T19:04:22.982679+0000","last_clean":"2024-04-23T19:04:22.982679+0000","last_became_active":"2024-04-23T19:00:09.583082+0000","last_became_peered":"2024-04-23T19:00:09.583082+0000","last_unstale":"2024-04-23T19:04:22.982679+0000","last_undegraded":"2024-04-23T19:04:22.982679+0000","last_fullsized":"2024-04-23T19:04:22.982679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:22.982421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:22.982421+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.982421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:19.523444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.221738+0000","last_change":"2024-04-23T19:04:03.221738+0000","last_active":"2024-04-23T19:04:03.221738+0000","last_peered":"2024-04-23T19:04:03.221738+0000","last_clean":"2024-04-23T19:04:03.221738+0000","last_became_active":"2024-04-23T19:00:19.307199+0000","last_became_peered":"2024-04-23T19:00:19.307199+0000","last_unstale":"2024-04-23T19:04:03.221738+0000","last_undegraded":"2024-04-23T19:04:03.221738+0000","last_fullsized":"2024-04-23T19:04:03.221738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:03.221480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:03.221480+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.221480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:58.768547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"116'21","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.516993+0000","last_change":"2024-04-23T19:04:10.516993+0000","last_active":"2024-04-23T19:04:10.516993+0000","last_peered":"2024-04-23T19:04:10.516993+0000","last_clean":"2024-04-23T19:04:10.516993+0000","last_became_active":"2024-04-23T19:03:32.300085+0000","last_became_peered":"2024-04-23T19:03:32.300085+0000","last_unstale":"2024-04-23T19:04:10.516993+0000","last_undegraded":"2024-04-23T19:04:10.516993+0000","last_fullsized":"2024-04-23T19:04:10.516993+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-04-23T19:04:10.516730+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-04-23T19:04:10.516730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.516730+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:31.263084+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'139","reported_seq":375,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.335312+0000","last_change":"2024-04-23T19:04:31.335427+0000","last_active":"2024-04-23T19:04:31.335312+0000","last_peered":"2024-04-23T19:04:31.335312+0000","last_clean":"2024-04-23T19:04:31.335312+0000","last_became_active":"2024-04-23T19:00:23.324752+0000","last_became_peered":"2024-04-23T19:00:23.324752+0000","last_unstale":"2024-04-23T19:04:31.335312+0000","last_undegraded":"2024-04-23T19:04:31.335312+0000","last_fullsized":"2024-04-23T19:04:31.335312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'139","last_scrub_stamp":"2024-04-23T19:04:31.335042+0000","last_deep_scrub":"116'139","last_deep_scrub_stamp":"2024-04-23T19:04:31.335042+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.335042+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:14.465611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"52'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:38.806896+0000","last_change":"2024-04-23T19:04:38.806896+0000","last_active":"2024-04-23T19:04:38.806896+0000","last_peered":"2024-04-23T19:04:38.806896+0000","last_clean":"2024-04-23T19:04:38.806896+0000","last_became_active":"2024-04-23T19:00:25.348328+0000","last_became_peered":"2024-04-23T19:00:25.348328+0000","last_unstale":"2024-04-23T19:04:38.806896+0000","last_undegraded":"2024-04-23T19:04:38.806896+0000","last_fullsized":"2024-04-23T19:04:38.806896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:38.806605+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:38.806605+0000","last_clean_scrub_stamp":"2024-04-23T19:04:38.806605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:15.414879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"89'2","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.722695+0000","last_change":"2024-04-23T19:04:11.722695+0000","last_active":"2024-04-23T19:04:11.722695+0000","last_peered":"2024-04-23T19:04:11.722695+0000","last_clean":"2024-04-23T19:04:11.722695+0000","last_became_active":"2024-04-23T19:00:17.303768+0000","last_became_peered":"2024-04-23T19:00:17.303768+0000","last_unstale":"2024-04-23T19:04:11.722695+0000","last_undegraded":"2024-04-23T19:04:11.722695+0000","last_fullsized":"2024-04-23T19:04:11.722695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:11.722335+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.722335+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.722335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:27.484503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'40","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.851818+0000","last_change":"2024-04-23T19:04:31.851818+0000","last_active":"2024-04-23T19:04:31.851818+0000","last_peered":"2024-04-23T19:04:31.851818+0000","last_clean":"2024-04-23T19:04:31.851818+0000","last_became_active":"2024-04-23T19:00:15.271354+0000","last_became_peered":"2024-04-23T19:00:15.271354+0000","last_unstale":"2024-04-23T19:04:31.851818+0000","last_undegraded":"2024-04-23T19:04:31.851818+0000","last_fullsized":"2024-04-23T19:04:31.851818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:31.851555+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:31.851555+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.851555+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:19.327284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.437215+0000","last_change":"2024-04-23T19:04:26.437215+0000","last_active":"2024-04-23T19:04:26.437215+0000","last_peered":"2024-04-23T19:04:26.437215+0000","last_clean":"2024-04-23T19:04:26.437215+0000","last_became_active":"2024-04-23T19:03:32.304243+0000","last_became_peered":"2024-04-23T19:03:32.304243+0000","last_unstale":"2024-04-23T19:04:26.437215+0000","last_undegraded":"2024-04-23T19:04:26.437215+0000","last_fullsized":"2024-04-23T19:04:26.437215+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:26.436948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:26.436948+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.436948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:03.316343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.140787+0000","last_change":"2024-04-23T19:04:19.140787+0000","last_active":"2024-04-23T19:04:19.140787+0000","last_peered":"2024-04-23T19:04:19.140787+0000","last_clean":"2024-04-23T19:04:19.140787+0000","last_became_active":"2024-04-23T19:00:19.287442+0000","last_became_peered":"2024-04-23T19:00:19.287442+0000","last_unstale":"2024-04-23T19:04:19.140787+0000","last_undegraded":"2024-04-23T19:04:19.140787+0000","last_fullsized":"2024-04-23T19:04:19.140787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:19.140514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:19.140514+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.140514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:35:34.902682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"116'15","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.914749+0000","last_change":"2024-04-23T19:04:05.914749+0000","last_active":"2024-04-23T19:04:05.914749+0000","last_peered":"2024-04-23T19:04:05.914749+0000","last_clean":"2024-04-23T19:04:05.914749+0000","last_became_active":"2024-04-23T19:00:21.299155+0000","last_became_peered":"2024-04-23T19:00:21.299155+0000","last_unstale":"2024-04-23T19:04:05.914749+0000","last_undegraded":"2024-04-23T19:04:05.914749+0000","last_fullsized":"2024-04-23T19:04:05.914749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:05.914386+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:05.914386+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.914386+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:41.719119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'138","reported_seq":452,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:03.816660+0000","last_change":"2024-04-23T19:04:03.816660+0000","last_active":"2024-04-23T19:04:03.816660+0000","last_peered":"2024-04-23T19:04:03.816660+0000","last_clean":"2024-04-23T19:04:03.816660+0000","last_became_active":"2024-04-23T19:00:23.311207+0000","last_became_peered":"2024-04-23T19:00:23.311207+0000","last_unstale":"2024-04-23T19:04:03.816660+0000","last_undegraded":"2024-04-23T19:04:03.816660+0000","last_fullsized":"2024-04-23T19:04:03.816660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:03.816386+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:03.816386+0000","last_clean_scrub_stamp":"2024-04-23T19:04:03.816386+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:51.838308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":131,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.706810+0000","last_change":"2024-04-23T19:04:32.706863+0000","last_active":"2024-04-23T19:04:32.706810+0000","last_peered":"2024-04-23T19:04:32.706810+0000","last_clean":"2024-04-23T19:04:32.706810+0000","last_became_active":"2024-04-23T19:01:39.095870+0000","last_became_peered":"2024-04-23T19:01:39.095870+0000","last_unstale":"2024-04-23T19:04:32.706810+0000","last_undegraded":"2024-04-23T19:04:32.706810+0000","last_fullsized":"2024-04-23T19:04:32.706810+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:32.706615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:32.706615+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.706615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:01:20.182344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.155260+0000","last_change":"2024-04-23T19:04:30.155315+0000","last_active":"2024-04-23T19:04:30.155260+0000","last_peered":"2024-04-23T19:04:30.155260+0000","last_clean":"2024-04-23T19:04:30.155260+0000","last_became_active":"2024-04-23T19:00:17.300106+0000","last_became_peered":"2024-04-23T19:00:17.300106+0000","last_unstale":"2024-04-23T19:04:30.155260+0000","last_undegraded":"2024-04-23T19:04:30.155260+0000","last_fullsized":"2024-04-23T19:04:30.155260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:30.155040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:30.155040+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.155040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:07.034436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'44","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.623374+0000","last_change":"2024-04-23T19:04:25.623374+0000","last_active":"2024-04-23T19:04:25.623374+0000","last_peered":"2024-04-23T19:04:25.623374+0000","last_clean":"2024-04-23T19:04:25.623374+0000","last_became_active":"2024-04-23T19:00:15.261767+0000","last_became_peered":"2024-04-23T19:00:15.261767+0000","last_unstale":"2024-04-23T19:04:25.623374+0000","last_undegraded":"2024-04-23T19:04:25.623374+0000","last_fullsized":"2024-04-23T19:04:25.623374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:25.623097+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:25.623097+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.623097+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:08.753667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.116257+0000","last_change":"2024-04-23T19:04:11.116257+0000","last_active":"2024-04-23T19:04:11.116257+0000","last_peered":"2024-04-23T19:04:11.116257+0000","last_clean":"2024-04-23T19:04:11.116257+0000","last_became_active":"2024-04-23T19:00:09.199197+0000","last_became_peered":"2024-04-23T19:00:09.199197+0000","last_unstale":"2024-04-23T19:04:11.116257+0000","last_undegraded":"2024-04-23T19:04:11.116257+0000","last_fullsized":"2024-04-23T19:04:11.116257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:11.115902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:11.115902+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.115902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:03.194983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.801097+0000","last_change":"2024-04-23T19:04:17.801097+0000","last_active":"2024-04-23T19:04:17.801097+0000","last_peered":"2024-04-23T19:04:17.801097+0000","last_clean":"2024-04-23T19:04:17.801097+0000","last_became_active":"2024-04-23T19:00:19.297162+0000","last_became_peered":"2024-04-23T19:00:19.297162+0000","last_unstale":"2024-04-23T19:04:17.801097+0000","last_undegraded":"2024-04-23T19:04:17.801097+0000","last_fullsized":"2024-04-23T19:04:17.801097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.800847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.800847+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.800847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:38.348067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'57","reported_seq":283,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.983092+0000","last_change":"2024-04-23T19:04:18.983092+0000","last_active":"2024-04-23T19:04:18.983092+0000","last_peered":"2024-04-23T19:04:18.983092+0000","last_clean":"2024-04-23T19:04:18.983092+0000","last_became_active":"2024-04-23T19:00:21.312897+0000","last_became_peered":"2024-04-23T19:00:21.312897+0000","last_unstale":"2024-04-23T19:04:18.983092+0000","last_undegraded":"2024-04-23T19:04:18.983092+0000","last_fullsized":"2024-04-23T19:04:18.983092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'57","last_scrub_stamp":"2024-04-23T19:04:18.982820+0000","last_deep_scrub":"116'57","last_deep_scrub_stamp":"2024-04-23T19:04:18.982820+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.982820+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.150140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.832735+0000","last_change":"2024-04-23T19:04:00.832735+0000","last_active":"2024-04-23T19:04:00.832735+0000","last_peered":"2024-04-23T19:04:00.832735+0000","last_clean":"2024-04-23T19:04:00.832735+0000","last_became_active":"2024-04-23T19:00:23.318066+0000","last_became_peered":"2024-04-23T19:00:23.318066+0000","last_unstale":"2024-04-23T19:04:00.832735+0000","last_undegraded":"2024-04-23T19:04:00.832735+0000","last_fullsized":"2024-04-23T19:04:00.832735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.832522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.832522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:03.723382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.353834+0000","last_change":"2024-04-23T19:04:36.353834+0000","last_active":"2024-04-23T19:04:36.353834+0000","last_peered":"2024-04-23T19:04:36.353834+0000","last_clean":"2024-04-23T19:04:36.353834+0000","last_became_active":"2024-04-23T19:00:25.334794+0000","last_became_peered":"2024-04-23T19:00:25.334794+0000","last_unstale":"2024-04-23T19:04:36.353834+0000","last_undegraded":"2024-04-23T19:04:36.353834+0000","last_fullsized":"2024-04-23T19:04:36.353834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:36.353581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:36.353581+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.353581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:02.273912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:00.361389+0000","last_change":"2024-04-23T19:04:00.361389+0000","last_active":"2024-04-23T19:04:00.361389+0000","last_peered":"2024-04-23T19:04:00.361389+0000","last_clean":"2024-04-23T19:04:00.361389+0000","last_became_active":"2024-04-23T19:00:25.315655+0000","last_became_peered":"2024-04-23T19:00:25.315655+0000","last_unstale":"2024-04-23T19:04:00.361389+0000","last_undegraded":"2024-04-23T19:04:00.361389+0000","last_fullsized":"2024-04-23T19:04:00.361389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:00.361115+0000","last_clean_scrub_stamp":"2024-04-23T19:04:00.361115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:00.899277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"89'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.946608+0000","last_change":"2024-04-23T19:04:06.946608+0000","last_active":"2024-04-23T19:04:06.946608+0000","last_peered":"2024-04-23T19:04:06.946608+0000","last_clean":"2024-04-23T19:04:06.946608+0000","last_became_active":"2024-04-23T19:00:17.324075+0000","last_became_peered":"2024-04-23T19:00:17.324075+0000","last_unstale":"2024-04-23T19:04:06.946608+0000","last_undegraded":"2024-04-23T19:04:06.946608+0000","last_fullsized":"2024-04-23T19:04:06.946608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-04-23T19:04:06.946339+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-04-23T19:04:06.946339+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.946339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:50.425590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'42","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.157829+0000","last_change":"2024-04-23T19:04:24.157829+0000","last_active":"2024-04-23T19:04:24.157829+0000","last_peered":"2024-04-23T19:04:24.157829+0000","last_clean":"2024-04-23T19:04:24.157829+0000","last_became_active":"2024-04-23T19:00:15.270927+0000","last_became_peered":"2024-04-23T19:00:15.270927+0000","last_unstale":"2024-04-23T19:04:24.157829+0000","last_undegraded":"2024-04-23T19:04:24.157829+0000","last_fullsized":"2024-04-23T19:04:24.157829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:24.157583+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:24.157583+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.157583+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:11.770054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.535624+0000","last_change":"2024-04-23T19:04:07.535679+0000","last_active":"2024-04-23T19:04:07.535624+0000","last_peered":"2024-04-23T19:04:07.535624+0000","last_clean":"2024-04-23T19:04:07.535624+0000","last_became_active":"2024-04-23T19:03:32.294324+0000","last_became_peered":"2024-04-23T19:03:32.294324+0000","last_unstale":"2024-04-23T19:04:07.535624+0000","last_undegraded":"2024-04-23T19:04:07.535624+0000","last_fullsized":"2024-04-23T19:04:07.535624+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.535419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.535419+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.535419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:29.334892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'26","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.801829+0000","last_change":"2024-04-23T19:04:06.801829+0000","last_active":"2024-04-23T19:04:06.801829+0000","last_peered":"2024-04-23T19:04:06.801829+0000","last_clean":"2024-04-23T19:04:06.801829+0000","last_became_active":"2024-04-23T19:00:21.317682+0000","last_became_peered":"2024-04-23T19:00:21.317682+0000","last_unstale":"2024-04-23T19:04:06.801829+0000","last_undegraded":"2024-04-23T19:04:06.801829+0000","last_fullsized":"2024-04-23T19:04:06.801829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-04-23T19:04:06.801529+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-04-23T19:04:06.801529+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.801529+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:27.547883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.817729+0000","last_change":"2024-04-23T19:04:02.817782+0000","last_active":"2024-04-23T19:04:02.817729+0000","last_peered":"2024-04-23T19:04:02.817729+0000","last_clean":"2024-04-23T19:04:02.817729+0000","last_became_active":"2024-04-23T19:00:23.311610+0000","last_became_peered":"2024-04-23T19:00:23.311610+0000","last_unstale":"2024-04-23T19:04:02.817729+0000","last_undegraded":"2024-04-23T19:04:02.817729+0000","last_fullsized":"2024-04-23T19:04:02.817729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.817544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.817544+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.817544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:02.070329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.728491+0000","last_change":"2024-04-23T19:04:09.728491+0000","last_active":"2024-04-23T19:04:09.728491+0000","last_peered":"2024-04-23T19:04:09.728491+0000","last_clean":"2024-04-23T19:04:09.728491+0000","last_became_active":"2024-04-23T19:00:25.334166+0000","last_became_peered":"2024-04-23T19:00:25.334166+0000","last_unstale":"2024-04-23T19:04:09.728491+0000","last_undegraded":"2024-04-23T19:04:09.728491+0000","last_fullsized":"2024-04-23T19:04:09.728491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.728213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.728213+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.728213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:21.715632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":173,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.509986+0000","last_change":"2024-04-23T19:04:08.510050+0000","last_active":"2024-04-23T19:04:08.509986+0000","last_peered":"2024-04-23T19:04:08.509986+0000","last_clean":"2024-04-23T19:04:08.509986+0000","last_became_active":"2024-04-23T19:03:32.294687+0000","last_became_peered":"2024-04-23T19:03:32.294687+0000","last_unstale":"2024-04-23T19:04:08.509986+0000","last_undegraded":"2024-04-23T19:04:08.509986+0000","last_fullsized":"2024-04-23T19:04:08.509986+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:08.509782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:08.509782+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.509782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:38.833192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'66","reported_seq":274,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.018648+0000","last_change":"2024-04-23T19:04:27.018707+0000","last_active":"2024-04-23T19:04:27.018648+0000","last_peered":"2024-04-23T19:04:27.018648+0000","last_clean":"2024-04-23T19:04:27.018648+0000","last_became_active":"2024-04-23T19:00:15.279621+0000","last_became_peered":"2024-04-23T19:00:15.279621+0000","last_unstale":"2024-04-23T19:04:27.018648+0000","last_undegraded":"2024-04-23T19:04:27.018648+0000","last_fullsized":"2024-04-23T19:04:27.018648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'66","last_scrub_stamp":"2024-04-23T19:04:27.018451+0000","last_deep_scrub":"116'66","last_deep_scrub_stamp":"2024-04-23T19:04:27.018451+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.018451+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:34.048493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.821554+0000","last_change":"2024-04-23T19:04:21.821554+0000","last_active":"2024-04-23T19:04:21.821554+0000","last_peered":"2024-04-23T19:04:21.821554+0000","last_clean":"2024-04-23T19:04:21.821554+0000","last_became_active":"2024-04-23T19:00:19.301119+0000","last_became_peered":"2024-04-23T19:00:19.301119+0000","last_unstale":"2024-04-23T19:04:21.821554+0000","last_undegraded":"2024-04-23T19:04:21.821554+0000","last_fullsized":"2024-04-23T19:04:21.821554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.821293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.821293+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.821293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:03.297512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"116'13","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.554379+0000","last_change":"2024-04-23T19:04:13.554379+0000","last_active":"2024-04-23T19:04:13.554379+0000","last_peered":"2024-04-23T19:04:13.554379+0000","last_clean":"2024-04-23T19:04:13.554379+0000","last_became_active":"2024-04-23T19:00:21.314725+0000","last_became_peered":"2024-04-23T19:00:21.314725+0000","last_unstale":"2024-04-23T19:04:13.554379+0000","last_undegraded":"2024-04-23T19:04:13.554379+0000","last_fullsized":"2024-04-23T19:04:13.554379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'13","last_scrub_stamp":"2024-04-23T19:04:13.554081+0000","last_deep_scrub":"116'13","last_deep_scrub_stamp":"2024-04-23T19:04:13.554081+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.554081+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:57.399076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.952994+0000","last_change":"2024-04-23T19:04:02.953047+0000","last_active":"2024-04-23T19:04:02.952994+0000","last_peered":"2024-04-23T19:04:02.952994+0000","last_clean":"2024-04-23T19:04:02.952994+0000","last_became_active":"2024-04-23T19:00:23.326913+0000","last_became_peered":"2024-04-23T19:00:23.326913+0000","last_unstale":"2024-04-23T19:04:02.952994+0000","last_undegraded":"2024-04-23T19:04:02.952994+0000","last_fullsized":"2024-04-23T19:04:02.952994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.952795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.952795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.952795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:30.524113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":131,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.751809+0000","last_change":"2024-04-23T19:04:33.751867+0000","last_active":"2024-04-23T19:04:33.751809+0000","last_peered":"2024-04-23T19:04:33.751809+0000","last_clean":"2024-04-23T19:04:33.751809+0000","last_became_active":"2024-04-23T19:01:39.099230+0000","last_became_peered":"2024-04-23T19:01:39.099230+0000","last_unstale":"2024-04-23T19:04:33.751809+0000","last_undegraded":"2024-04-23T19:04:33.751809+0000","last_fullsized":"2024-04-23T19:04:33.751809+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:33.751598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:33.751598+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.751598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:36.996632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"98'6","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.737569+0000","last_change":"2024-04-23T19:04:13.737569+0000","last_active":"2024-04-23T19:04:13.737569+0000","last_peered":"2024-04-23T19:04:13.737569+0000","last_clean":"2024-04-23T19:04:13.737569+0000","last_became_active":"2024-04-23T19:00:17.303666+0000","last_became_peered":"2024-04-23T19:00:17.303666+0000","last_unstale":"2024-04-23T19:04:13.737569+0000","last_undegraded":"2024-04-23T19:04:13.737569+0000","last_fullsized":"2024-04-23T19:04:13.737569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:13.737281+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:13.737281+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.737281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.217889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'48","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.335181+0000","last_change":"2024-04-23T19:04:21.335249+0000","last_active":"2024-04-23T19:04:21.335181+0000","last_peered":"2024-04-23T19:04:21.335181+0000","last_clean":"2024-04-23T19:04:21.335181+0000","last_became_active":"2024-04-23T19:00:15.271607+0000","last_became_peered":"2024-04-23T19:00:15.271607+0000","last_unstale":"2024-04-23T19:04:21.335181+0000","last_undegraded":"2024-04-23T19:04:21.335181+0000","last_fullsized":"2024-04-23T19:04:21.335181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'48","last_scrub_stamp":"2024-04-23T19:04:21.334981+0000","last_deep_scrub":"116'48","last_deep_scrub_stamp":"2024-04-23T19:04:21.334981+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.334981+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:28.365024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.950205+0000","last_change":"2024-04-23T19:04:04.950205+0000","last_active":"2024-04-23T19:04:04.950205+0000","last_peered":"2024-04-23T19:04:04.950205+0000","last_clean":"2024-04-23T19:04:04.950205+0000","last_became_active":"2024-04-23T19:00:19.308372+0000","last_became_peered":"2024-04-23T19:00:19.308372+0000","last_unstale":"2024-04-23T19:04:04.950205+0000","last_undegraded":"2024-04-23T19:04:04.950205+0000","last_fullsized":"2024-04-23T19:04:04.950205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.949925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.949925+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.949925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:39.148380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'29","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.833084+0000","last_change":"2024-04-23T19:04:04.833084+0000","last_active":"2024-04-23T19:04:04.833084+0000","last_peered":"2024-04-23T19:04:04.833084+0000","last_clean":"2024-04-23T19:04:04.833084+0000","last_became_active":"2024-04-23T19:00:21.317521+0000","last_became_peered":"2024-04-23T19:00:21.317521+0000","last_unstale":"2024-04-23T19:04:04.833084+0000","last_undegraded":"2024-04-23T19:04:04.833084+0000","last_fullsized":"2024-04-23T19:04:04.833084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'29","last_scrub_stamp":"2024-04-23T19:04:04.832764+0000","last_deep_scrub":"116'29","last_deep_scrub_stamp":"2024-04-23T19:04:04.832764+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.832764+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:35.156175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.154379+0000","last_change":"2024-04-23T19:04:21.154432+0000","last_active":"2024-04-23T19:04:21.154379+0000","last_peered":"2024-04-23T19:04:21.154379+0000","last_clean":"2024-04-23T19:04:21.154379+0000","last_became_active":"2024-04-23T19:00:23.331109+0000","last_became_peered":"2024-04-23T19:00:23.331109+0000","last_unstale":"2024-04-23T19:04:21.154379+0000","last_undegraded":"2024-04-23T19:04:21.154379+0000","last_fullsized":"2024-04-23T19:04:21.154379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.154185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.154185+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.154185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:09.176108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'4","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.380053+0000","last_change":"2024-04-23T19:04:32.380112+0000","last_active":"2024-04-23T19:04:32.380053+0000","last_peered":"2024-04-23T19:04:32.380053+0000","last_clean":"2024-04-23T19:04:32.380053+0000","last_became_active":"2024-04-23T19:00:25.329200+0000","last_became_peered":"2024-04-23T19:00:25.329200+0000","last_unstale":"2024-04-23T19:04:32.380053+0000","last_undegraded":"2024-04-23T19:04:32.380053+0000","last_fullsized":"2024-04-23T19:04:32.380053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'4","last_scrub_stamp":"2024-04-23T19:04:32.379856+0000","last_deep_scrub":"52'4","last_deep_scrub_stamp":"2024-04-23T19:04:32.379856+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.379856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:23.287703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"52'4","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:41.866913+0000","last_change":"2024-04-23T19:04:41.866913+0000","last_active":"2024-04-23T19:04:41.866913+0000","last_peered":"2024-04-23T19:04:41.866913+0000","last_clean":"2024-04-23T19:04:41.866913+0000","last_became_active":"2024-04-23T19:00:55.103818+0000","last_became_peered":"2024-04-23T19:00:55.103818+0000","last_unstale":"2024-04-23T19:04:41.866913+0000","last_undegraded":"2024-04-23T19:04:41.866913+0000","last_fullsized":"2024-04-23T19:04:41.866913+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'4","last_scrub_stamp":"2024-04-23T19:04:41.866639+0000","last_deep_scrub":"52'4","last_deep_scrub_stamp":"2024-04-23T19:04:41.866639+0000","last_clean_scrub_stamp":"2024-04-23T19:04:41.866639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:59.633026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'56","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.637296+0000","last_change":"2024-04-23T19:04:27.637357+0000","last_active":"2024-04-23T19:04:27.637296+0000","last_peered":"2024-04-23T19:04:27.637296+0000","last_clean":"2024-04-23T19:04:27.637296+0000","last_became_active":"2024-04-23T19:00:15.275950+0000","last_became_peered":"2024-04-23T19:00:15.275950+0000","last_unstale":"2024-04-23T19:04:27.637296+0000","last_undegraded":"2024-04-23T19:04:27.637296+0000","last_fullsized":"2024-04-23T19:04:27.637296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:27.637096+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:27.637096+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.637096+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:27.088430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.260185+0000","last_change":"2024-04-23T19:04:02.260185+0000","last_active":"2024-04-23T19:04:02.260185+0000","last_peered":"2024-04-23T19:04:02.260185+0000","last_clean":"2024-04-23T19:04:02.260185+0000","last_became_active":"2024-04-23T19:00:19.302419+0000","last_became_peered":"2024-04-23T19:00:19.302419+0000","last_unstale":"2024-04-23T19:04:02.260185+0000","last_undegraded":"2024-04-23T19:04:02.260185+0000","last_fullsized":"2024-04-23T19:04:02.260185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.259941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.259941+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.259941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:34:34.827166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'23","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.024704+0000","last_change":"2024-04-23T19:04:15.024704+0000","last_active":"2024-04-23T19:04:15.024704+0000","last_peered":"2024-04-23T19:04:15.024704+0000","last_clean":"2024-04-23T19:04:15.024704+0000","last_became_active":"2024-04-23T19:00:21.306250+0000","last_became_peered":"2024-04-23T19:00:21.306250+0000","last_unstale":"2024-04-23T19:04:15.024704+0000","last_undegraded":"2024-04-23T19:04:15.024704+0000","last_fullsized":"2024-04-23T19:04:15.024704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-04-23T19:04:15.024424+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-04-23T19:04:15.024424+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.024424+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:47.959153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.504042+0000","last_change":"2024-04-23T19:04:04.504098+0000","last_active":"2024-04-23T19:04:04.504042+0000","last_peered":"2024-04-23T19:04:04.504042+0000","last_clean":"2024-04-23T19:04:04.504042+0000","last_became_active":"2024-04-23T19:00:23.330150+0000","last_became_peered":"2024-04-23T19:00:23.330150+0000","last_unstale":"2024-04-23T19:04:04.504042+0000","last_undegraded":"2024-04-23T19:04:04.504042+0000","last_fullsized":"2024-04-23T19:04:04.504042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.503808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.503808+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.503808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:34.827218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"98'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.150384+0000","last_change":"2024-04-23T19:04:10.150384+0000","last_active":"2024-04-23T19:04:10.150384+0000","last_peered":"2024-04-23T19:04:10.150384+0000","last_clean":"2024-04-23T19:04:10.150384+0000","last_became_active":"2024-04-23T19:00:17.299839+0000","last_became_peered":"2024-04-23T19:00:17.299839+0000","last_unstale":"2024-04-23T19:04:10.150384+0000","last_undegraded":"2024-04-23T19:04:10.150384+0000","last_fullsized":"2024-04-23T19:04:10.150384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:10.150112+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:10.150112+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.150112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:37.721431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'40","reported_seq":274,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:42.898961+0000","last_change":"2024-04-23T19:04:42.899027+0000","last_active":"2024-04-23T19:04:42.898961+0000","last_peered":"2024-04-23T19:04:42.898961+0000","last_clean":"2024-04-23T19:04:42.898961+0000","last_became_active":"2024-04-23T19:01:39.103371+0000","last_became_peered":"2024-04-23T19:01:39.103371+0000","last_unstale":"2024-04-23T19:04:42.898961+0000","last_undegraded":"2024-04-23T19:04:42.898961+0000","last_fullsized":"2024-04-23T19:04:42.898961+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:42.898755+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:42.898755+0000","last_clean_scrub_stamp":"2024-04-23T19:04:42.898755+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:26.102527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.486506+0000","last_change":"2024-04-23T19:04:07.486506+0000","last_active":"2024-04-23T19:04:07.486506+0000","last_peered":"2024-04-23T19:04:07.486506+0000","last_clean":"2024-04-23T19:04:07.486506+0000","last_became_active":"2024-04-23T19:00:19.299845+0000","last_became_peered":"2024-04-23T19:00:19.299845+0000","last_unstale":"2024-04-23T19:04:07.486506+0000","last_undegraded":"2024-04-23T19:04:07.486506+0000","last_fullsized":"2024-04-23T19:04:07.486506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:07.486252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:07.486252+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.486252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:04.087179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'41","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.373550+0000","last_change":"2024-04-23T19:04:28.373623+0000","last_active":"2024-04-23T19:04:28.373550+0000","last_peered":"2024-04-23T19:04:28.373550+0000","last_clean":"2024-04-23T19:04:28.373550+0000","last_became_active":"2024-04-23T19:03:32.304695+0000","last_became_peered":"2024-04-23T19:03:32.304695+0000","last_unstale":"2024-04-23T19:04:28.373550+0000","last_undegraded":"2024-04-23T19:04:28.373550+0000","last_fullsized":"2024-04-23T19:04:28.373550+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'41","last_scrub_stamp":"2024-04-23T19:04:28.373411+0000","last_deep_scrub":"116'41","last_deep_scrub_stamp":"2024-04-23T19:04:28.373411+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.373411+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:52.850973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.266763+0000","last_change":"2024-04-23T19:04:04.266816+0000","last_active":"2024-04-23T19:04:04.266763+0000","last_peered":"2024-04-23T19:04:04.266763+0000","last_clean":"2024-04-23T19:04:04.266763+0000","last_became_active":"2024-04-23T19:00:23.309925+0000","last_became_peered":"2024-04-23T19:00:23.309925+0000","last_unstale":"2024-04-23T19:04:04.266763+0000","last_undegraded":"2024-04-23T19:04:04.266763+0000","last_fullsized":"2024-04-23T19:04:04.266763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:04.266571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:04.266571+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.266571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:40.071305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.778824+0000","last_change":"2024-04-23T19:04:37.778883+0000","last_active":"2024-04-23T19:04:37.778824+0000","last_peered":"2024-04-23T19:04:37.778824+0000","last_clean":"2024-04-23T19:04:37.778824+0000","last_became_active":"2024-04-23T19:00:25.347397+0000","last_became_peered":"2024-04-23T19:00:25.347397+0000","last_unstale":"2024-04-23T19:04:37.778824+0000","last_undegraded":"2024-04-23T19:04:37.778824+0000","last_fullsized":"2024-04-23T19:04:37.778824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:37.778607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:37.778607+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.778607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:02.222724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"98'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.598248+0000","last_change":"2024-04-23T19:04:14.598248+0000","last_active":"2024-04-23T19:04:14.598248+0000","last_peered":"2024-04-23T19:04:14.598248+0000","last_clean":"2024-04-23T19:04:14.598248+0000","last_became_active":"2024-04-23T19:00:17.303464+0000","last_became_peered":"2024-04-23T19:00:17.303464+0000","last_unstale":"2024-04-23T19:04:14.598248+0000","last_undegraded":"2024-04-23T19:04:14.598248+0000","last_fullsized":"2024-04-23T19:04:14.598248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-23T19:04:14.597970+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-23T19:04:14.597970+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.597970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:22.375247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'60","reported_seq":270,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.455836+0000","last_change":"2024-04-23T19:04:14.455903+0000","last_active":"2024-04-23T19:04:14.455836+0000","last_peered":"2024-04-23T19:04:14.455836+0000","last_clean":"2024-04-23T19:04:14.455836+0000","last_became_active":"2024-04-23T19:00:15.251403+0000","last_became_peered":"2024-04-23T19:00:15.251403+0000","last_unstale":"2024-04-23T19:04:14.455836+0000","last_undegraded":"2024-04-23T19:04:14.455836+0000","last_fullsized":"2024-04-23T19:04:14.455836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'60","last_scrub_stamp":"2024-04-23T19:04:14.455632+0000","last_deep_scrub":"116'60","last_deep_scrub_stamp":"2024-04-23T19:04:14.455632+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.455632+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:27.517424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.277395+0000","last_change":"2024-04-23T19:04:05.277395+0000","last_active":"2024-04-23T19:04:05.277395+0000","last_peered":"2024-04-23T19:04:05.277395+0000","last_clean":"2024-04-23T19:04:05.277395+0000","last_became_active":"2024-04-23T19:00:19.307428+0000","last_became_peered":"2024-04-23T19:00:19.307428+0000","last_unstale":"2024-04-23T19:04:05.277395+0000","last_undegraded":"2024-04-23T19:04:05.277395+0000","last_fullsized":"2024-04-23T19:04:05.277395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:05.277117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:05.277117+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.277117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:16.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'33","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.009170+0000","last_change":"2024-04-23T19:04:04.009319+0000","last_active":"2024-04-23T19:04:04.009170+0000","last_peered":"2024-04-23T19:04:04.009170+0000","last_clean":"2024-04-23T19:04:04.009170+0000","last_became_active":"2024-04-23T19:00:21.316847+0000","last_became_peered":"2024-04-23T19:00:21.316847+0000","last_unstale":"2024-04-23T19:04:04.009170+0000","last_undegraded":"2024-04-23T19:04:04.009170+0000","last_fullsized":"2024-04-23T19:04:04.009170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-04-23T19:04:04.008931+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-04-23T19:04:04.008931+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.008931+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:35.883159+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.420062+0000","last_change":"2024-04-23T19:04:20.420114+0000","last_active":"2024-04-23T19:04:20.420062+0000","last_peered":"2024-04-23T19:04:20.420062+0000","last_clean":"2024-04-23T19:04:20.420062+0000","last_became_active":"2024-04-23T19:00:23.337041+0000","last_became_peered":"2024-04-23T19:00:23.337041+0000","last_unstale":"2024-04-23T19:04:20.420062+0000","last_undegraded":"2024-04-23T19:04:20.420062+0000","last_fullsized":"2024-04-23T19:04:20.420062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.419859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.419859+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.419859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:49.249375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.095336+0000","last_change":"2024-04-23T19:04:24.095444+0000","last_active":"2024-04-23T19:04:24.095336+0000","last_peered":"2024-04-23T19:04:24.095336+0000","last_clean":"2024-04-23T19:04:24.095336+0000","last_became_active":"2024-04-23T19:00:25.338744+0000","last_became_peered":"2024-04-23T19:00:25.338744+0000","last_unstale":"2024-04-23T19:04:24.095336+0000","last_undegraded":"2024-04-23T19:04:24.095336+0000","last_fullsized":"2024-04-23T19:04:24.095336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:24.095079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:24.095079+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.095079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:44.841432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"98'6","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.785503+0000","last_change":"2024-04-23T19:04:16.785628+0000","last_active":"2024-04-23T19:04:16.785503+0000","last_peered":"2024-04-23T19:04:16.785503+0000","last_clean":"2024-04-23T19:04:16.785503+0000","last_became_active":"2024-04-23T19:00:17.298425+0000","last_became_peered":"2024-04-23T19:00:17.298425+0000","last_unstale":"2024-04-23T19:04:16.785503+0000","last_undegraded":"2024-04-23T19:04:16.785503+0000","last_fullsized":"2024-04-23T19:04:16.785503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-23T19:04:16.785232+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-23T19:04:16.785232+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.785232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:04.397703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:23.109201+0000","last_change":"2024-04-23T19:04:23.109267+0000","last_active":"2024-04-23T19:04:23.109201+0000","last_peered":"2024-04-23T19:04:23.109201+0000","last_clean":"2024-04-23T19:04:23.109201+0000","last_became_active":"2024-04-23T19:00:15.263566+0000","last_became_peered":"2024-04-23T19:00:15.263566+0000","last_unstale":"2024-04-23T19:04:23.109201+0000","last_undegraded":"2024-04-23T19:04:23.109201+0000","last_fullsized":"2024-04-23T19:04:23.109201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:23.108994+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:23.108994+0000","last_clean_scrub_stamp":"2024-04-23T19:04:23.108994+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:16:30.139036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:17.160699+0000","last_change":"2024-04-23T19:04:17.160846+0000","last_active":"2024-04-23T19:04:17.160699+0000","last_peered":"2024-04-23T19:04:17.160699+0000","last_clean":"2024-04-23T19:04:17.160699+0000","last_became_active":"2024-04-23T19:00:19.288374+0000","last_became_peered":"2024-04-23T19:00:19.288374+0000","last_unstale":"2024-04-23T19:04:17.160699+0000","last_undegraded":"2024-04-23T19:04:17.160699+0000","last_fullsized":"2024-04-23T19:04:17.160699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:17.160447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:17.160447+0000","last_clean_scrub_stamp":"2024-04-23T19:04:17.160447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:30:29.147866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'28","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.753432+0000","last_change":"2024-04-23T19:04:07.753432+0000","last_active":"2024-04-23T19:04:07.753432+0000","last_peered":"2024-04-23T19:04:07.753432+0000","last_clean":"2024-04-23T19:04:07.753432+0000","last_became_active":"2024-04-23T19:00:21.309430+0000","last_became_peered":"2024-04-23T19:00:21.309430+0000","last_unstale":"2024-04-23T19:04:07.753432+0000","last_undegraded":"2024-04-23T19:04:07.753432+0000","last_fullsized":"2024-04-23T19:04:07.753432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-04-23T19:04:07.753180+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-04-23T19:04:07.753180+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.753180+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:04.354107+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":162,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.426361+0000","last_change":"2024-04-23T19:04:01.426361+0000","last_active":"2024-04-23T19:04:01.426361+0000","last_peered":"2024-04-23T19:04:01.426361+0000","last_clean":"2024-04-23T19:04:01.426361+0000","last_became_active":"2024-04-23T19:03:32.295623+0000","last_became_peered":"2024-04-23T19:03:32.295623+0000","last_unstale":"2024-04-23T19:04:01.426361+0000","last_undegraded":"2024-04-23T19:04:01.426361+0000","last_fullsized":"2024-04-23T19:04:01.426361+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:01.426273+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.426273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:06.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"116'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.379098+0000","last_change":"2024-04-23T19:04:33.379162+0000","last_active":"2024-04-23T19:04:33.379098+0000","last_peered":"2024-04-23T19:04:33.379098+0000","last_clean":"2024-04-23T19:04:33.379098+0000","last_became_active":"2024-04-23T19:00:25.329304+0000","last_became_peered":"2024-04-23T19:00:25.329304+0000","last_unstale":"2024-04-23T19:04:33.379098+0000","last_undegraded":"2024-04-23T19:04:33.379098+0000","last_fullsized":"2024-04-23T19:04:33.379098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'12","last_scrub_stamp":"2024-04-23T19:04:33.378851+0000","last_deep_scrub":"116'12","last_deep_scrub_stamp":"2024-04-23T19:04:33.378851+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.378851+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:12.064023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"57'4","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.951782+0000","last_change":"2024-04-23T19:04:09.951849+0000","last_active":"2024-04-23T19:04:09.951782+0000","last_peered":"2024-04-23T19:04:09.951782+0000","last_clean":"2024-04-23T19:04:09.951782+0000","last_became_active":"2024-04-23T19:00:17.294947+0000","last_became_peered":"2024-04-23T19:00:17.294947+0000","last_unstale":"2024-04-23T19:04:09.951782+0000","last_undegraded":"2024-04-23T19:04:09.951782+0000","last_fullsized":"2024-04-23T19:04:09.951782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:09.951567+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:09.951567+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.951567+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:21.339434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'40","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.742321+0000","last_change":"2024-04-23T19:04:35.742382+0000","last_active":"2024-04-23T19:04:35.742321+0000","last_peered":"2024-04-23T19:04:35.742321+0000","last_clean":"2024-04-23T19:04:35.742321+0000","last_became_active":"2024-04-23T19:01:39.097297+0000","last_became_peered":"2024-04-23T19:01:39.097297+0000","last_unstale":"2024-04-23T19:04:35.742321+0000","last_undegraded":"2024-04-23T19:04:35.742321+0000","last_fullsized":"2024-04-23T19:04:35.742321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'40","last_scrub_stamp":"2024-04-23T19:04:35.742116+0000","last_deep_scrub":"116'40","last_deep_scrub_stamp":"2024-04-23T19:04:35.742116+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.742116+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:48.863411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.512313+0000","last_change":"2024-04-23T19:04:06.512368+0000","last_active":"2024-04-23T19:04:06.512313+0000","last_peered":"2024-04-23T19:04:06.512313+0000","last_clean":"2024-04-23T19:04:06.512313+0000","last_became_active":"2024-04-23T19:03:32.280531+0000","last_became_peered":"2024-04-23T19:03:32.280531+0000","last_unstale":"2024-04-23T19:04:06.512313+0000","last_undegraded":"2024-04-23T19:04:06.512313+0000","last_fullsized":"2024-04-23T19:04:06.512313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:06.512135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:06.512135+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.512135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:05.764920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'15","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:01.845493+0000","last_change":"2024-04-23T19:04:01.845493+0000","last_active":"2024-04-23T19:04:01.845493+0000","last_peered":"2024-04-23T19:04:01.845493+0000","last_clean":"2024-04-23T19:04:01.845493+0000","last_became_active":"2024-04-23T19:00:21.307263+0000","last_became_peered":"2024-04-23T19:00:21.307263+0000","last_unstale":"2024-04-23T19:04:01.845493+0000","last_undegraded":"2024-04-23T19:04:01.845493+0000","last_fullsized":"2024-04-23T19:04:01.845493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-04-23T19:04:01.845084+0000","last_clean_scrub_stamp":"2024-04-23T19:04:01.845084+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:36.043539+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'138","reported_seq":402,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.196194+0000","last_change":"2024-04-23T19:04:09.196194+0000","last_active":"2024-04-23T19:04:09.196194+0000","last_peered":"2024-04-23T19:04:09.196194+0000","last_clean":"2024-04-23T19:04:09.196194+0000","last_became_active":"2024-04-23T19:00:23.322485+0000","last_became_peered":"2024-04-23T19:00:23.322485+0000","last_unstale":"2024-04-23T19:04:09.196194+0000","last_undegraded":"2024-04-23T19:04:09.196194+0000","last_fullsized":"2024-04-23T19:04:09.196194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'138","last_scrub_stamp":"2024-04-23T19:04:09.195905+0000","last_deep_scrub":"116'138","last_deep_scrub_stamp":"2024-04-23T19:04:09.195905+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.195905+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:00:54.108731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:33.045848+0000","last_change":"2024-04-23T19:04:33.045902+0000","last_active":"2024-04-23T19:04:33.045848+0000","last_peered":"2024-04-23T19:04:33.045848+0000","last_clean":"2024-04-23T19:04:33.045848+0000","last_became_active":"2024-04-23T19:00:25.328231+0000","last_became_peered":"2024-04-23T19:00:25.328231+0000","last_unstale":"2024-04-23T19:04:33.045848+0000","last_undegraded":"2024-04-23T19:04:33.045848+0000","last_fullsized":"2024-04-23T19:04:33.045848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:33.045618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:33.045618+0000","last_clean_scrub_stamp":"2024-04-23T19:04:33.045618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:14.521837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.187110+0000","last_change":"2024-04-23T19:04:18.187164+0000","last_active":"2024-04-23T19:04:18.187110+0000","last_peered":"2024-04-23T19:04:18.187110+0000","last_clean":"2024-04-23T19:04:18.187110+0000","last_became_active":"2024-04-23T19:00:17.307539+0000","last_became_peered":"2024-04-23T19:00:17.307539+0000","last_unstale":"2024-04-23T19:04:18.187110+0000","last_undegraded":"2024-04-23T19:04:18.187110+0000","last_fullsized":"2024-04-23T19:04:18.187110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.186906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.186906+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.186906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:31.248698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'42","reported_seq":252,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.364925+0000","last_change":"2024-04-23T19:04:19.364986+0000","last_active":"2024-04-23T19:04:19.364925+0000","last_peered":"2024-04-23T19:04:19.364925+0000","last_clean":"2024-04-23T19:04:19.364925+0000","last_became_active":"2024-04-23T19:00:15.274950+0000","last_became_peered":"2024-04-23T19:00:15.274950+0000","last_unstale":"2024-04-23T19:04:19.364925+0000","last_undegraded":"2024-04-23T19:04:19.364925+0000","last_fullsized":"2024-04-23T19:04:19.364925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:19.364730+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:19.364730+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.364730+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:34:03.209726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:09.033520+0000","last_change":"2024-04-23T19:04:09.033574+0000","last_active":"2024-04-23T19:04:09.033520+0000","last_peered":"2024-04-23T19:04:09.033520+0000","last_clean":"2024-04-23T19:04:09.033520+0000","last_became_active":"2024-04-23T19:00:19.308732+0000","last_became_peered":"2024-04-23T19:00:19.308732+0000","last_unstale":"2024-04-23T19:04:09.033520+0000","last_undegraded":"2024-04-23T19:04:09.033520+0000","last_fullsized":"2024-04-23T19:04:09.033520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:09.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:09.033307+0000","last_clean_scrub_stamp":"2024-04-23T19:04:09.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:57.556321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'32","reported_seq":244,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.307389+0000","last_change":"2024-04-23T19:04:05.307497+0000","last_active":"2024-04-23T19:04:05.307389+0000","last_peered":"2024-04-23T19:04:05.307389+0000","last_clean":"2024-04-23T19:04:05.307389+0000","last_became_active":"2024-04-23T19:00:21.311702+0000","last_became_peered":"2024-04-23T19:00:21.311702+0000","last_unstale":"2024-04-23T19:04:05.307389+0000","last_undegraded":"2024-04-23T19:04:05.307389+0000","last_fullsized":"2024-04-23T19:04:05.307389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-04-23T19:04:05.307144+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-04-23T19:04:05.307144+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.307144+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:54.457438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:21.582678+0000","last_change":"2024-04-23T19:04:21.582732+0000","last_active":"2024-04-23T19:04:21.582678+0000","last_peered":"2024-04-23T19:04:21.582678+0000","last_clean":"2024-04-23T19:04:21.582678+0000","last_became_active":"2024-04-23T19:00:23.327198+0000","last_became_peered":"2024-04-23T19:00:23.327198+0000","last_unstale":"2024-04-23T19:04:21.582678+0000","last_undegraded":"2024-04-23T19:04:21.582678+0000","last_fullsized":"2024-04-23T19:04:21.582678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:21.582488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:21.582488+0000","last_clean_scrub_stamp":"2024-04-23T19:04:21.582488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:10:46.474465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"53'4","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.023421+0000","last_change":"2024-04-23T19:04:34.023480+0000","last_active":"2024-04-23T19:04:34.023421+0000","last_peered":"2024-04-23T19:04:34.023421+0000","last_clean":"2024-04-23T19:04:34.023421+0000","last_became_active":"2024-04-23T19:00:25.335051+0000","last_became_peered":"2024-04-23T19:00:25.335051+0000","last_unstale":"2024-04-23T19:04:34.023421+0000","last_undegraded":"2024-04-23T19:04:34.023421+0000","last_fullsized":"2024-04-23T19:04:34.023421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:34.023216+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:34.023216+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.023216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:10.902611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"98'8","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.144746+0000","last_change":"2024-04-23T19:04:16.144806+0000","last_active":"2024-04-23T19:04:16.144746+0000","last_peered":"2024-04-23T19:04:16.144746+0000","last_clean":"2024-04-23T19:04:16.144746+0000","last_became_active":"2024-04-23T19:00:17.307641+0000","last_became_peered":"2024-04-23T19:00:17.307641+0000","last_unstale":"2024-04-23T19:04:16.144746+0000","last_undegraded":"2024-04-23T19:04:16.144746+0000","last_fullsized":"2024-04-23T19:04:16.144746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-23T19:04:16.144522+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-23T19:04:16.144522+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.144522+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:08.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'52","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.080984+0000","last_change":"2024-04-23T19:04:19.081131+0000","last_active":"2024-04-23T19:04:19.080984+0000","last_peered":"2024-04-23T19:04:19.080984+0000","last_clean":"2024-04-23T19:04:19.080984+0000","last_became_active":"2024-04-23T19:00:55.482720+0000","last_became_peered":"2024-04-23T19:00:55.482720+0000","last_unstale":"2024-04-23T19:04:19.080984+0000","last_undegraded":"2024-04-23T19:04:19.080984+0000","last_fullsized":"2024-04-23T19:04:19.080984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:19.080702+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:19.080702+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.080702+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:43.244336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.348448+0000","last_change":"2024-04-23T19:04:20.348505+0000","last_active":"2024-04-23T19:04:20.348448+0000","last_peered":"2024-04-23T19:04:20.348448+0000","last_clean":"2024-04-23T19:04:20.348448+0000","last_became_active":"2024-04-23T19:00:19.300161+0000","last_became_peered":"2024-04-23T19:00:19.300161+0000","last_unstale":"2024-04-23T19:04:20.348448+0000","last_undegraded":"2024-04-23T19:04:20.348448+0000","last_fullsized":"2024-04-23T19:04:20.348448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.348220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.348220+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.348220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:28.125498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'24","reported_seq":155,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:38.695118+0000","last_change":"2024-04-23T19:04:38.695193+0000","last_active":"2024-04-23T19:04:38.695118+0000","last_peered":"2024-04-23T19:04:38.695118+0000","last_clean":"2024-04-23T19:04:38.695118+0000","last_became_active":"2024-04-23T19:01:39.099758+0000","last_became_peered":"2024-04-23T19:01:39.099758+0000","last_unstale":"2024-04-23T19:04:38.695118+0000","last_undegraded":"2024-04-23T19:04:38.695118+0000","last_fullsized":"2024-04-23T19:04:38.695118+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-04-23T19:04:38.694895+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-04-23T19:04:38.694895+0000","last_clean_scrub_stamp":"2024-04-23T19:04:38.694895+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:25.009105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:20.143021+0000","last_change":"2024-04-23T19:04:20.143077+0000","last_active":"2024-04-23T19:04:20.143021+0000","last_peered":"2024-04-23T19:04:20.143021+0000","last_clean":"2024-04-23T19:04:20.143021+0000","last_became_active":"2024-04-23T19:00:23.329204+0000","last_became_peered":"2024-04-23T19:00:23.329204+0000","last_unstale":"2024-04-23T19:04:20.143021+0000","last_undegraded":"2024-04-23T19:04:20.143021+0000","last_fullsized":"2024-04-23T19:04:20.143021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:20.142757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:20.142757+0000","last_clean_scrub_stamp":"2024-04-23T19:04:20.142757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:42.252737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"53'2","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.823428+0000","last_change":"2024-04-23T19:04:36.823491+0000","last_active":"2024-04-23T19:04:36.823428+0000","last_peered":"2024-04-23T19:04:36.823428+0000","last_clean":"2024-04-23T19:04:36.823428+0000","last_became_active":"2024-04-23T19:00:25.336210+0000","last_became_peered":"2024-04-23T19:00:25.336210+0000","last_unstale":"2024-04-23T19:04:36.823428+0000","last_undegraded":"2024-04-23T19:04:36.823428+0000","last_fullsized":"2024-04-23T19:04:36.823428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:36.823230+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:36.823230+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.823230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:32.948185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"53'10","reported_seq":248,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.760403+0000","last_change":"2024-04-23T19:04:18.760497+0000","last_active":"2024-04-23T19:04:18.760403+0000","last_peered":"2024-04-23T19:04:18.760403+0000","last_clean":"2024-04-23T19:04:18.760403+0000","last_became_active":"2024-04-23T19:00:17.292841+0000","last_became_peered":"2024-04-23T19:00:17.292841+0000","last_unstale":"2024-04-23T19:04:18.760403+0000","last_undegraded":"2024-04-23T19:04:18.760403+0000","last_fullsized":"2024-04-23T19:04:18.760403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-23T19:04:18.760211+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-23T19:04:18.760211+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.760211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:24.942267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:30.856752+0000","last_change":"2024-04-23T19:04:30.856816+0000","last_active":"2024-04-23T19:04:30.856752+0000","last_peered":"2024-04-23T19:04:30.856752+0000","last_clean":"2024-04-23T19:04:30.856752+0000","last_became_active":"2024-04-23T19:00:15.269916+0000","last_became_peered":"2024-04-23T19:00:15.269916+0000","last_unstale":"2024-04-23T19:04:30.856752+0000","last_undegraded":"2024-04-23T19:04:30.856752+0000","last_fullsized":"2024-04-23T19:04:30.856752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:30.856559+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:30.856559+0000","last_clean_scrub_stamp":"2024-04-23T19:04:30.856559+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:56.776890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:31.167372+0000","last_change":"2024-04-23T19:04:31.167492+0000","last_active":"2024-04-23T19:04:31.167372+0000","last_peered":"2024-04-23T19:04:31.167372+0000","last_clean":"2024-04-23T19:04:31.167372+0000","last_became_active":"2024-04-23T19:00:19.299634+0000","last_became_peered":"2024-04-23T19:00:19.299634+0000","last_unstale":"2024-04-23T19:04:31.167372+0000","last_undegraded":"2024-04-23T19:04:31.167372+0000","last_fullsized":"2024-04-23T19:04:31.167372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:31.167154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:31.167154+0000","last_clean_scrub_stamp":"2024-04-23T19:04:31.167154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:55.838722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'20","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.833743+0000","last_change":"2024-04-23T19:04:35.833807+0000","last_active":"2024-04-23T19:04:35.833743+0000","last_peered":"2024-04-23T19:04:35.833743+0000","last_clean":"2024-04-23T19:04:35.833743+0000","last_became_active":"2024-04-23T19:00:21.302717+0000","last_became_peered":"2024-04-23T19:00:21.302717+0000","last_unstale":"2024-04-23T19:04:35.833743+0000","last_undegraded":"2024-04-23T19:04:35.833743+0000","last_fullsized":"2024-04-23T19:04:35.833743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-04-23T19:04:35.833559+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-04-23T19:04:35.833559+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.833559+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:28:00.180355+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.128152+0000","last_change":"2024-04-23T19:04:32.128207+0000","last_active":"2024-04-23T19:04:32.128152+0000","last_peered":"2024-04-23T19:04:32.128152+0000","last_clean":"2024-04-23T19:04:32.128152+0000","last_became_active":"2024-04-23T19:00:23.321743+0000","last_became_peered":"2024-04-23T19:00:23.321743+0000","last_unstale":"2024-04-23T19:04:32.128152+0000","last_undegraded":"2024-04-23T19:04:32.128152+0000","last_fullsized":"2024-04-23T19:04:32.128152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:32.127955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:32.127955+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.127955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:00.447137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:34.981908+0000","last_change":"2024-04-23T19:04:34.981962+0000","last_active":"2024-04-23T19:04:34.981908+0000","last_peered":"2024-04-23T19:04:34.981908+0000","last_clean":"2024-04-23T19:04:34.981908+0000","last_became_active":"2024-04-23T19:00:25.342667+0000","last_became_peered":"2024-04-23T19:00:25.342667+0000","last_unstale":"2024-04-23T19:04:34.981908+0000","last_undegraded":"2024-04-23T19:04:34.981908+0000","last_fullsized":"2024-04-23T19:04:34.981908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:34.981709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:34.981709+0000","last_clean_scrub_stamp":"2024-04-23T19:04:34.981709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:59.653277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"89'6","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:13.092992+0000","last_change":"2024-04-23T19:04:13.093062+0000","last_active":"2024-04-23T19:04:13.092992+0000","last_peered":"2024-04-23T19:04:13.092992+0000","last_clean":"2024-04-23T19:04:13.092992+0000","last_became_active":"2024-04-23T19:00:17.323301+0000","last_became_peered":"2024-04-23T19:00:17.323301+0000","last_unstale":"2024-04-23T19:04:13.092992+0000","last_undegraded":"2024-04-23T19:04:13.092992+0000","last_fullsized":"2024-04-23T19:04:13.092992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:13.092795+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:13.092795+0000","last_clean_scrub_stamp":"2024-04-23T19:04:13.092795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:58.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'50","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.709926+0000","last_change":"2024-04-23T19:04:37.709987+0000","last_active":"2024-04-23T19:04:37.709926+0000","last_peered":"2024-04-23T19:04:37.709926+0000","last_clean":"2024-04-23T19:04:37.709926+0000","last_became_active":"2024-04-23T19:01:39.099182+0000","last_became_peered":"2024-04-23T19:01:39.099182+0000","last_unstale":"2024-04-23T19:04:37.709926+0000","last_undegraded":"2024-04-23T19:04:37.709926+0000","last_fullsized":"2024-04-23T19:04:37.709926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'50","last_scrub_stamp":"2024-04-23T19:04:37.709712+0000","last_deep_scrub":"116'50","last_deep_scrub_stamp":"2024-04-23T19:04:37.709712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.709712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:33.834667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":171,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.418968+0000","last_change":"2024-04-23T19:04:12.419040+0000","last_active":"2024-04-23T19:04:12.418968+0000","last_peered":"2024-04-23T19:04:12.418968+0000","last_clean":"2024-04-23T19:04:12.418968+0000","last_became_active":"2024-04-23T19:03:32.300664+0000","last_became_peered":"2024-04-23T19:03:32.300664+0000","last_unstale":"2024-04-23T19:04:12.418968+0000","last_undegraded":"2024-04-23T19:04:12.418968+0000","last_fullsized":"2024-04-23T19:04:12.418968+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-04-23T19:04:12.418765+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-04-23T19:04:12.418765+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.418765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:04.586084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'24","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:04.916796+0000","last_change":"2024-04-23T19:04:04.916870+0000","last_active":"2024-04-23T19:04:04.916796+0000","last_peered":"2024-04-23T19:04:04.916796+0000","last_clean":"2024-04-23T19:04:04.916796+0000","last_became_active":"2024-04-23T19:00:21.313182+0000","last_became_peered":"2024-04-23T19:00:21.313182+0000","last_unstale":"2024-04-23T19:04:04.916796+0000","last_undegraded":"2024-04-23T19:04:04.916796+0000","last_fullsized":"2024-04-23T19:04:04.916796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-04-23T19:04:04.916613+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-04-23T19:04:04.916613+0000","last_clean_scrub_stamp":"2024-04-23T19:04:04.916613+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:10.168421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:02.425047+0000","last_change":"2024-04-23T19:04:02.425096+0000","last_active":"2024-04-23T19:04:02.425047+0000","last_peered":"2024-04-23T19:04:02.425047+0000","last_clean":"2024-04-23T19:04:02.425047+0000","last_became_active":"2024-04-23T19:00:23.347860+0000","last_became_peered":"2024-04-23T19:00:23.347860+0000","last_unstale":"2024-04-23T19:04:02.425047+0000","last_undegraded":"2024-04-23T19:04:02.425047+0000","last_fullsized":"2024-04-23T19:04:02.425047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:02.424719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:02.424719+0000","last_clean_scrub_stamp":"2024-04-23T19:04:02.424719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:01.677504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:37.074105+0000","last_change":"2024-04-23T19:04:37.074161+0000","last_active":"2024-04-23T19:04:37.074105+0000","last_peered":"2024-04-23T19:04:37.074105+0000","last_clean":"2024-04-23T19:04:37.074105+0000","last_became_active":"2024-04-23T19:00:25.331881+0000","last_became_peered":"2024-04-23T19:00:25.331881+0000","last_unstale":"2024-04-23T19:04:37.074105+0000","last_undegraded":"2024-04-23T19:04:37.074105+0000","last_fullsized":"2024-04-23T19:04:37.074105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:37.073905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:37.073905+0000","last_clean_scrub_stamp":"2024-04-23T19:04:37.073905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:03.841310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"52'2","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:27.416833+0000","last_change":"2024-04-23T19:04:27.416833+0000","last_active":"2024-04-23T19:04:27.416833+0000","last_peered":"2024-04-23T19:04:27.416833+0000","last_clean":"2024-04-23T19:04:27.416833+0000","last_became_active":"2024-04-23T19:03:32.304833+0000","last_became_peered":"2024-04-23T19:03:32.304833+0000","last_unstale":"2024-04-23T19:04:27.416833+0000","last_undegraded":"2024-04-23T19:04:27.416833+0000","last_fullsized":"2024-04-23T19:04:27.416833+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:27.416453+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:27.416453+0000","last_clean_scrub_stamp":"2024-04-23T19:04:27.416453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:59.194612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'58","reported_seq":285,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.171448+0000","last_change":"2024-04-23T19:04:26.171448+0000","last_active":"2024-04-23T19:04:26.171448+0000","last_peered":"2024-04-23T19:04:26.171448+0000","last_clean":"2024-04-23T19:04:26.171448+0000","last_became_active":"2024-04-23T19:01:39.102596+0000","last_became_peered":"2024-04-23T19:01:39.102596+0000","last_unstale":"2024-04-23T19:04:26.171448+0000","last_undegraded":"2024-04-23T19:04:26.171448+0000","last_fullsized":"2024-04-23T19:04:26.171448+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:26.171073+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:26.171073+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.171073+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.338392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"57'4","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.413349+0000","last_change":"2024-04-23T19:04:25.413349+0000","last_active":"2024-04-23T19:04:25.413349+0000","last_peered":"2024-04-23T19:04:25.413349+0000","last_clean":"2024-04-23T19:04:25.413349+0000","last_became_active":"2024-04-23T19:03:32.301257+0000","last_became_peered":"2024-04-23T19:03:32.301257+0000","last_unstale":"2024-04-23T19:04:25.413349+0000","last_undegraded":"2024-04-23T19:04:25.413349+0000","last_fullsized":"2024-04-23T19:04:25.413349+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:25.413068+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:25.413068+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.413068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:10:50.305044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.936359+0000","last_change":"2024-04-23T19:04:05.936359+0000","last_active":"2024-04-23T19:04:05.936359+0000","last_peered":"2024-04-23T19:04:05.936359+0000","last_clean":"2024-04-23T19:04:05.936359+0000","last_became_active":"2024-04-23T19:00:15.246203+0000","last_became_peered":"2024-04-23T19:00:15.246203+0000","last_unstale":"2024-04-23T19:04:05.936359+0000","last_undegraded":"2024-04-23T19:04:05.936359+0000","last_fullsized":"2024-04-23T19:04:05.936359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:05.936104+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:05.936104+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.936104+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:09:25.295580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"52'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:07.348911+0000","last_change":"2024-04-23T19:04:07.348911+0000","last_active":"2024-04-23T19:04:07.348911+0000","last_peered":"2024-04-23T19:04:07.348911+0000","last_clean":"2024-04-23T19:04:07.348911+0000","last_became_active":"2024-04-23T19:00:17.315635+0000","last_became_peered":"2024-04-23T19:00:17.315635+0000","last_unstale":"2024-04-23T19:04:07.348911+0000","last_undegraded":"2024-04-23T19:04:07.348911+0000","last_fullsized":"2024-04-23T19:04:07.348911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'2","last_scrub_stamp":"2024-04-23T19:04:07.348615+0000","last_deep_scrub":"52'2","last_deep_scrub_stamp":"2024-04-23T19:04:07.348615+0000","last_clean_scrub_stamp":"2024-04-23T19:04:07.348615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:56.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'34","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.338926+0000","last_change":"2024-04-23T19:04:29.338987+0000","last_active":"2024-04-23T19:04:29.338926+0000","last_peered":"2024-04-23T19:04:29.338926+0000","last_clean":"2024-04-23T19:04:29.338926+0000","last_became_active":"2024-04-23T19:00:15.268486+0000","last_became_peered":"2024-04-23T19:00:15.268486+0000","last_unstale":"2024-04-23T19:04:29.338926+0000","last_undegraded":"2024-04-23T19:04:29.338926+0000","last_fullsized":"2024-04-23T19:04:29.338926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-04-23T19:04:29.338719+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-04-23T19:04:29.338719+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.338719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:54.010287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"98'12","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:16.414331+0000","last_change":"2024-04-23T19:04:16.414331+0000","last_active":"2024-04-23T19:04:16.414331+0000","last_peered":"2024-04-23T19:04:16.414331+0000","last_clean":"2024-04-23T19:04:16.414331+0000","last_became_active":"2024-04-23T19:00:17.301387+0000","last_became_peered":"2024-04-23T19:00:17.301387+0000","last_unstale":"2024-04-23T19:04:16.414331+0000","last_undegraded":"2024-04-23T19:04:16.414331+0000","last_fullsized":"2024-04-23T19:04:16.414331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'12","last_scrub_stamp":"2024-04-23T19:04:16.413901+0000","last_deep_scrub":"98'12","last_deep_scrub_stamp":"2024-04-23T19:04:16.413901+0000","last_clean_scrub_stamp":"2024-04-23T19:04:16.413901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.356368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'42","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:36.706593+0000","last_change":"2024-04-23T19:04:36.706657+0000","last_active":"2024-04-23T19:04:36.706593+0000","last_peered":"2024-04-23T19:04:36.706593+0000","last_clean":"2024-04-23T19:04:36.706593+0000","last_became_active":"2024-04-23T19:01:39.097996+0000","last_became_peered":"2024-04-23T19:01:39.097996+0000","last_unstale":"2024-04-23T19:04:36.706593+0000","last_undegraded":"2024-04-23T19:04:36.706593+0000","last_fullsized":"2024-04-23T19:04:36.706593+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:36.706392+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:36.706392+0000","last_clean_scrub_stamp":"2024-04-23T19:04:36.706392+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:44.109818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'12","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:22.791685+0000","last_change":"2024-04-23T19:04:22.791685+0000","last_active":"2024-04-23T19:04:22.791685+0000","last_peered":"2024-04-23T19:04:22.791685+0000","last_clean":"2024-04-23T19:04:22.791685+0000","last_became_active":"2024-04-23T19:00:17.289829+0000","last_became_peered":"2024-04-23T19:00:17.289829+0000","last_unstale":"2024-04-23T19:04:22.791685+0000","last_undegraded":"2024-04-23T19:04:22.791685+0000","last_fullsized":"2024-04-23T19:04:22.791685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-23T19:04:22.791401+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-23T19:04:22.791401+0000","last_clean_scrub_stamp":"2024-04-23T19:04:22.791401+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:59.670797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'46","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.766463+0000","last_change":"2024-04-23T19:04:24.766463+0000","last_active":"2024-04-23T19:04:24.766463+0000","last_peered":"2024-04-23T19:04:24.766463+0000","last_clean":"2024-04-23T19:04:24.766463+0000","last_became_active":"2024-04-23T19:00:15.287662+0000","last_became_peered":"2024-04-23T19:00:15.287662+0000","last_unstale":"2024-04-23T19:04:24.766463+0000","last_undegraded":"2024-04-23T19:04:24.766463+0000","last_fullsized":"2024-04-23T19:04:24.766463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-04-23T19:04:24.766174+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-04-23T19:04:24.766174+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.766174+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:53.085356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"53'2","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.975592+0000","last_change":"2024-04-23T19:04:08.975592+0000","last_active":"2024-04-23T19:04:08.975592+0000","last_peered":"2024-04-23T19:04:08.975592+0000","last_clean":"2024-04-23T19:04:08.975592+0000","last_became_active":"2024-04-23T19:00:17.324168+0000","last_became_peered":"2024-04-23T19:00:17.324168+0000","last_unstale":"2024-04-23T19:04:08.975592+0000","last_undegraded":"2024-04-23T19:04:08.975592+0000","last_fullsized":"2024-04-23T19:04:08.975592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:08.975323+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:08.975323+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.975323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:58.099593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'68","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:29.334087+0000","last_change":"2024-04-23T19:04:29.334087+0000","last_active":"2024-04-23T19:04:29.334087+0000","last_peered":"2024-04-23T19:04:29.334087+0000","last_clean":"2024-04-23T19:04:29.334087+0000","last_became_active":"2024-04-23T19:03:32.306628+0000","last_became_peered":"2024-04-23T19:03:32.306628+0000","last_unstale":"2024-04-23T19:04:29.334087+0000","last_undegraded":"2024-04-23T19:04:29.334087+0000","last_fullsized":"2024-04-23T19:04:29.334087+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'68","last_scrub_stamp":"2024-04-23T19:04:29.333653+0000","last_deep_scrub":"116'68","last_deep_scrub_stamp":"2024-04-23T19:04:29.333653+0000","last_clean_scrub_stamp":"2024-04-23T19:04:29.333653+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:58:12.464223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"57'2","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.723412+0000","last_change":"2024-04-23T19:04:14.723412+0000","last_active":"2024-04-23T19:04:14.723412+0000","last_peered":"2024-04-23T19:04:14.723412+0000","last_clean":"2024-04-23T19:04:14.723412+0000","last_became_active":"2024-04-23T19:00:17.298341+0000","last_became_peered":"2024-04-23T19:00:17.298341+0000","last_unstale":"2024-04-23T19:04:14.723412+0000","last_undegraded":"2024-04-23T19:04:14.723412+0000","last_fullsized":"2024-04-23T19:04:14.723412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'2","last_scrub_stamp":"2024-04-23T19:04:14.723146+0000","last_deep_scrub":"57'2","last_deep_scrub_stamp":"2024-04-23T19:04:14.723146+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.723146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:02.010322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'52","reported_seq":261,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.085353+0000","last_change":"2024-04-23T19:04:15.085353+0000","last_active":"2024-04-23T19:04:15.085353+0000","last_peered":"2024-04-23T19:04:15.085353+0000","last_clean":"2024-04-23T19:04:15.085353+0000","last_became_active":"2024-04-23T19:00:15.275587+0000","last_became_peered":"2024-04-23T19:00:15.275587+0000","last_unstale":"2024-04-23T19:04:15.085353+0000","last_undegraded":"2024-04-23T19:04:15.085353+0000","last_fullsized":"2024-04-23T19:04:15.085353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'52","last_scrub_stamp":"2024-04-23T19:04:15.085072+0000","last_deep_scrub":"116'52","last_deep_scrub_stamp":"2024-04-23T19:04:15.085072+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.085072+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:20.336880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"89'6","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.199400+0000","last_change":"2024-04-23T19:04:18.199400+0000","last_active":"2024-04-23T19:04:18.199400+0000","last_peered":"2024-04-23T19:04:18.199400+0000","last_clean":"2024-04-23T19:04:18.199400+0000","last_became_active":"2024-04-23T19:00:17.298321+0000","last_became_peered":"2024-04-23T19:00:17.298321+0000","last_unstale":"2024-04-23T19:04:18.199400+0000","last_undegraded":"2024-04-23T19:04:18.199400+0000","last_fullsized":"2024-04-23T19:04:18.199400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:18.199141+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:18.199141+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.199141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:22:05.503114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:26.789867+0000","last_change":"2024-04-23T19:04:26.789867+0000","last_active":"2024-04-23T19:04:26.789867+0000","last_peered":"2024-04-23T19:04:26.789867+0000","last_clean":"2024-04-23T19:04:26.789867+0000","last_became_active":"2024-04-23T19:00:15.280586+0000","last_became_peered":"2024-04-23T19:00:15.280586+0000","last_unstale":"2024-04-23T19:04:26.789867+0000","last_undegraded":"2024-04-23T19:04:26.789867+0000","last_fullsized":"2024-04-23T19:04:26.789867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:26.789515+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:26.789515+0000","last_clean_scrub_stamp":"2024-04-23T19:04:26.789515+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:17.697362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.521002+0000","last_change":"2024-04-23T19:04:12.521002+0000","last_active":"2024-04-23T19:04:12.521002+0000","last_peered":"2024-04-23T19:04:12.521002+0000","last_clean":"2024-04-23T19:04:12.521002+0000","last_became_active":"2024-04-23T19:00:17.305780+0000","last_became_peered":"2024-04-23T19:00:17.305780+0000","last_unstale":"2024-04-23T19:04:12.521002+0000","last_undegraded":"2024-04-23T19:04:12.521002+0000","last_fullsized":"2024-04-23T19:04:12.521002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:12.520732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:12.520732+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.520732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:49.463199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'56","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:25.351192+0000","last_change":"2024-04-23T19:04:25.351192+0000","last_active":"2024-04-23T19:04:25.351192+0000","last_peered":"2024-04-23T19:04:25.351192+0000","last_clean":"2024-04-23T19:04:25.351192+0000","last_became_active":"2024-04-23T19:00:15.266399+0000","last_became_peered":"2024-04-23T19:00:15.266399+0000","last_unstale":"2024-04-23T19:04:25.351192+0000","last_undegraded":"2024-04-23T19:04:25.351192+0000","last_fullsized":"2024-04-23T19:04:25.351192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:25.350900+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:25.350900+0000","last_clean_scrub_stamp":"2024-04-23T19:04:25.350900+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:35.569014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12,"num_write":96,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"89'12","reported_seq":243,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.093724+0000","last_change":"2024-04-23T19:04:28.093724+0000","last_active":"2024-04-23T19:04:28.093724+0000","last_peered":"2024-04-23T19:04:28.093724+0000","last_clean":"2024-04-23T19:04:28.093724+0000","last_became_active":"2024-04-23T19:00:17.296189+0000","last_became_peered":"2024-04-23T19:00:17.296189+0000","last_unstale":"2024-04-23T19:04:28.093724+0000","last_undegraded":"2024-04-23T19:04:28.093724+0000","last_fullsized":"2024-04-23T19:04:28.093724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'12","last_scrub_stamp":"2024-04-23T19:04:28.093465+0000","last_deep_scrub":"89'12","last_deep_scrub_stamp":"2024-04-23T19:04:28.093465+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.093465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:35.306478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'58","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:32.874297+0000","last_change":"2024-04-23T19:04:32.874297+0000","last_active":"2024-04-23T19:04:32.874297+0000","last_peered":"2024-04-23T19:04:32.874297+0000","last_clean":"2024-04-23T19:04:32.874297+0000","last_became_active":"2024-04-23T19:00:15.275865+0000","last_became_peered":"2024-04-23T19:00:15.275865+0000","last_unstale":"2024-04-23T19:04:32.874297+0000","last_undegraded":"2024-04-23T19:04:32.874297+0000","last_fullsized":"2024-04-23T19:04:32.874297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'58","last_scrub_stamp":"2024-04-23T19:04:32.874024+0000","last_deep_scrub":"116'58","last_deep_scrub_stamp":"2024-04-23T19:04:32.874024+0000","last_clean_scrub_stamp":"2024-04-23T19:04:32.874024+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:36.119058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"98'4","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.958072+0000","last_change":"2024-04-23T19:04:10.958072+0000","last_active":"2024-04-23T19:04:10.958072+0000","last_peered":"2024-04-23T19:04:10.958072+0000","last_clean":"2024-04-23T19:04:10.958072+0000","last_became_active":"2024-04-23T19:00:17.300268+0000","last_became_peered":"2024-04-23T19:00:17.300268+0000","last_unstale":"2024-04-23T19:04:10.958072+0000","last_undegraded":"2024-04-23T19:04:10.958072+0000","last_fullsized":"2024-04-23T19:04:10.958072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-23T19:04:10.957802+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-23T19:04:10.957802+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.957802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:32.529640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'62","reported_seq":273,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:15.348157+0000","last_change":"2024-04-23T19:04:15.348157+0000","last_active":"2024-04-23T19:04:15.348157+0000","last_peered":"2024-04-23T19:04:15.348157+0000","last_clean":"2024-04-23T19:04:15.348157+0000","last_became_active":"2024-04-23T19:00:15.280144+0000","last_became_peered":"2024-04-23T19:00:15.280144+0000","last_unstale":"2024-04-23T19:04:15.348157+0000","last_undegraded":"2024-04-23T19:04:15.348157+0000","last_fullsized":"2024-04-23T19:04:15.348157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'62","last_scrub_stamp":"2024-04-23T19:04:15.347904+0000","last_deep_scrub":"116'62","last_deep_scrub_stamp":"2024-04-23T19:04:15.347904+0000","last_clean_scrub_stamp":"2024-04-23T19:04:15.347904+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:31.678837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"53'2","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:11.018039+0000","last_change":"2024-04-23T19:04:11.018039+0000","last_active":"2024-04-23T19:04:11.018039+0000","last_peered":"2024-04-23T19:04:11.018039+0000","last_clean":"2024-04-23T19:04:11.018039+0000","last_became_active":"2024-04-23T19:00:17.324135+0000","last_became_peered":"2024-04-23T19:00:17.324135+0000","last_unstale":"2024-04-23T19:04:11.018039+0000","last_undegraded":"2024-04-23T19:04:11.018039+0000","last_fullsized":"2024-04-23T19:04:11.018039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-23T19:04:11.017650+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-23T19:04:11.017650+0000","last_clean_scrub_stamp":"2024-04-23T19:04:11.017650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:32.817124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'42","reported_seq":250,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:28.686978+0000","last_change":"2024-04-23T19:04:28.686978+0000","last_active":"2024-04-23T19:04:28.686978+0000","last_peered":"2024-04-23T19:04:28.686978+0000","last_clean":"2024-04-23T19:04:28.686978+0000","last_became_active":"2024-04-23T19:00:15.276989+0000","last_became_peered":"2024-04-23T19:00:15.276989+0000","last_unstale":"2024-04-23T19:04:28.686978+0000","last_undegraded":"2024-04-23T19:04:28.686978+0000","last_fullsized":"2024-04-23T19:04:28.686978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'42","last_scrub_stamp":"2024-04-23T19:04:28.686712+0000","last_deep_scrub":"116'42","last_deep_scrub_stamp":"2024-04-23T19:04:28.686712+0000","last_clean_scrub_stamp":"2024-04-23T19:04:28.686712+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:26.624601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'4","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:35.989674+0000","last_change":"2024-04-23T19:04:35.989674+0000","last_active":"2024-04-23T19:04:35.989674+0000","last_peered":"2024-04-23T19:04:35.989674+0000","last_clean":"2024-04-23T19:04:35.989674+0000","last_became_active":"2024-04-23T19:00:55.104104+0000","last_became_peered":"2024-04-23T19:00:55.104104+0000","last_unstale":"2024-04-23T19:04:35.989674+0000","last_undegraded":"2024-04-23T19:04:35.989674+0000","last_fullsized":"2024-04-23T19:04:35.989674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-23T19:04:35.989398+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-23T19:04:35.989398+0000","last_clean_scrub_stamp":"2024-04-23T19:04:35.989398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:14:04.308580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'44","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:14.087778+0000","last_change":"2024-04-23T19:04:14.087778+0000","last_active":"2024-04-23T19:04:14.087778+0000","last_peered":"2024-04-23T19:04:14.087778+0000","last_clean":"2024-04-23T19:04:14.087778+0000","last_became_active":"2024-04-23T19:00:15.273509+0000","last_became_peered":"2024-04-23T19:00:15.273509+0000","last_unstale":"2024-04-23T19:04:14.087778+0000","last_undegraded":"2024-04-23T19:04:14.087778+0000","last_fullsized":"2024-04-23T19:04:14.087778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:14.087323+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:14.087323+0000","last_clean_scrub_stamp":"2024-04-23T19:04:14.087323+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:47.703794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.593111+0000","last_change":"2024-04-23T19:04:18.593111+0000","last_active":"2024-04-23T19:04:18.593111+0000","last_peered":"2024-04-23T19:04:18.593111+0000","last_clean":"2024-04-23T19:04:18.593111+0000","last_became_active":"2024-04-23T19:00:17.301156+0000","last_became_peered":"2024-04-23T19:00:17.301156+0000","last_unstale":"2024-04-23T19:04:18.593111+0000","last_undegraded":"2024-04-23T19:04:18.593111+0000","last_fullsized":"2024-04-23T19:04:18.593111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T19:04:18.592844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T19:04:18.592844+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.592844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:24.774900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'44","reported_seq":253,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:19.994110+0000","last_change":"2024-04-23T19:04:19.994110+0000","last_active":"2024-04-23T19:04:19.994110+0000","last_peered":"2024-04-23T19:04:19.994110+0000","last_clean":"2024-04-23T19:04:19.994110+0000","last_became_active":"2024-04-23T19:00:15.279307+0000","last_became_peered":"2024-04-23T19:00:15.279307+0000","last_unstale":"2024-04-23T19:04:19.994110+0000","last_undegraded":"2024-04-23T19:04:19.994110+0000","last_fullsized":"2024-04-23T19:04:19.994110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:19.993852+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:19.993852+0000","last_clean_scrub_stamp":"2024-04-23T19:04:19.993852+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:54.257079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"98'10","reported_seq":251,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:12.754099+0000","last_change":"2024-04-23T19:04:12.754099+0000","last_active":"2024-04-23T19:04:12.754099+0000","last_peered":"2024-04-23T19:04:12.754099+0000","last_clean":"2024-04-23T19:04:12.754099+0000","last_became_active":"2024-04-23T19:00:17.301912+0000","last_became_peered":"2024-04-23T19:00:17.301912+0000","last_unstale":"2024-04-23T19:04:12.754099+0000","last_undegraded":"2024-04-23T19:04:12.754099+0000","last_fullsized":"2024-04-23T19:04:12.754099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'10","last_scrub_stamp":"2024-04-23T19:04:12.753839+0000","last_deep_scrub":"98'10","last_deep_scrub_stamp":"2024-04-23T19:04:12.753839+0000","last_clean_scrub_stamp":"2024-04-23T19:04:12.753839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:31.406847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'36","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:06.980779+0000","last_change":"2024-04-23T19:04:06.980779+0000","last_active":"2024-04-23T19:04:06.980779+0000","last_peered":"2024-04-23T19:04:06.980779+0000","last_clean":"2024-04-23T19:04:06.980779+0000","last_became_active":"2024-04-23T19:00:15.269436+0000","last_became_peered":"2024-04-23T19:00:15.269436+0000","last_unstale":"2024-04-23T19:04:06.980779+0000","last_undegraded":"2024-04-23T19:04:06.980779+0000","last_fullsized":"2024-04-23T19:04:06.980779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-04-23T19:04:06.980512+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-04-23T19:04:06.980512+0000","last_clean_scrub_stamp":"2024-04-23T19:04:06.980512+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:37.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"57'4","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:05.967890+0000","last_change":"2024-04-23T19:04:05.967890+0000","last_active":"2024-04-23T19:04:05.967890+0000","last_peered":"2024-04-23T19:04:05.967890+0000","last_clean":"2024-04-23T19:04:05.967890+0000","last_became_active":"2024-04-23T19:00:17.303150+0000","last_became_peered":"2024-04-23T19:00:17.303150+0000","last_unstale":"2024-04-23T19:04:05.967890+0000","last_undegraded":"2024-04-23T19:04:05.967890+0000","last_fullsized":"2024-04-23T19:04:05.967890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4","last_scrub_stamp":"2024-04-23T19:04:05.967627+0000","last_deep_scrub":"57'4","last_deep_scrub_stamp":"2024-04-23T19:04:05.967627+0000","last_clean_scrub_stamp":"2024-04-23T19:04:05.967627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:11:16.102311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'56","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:18.117953+0000","last_change":"2024-04-23T19:04:18.118087+0000","last_active":"2024-04-23T19:04:18.117953+0000","last_peered":"2024-04-23T19:04:18.117953+0000","last_clean":"2024-04-23T19:04:18.117953+0000","last_became_active":"2024-04-23T19:00:55.103907+0000","last_became_peered":"2024-04-23T19:00:55.103907+0000","last_unstale":"2024-04-23T19:04:18.117953+0000","last_undegraded":"2024-04-23T19:04:18.117953+0000","last_fullsized":"2024-04-23T19:04:18.117953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:18.117705+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:18.117705+0000","last_clean_scrub_stamp":"2024-04-23T19:04:18.117705+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:11:28.252389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"116'44","reported_seq":255,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.368761+0000","last_change":"2024-04-23T19:04:24.368761+0000","last_active":"2024-04-23T19:04:24.368761+0000","last_peered":"2024-04-23T19:04:24.368761+0000","last_clean":"2024-04-23T19:04:24.368761+0000","last_became_active":"2024-04-23T19:00:15.265448+0000","last_became_peered":"2024-04-23T19:00:15.265448+0000","last_unstale":"2024-04-23T19:04:24.368761+0000","last_undegraded":"2024-04-23T19:04:24.368761+0000","last_fullsized":"2024-04-23T19:04:24.368761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'44","last_scrub_stamp":"2024-04-23T19:04:24.368496+0000","last_deep_scrub":"116'44","last_deep_scrub_stamp":"2024-04-23T19:04:24.368496+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.368496+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:21:30.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"89'6","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:10.467416+0000","last_change":"2024-04-23T19:04:10.467478+0000","last_active":"2024-04-23T19:04:10.467416+0000","last_peered":"2024-04-23T19:04:10.467416+0000","last_clean":"2024-04-23T19:04:10.467416+0000","last_became_active":"2024-04-23T19:00:17.308531+0000","last_became_peered":"2024-04-23T19:00:17.308531+0000","last_unstale":"2024-04-23T19:04:10.467416+0000","last_undegraded":"2024-04-23T19:04:10.467416+0000","last_fullsized":"2024-04-23T19:04:10.467416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-04-23T19:04:10.467210+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-04-23T19:04:10.467210+0000","last_clean_scrub_stamp":"2024-04-23T19:04:10.467210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:23.529002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'56","reported_seq":245,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:24.375827+0000","last_change":"2024-04-23T19:04:24.375890+0000","last_active":"2024-04-23T19:04:24.375827+0000","last_peered":"2024-04-23T19:04:24.375827+0000","last_clean":"2024-04-23T19:04:24.375827+0000","last_became_active":"2024-04-23T19:03:32.296502+0000","last_became_peered":"2024-04-23T19:03:32.296502+0000","last_unstale":"2024-04-23T19:04:24.375827+0000","last_undegraded":"2024-04-23T19:04:24.375827+0000","last_fullsized":"2024-04-23T19:04:24.375827+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'56","last_scrub_stamp":"2024-04-23T19:04:24.375634+0000","last_deep_scrub":"116'56","last_deep_scrub_stamp":"2024-04-23T19:04:24.375634+0000","last_clean_scrub_stamp":"2024-04-23T19:04:24.375634+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:31.588647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'6","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-23T19:04:08.338075+0000","last_change":"2024-04-23T19:04:08.338197+0000","last_active":"2024-04-23T19:04:08.338075+0000","last_peered":"2024-04-23T19:04:08.338075+0000","last_clean":"2024-04-23T19:04:08.338075+0000","last_became_active":"2024-04-23T19:00:17.317065+0000","last_became_peered":"2024-04-23T19:00:17.317065+0000","last_unstale":"2024-04-23T19:04:08.338075+0000","last_undegraded":"2024-04-23T19:04:08.338075+0000","last_fullsized":"2024-04-23T19:04:08.338075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-23T19:04:08.337843+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-23T19:04:08.337843+0000","last_clean_scrub_stamp":"2024-04-23T19:04:08.337843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:48:07.590628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":345,"num_read_kb":325,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":35590,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1070,"num_read_kb":1553,"num_write":547,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":81788928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37328,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334512,"statfs":{"total":96636764160,"available":96598540288,"internally_reserved":0,"allocated":2039808,"data_stored":1406946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36720,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":1417216,"data_stored":815907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1462272,"data_stored":815753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1433600,"data_stored":815702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1400832,"data_stored":814476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":1437696,"data_stored":815992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37304,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334536,"statfs":{"total":96636764160,"available":96598564864,"internally_reserved":0,"allocated":2015232,"data_stored":1405784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T19:05:04.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T19:05:04.517 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T19:05:04.517 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T19:05:04.517 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T19:05:04.517 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:04.611 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T19:05:04.611 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T19:05:04.611 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:04.710 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T19:05:04.710 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T19:05:04.710 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:05.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-23T19:05:10.812 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T19:05:10.812 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T19:05:10.812 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:10.903 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T19:05:10.903 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-23T19:05:10.903 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:10.979 INFO:tasks.ceph.osd.4:Stopped 2024-04-23T19:05:10.979 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-23T19:05:10.979 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:11.078 INFO:tasks.ceph.osd.5:Stopped 2024-04-23T19:05:11.078 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-23T19:05:11.078 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:11.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-23T19:05:11.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-23T19:05:17.179 INFO:tasks.ceph.osd.6:Stopped 2024-04-23T19:05:17.180 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-23T19:05:17.180 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:17.235 INFO:tasks.ceph.osd.7:Stopped 2024-04-23T19:05:17.235 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T19:05:17.235 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-23T19:05:17.235 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:17.264 INFO:tasks.ceph.mgr.y:Stopped 2024-04-23T19:05:17.264 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T19:05:17.264 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:17.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-23T19:05:17.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-23T19:05:17.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-23T19:05:17.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-23T19:05:17.295 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T19:05:17.295 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T19:05:17.296 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T19:05:17.296 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:17.326 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T19:05:17.326 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-23T19:05:17.326 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:17.389 INFO:tasks.ceph.mon.c:Stopped 2024-04-23T19:05:17.389 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-23T19:05:17.389 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T19:05:17.411 INFO:tasks.ceph.mon.b:Stopped 2024-04-23T19:05:17.411 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T19:05:17.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-23T19:05:17.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T19:05:17.447 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T19:05:17.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T19:05:17.809 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T19:05:18.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T19:05:18.020 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T19:05:18.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T19:05:18.198 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T19:05:18.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T19:05:18.373 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-23T19:05:18.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T19:05:18.549 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-23T19:05:18.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T19:05:18.748 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-23T19:05:18.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T19:05:18.898 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-23T19:05:19.056 INFO:tasks.ceph:Archiving mon data... 2024-04-23T19:05:19.057 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/data/mon.a.tgz 2024-04-23T19:05:19.057 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-23T19:05:19.063 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.eZZlD0AiGR 2024-04-23T19:05:19.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eZZlD0AiGR 2024-04-23T19:05:19.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.eZZlD0AiGR 2024-04-23T19:05:19.298 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.eZZlD0AiGR is 574KB 2024-04-23T19:05:19.410 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.eZZlD0AiGR 2024-04-23T19:05:19.415 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/data/mon.c.tgz 2024-04-23T19:05:19.416 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-23T19:05:19.463 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.XZsjBWW1ff 2024-04-23T19:05:19.463 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XZsjBWW1ff 2024-04-23T19:05:19.675 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.XZsjBWW1ff 2024-04-23T19:05:19.738 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.XZsjBWW1ff is 735KB 2024-04-23T19:05:19.849 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.XZsjBWW1ff 2024-04-23T19:05:19.856 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/data/mon.b.tgz 2024-04-23T19:05:19.856 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-04-23T19:05:19.862 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.2VDA3FPoig 2024-04-23T19:05:19.862 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2VDA3FPoig 2024-04-23T19:05:20.085 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.2VDA3FPoig 2024-04-23T19:05:20.155 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.2VDA3FPoig is 735KB 2024-04-23T19:05:20.261 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.2VDA3FPoig 2024-04-23T19:05:20.267 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T19:05:20.267 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T19:05:20.270 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T19:05:20.331 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T19:05:20.371 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T19:05:20.372 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T19:05:20.373 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/remote/smithi169/crash 2024-04-23T19:05:20.374 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T19:05:20.388 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/crash to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/remote/smithi193/crash 2024-04-23T19:05:20.389 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T19:05:20.426 INFO:tasks.ceph:Compressing logs... 2024-04-23T19:05:20.427 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T19:05:20.435 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T19:05:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65793.log 2024-04-23T19:05:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66573.log 2024-04-23T19:05:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51485.log 2024-04-23T19:05:20.455 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65793.log.gz 2024-04-23T19:05:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56684.log 2024-04-23T19:05:20.463 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66573.log.gz 2024-04-23T19:05:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.51485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58327.log 2024-04-23T19:05:20.463 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51485.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65741.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56684.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58327.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.58327.log.gz -5 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53397.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65741.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61910.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57952.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53397.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61910.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61910.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57952.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.57952.log.gz 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-04-23T19:05:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:gzip/var/log/ceph/rgw.ceph.client.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53131.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.43673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65898.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53131.log: 87.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gzgzip 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52151.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53131.log.gz 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57978.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65898.log.gz 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57118.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52151.log.gz 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62539.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57978.log.gz 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65403.log 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57118.log.gz 2024-04-23T19:05:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.62539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66315.log 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62539.log.gz 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65403.log.gz 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65559.log 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66315.log.gz 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65559.log.gz 2024-04-23T19:05:20.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-23T19:05:20.495 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25150.log 2024-04-23T19:05:20.495 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25174.log 2024-04-23T19:05:20.495 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25150.log.gz 2024-04-23T19:05:20.495 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-23T19:05:20.495 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25174.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.25102.log -- replaced with /var/log/ceph/ceph-client.admin.25174.log.gz 2024-04-23T19:05:20.495 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25102.log.gz 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25198.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25126.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25198.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25198.log.gz 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25078.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25126.log.gz 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25078.log.gz 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T19:05:20.508 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25253.log 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25253.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25253.log.gz 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25229.log 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T19:05:20.509 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25229.log.gz 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37687.log 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53205.log 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37687.log.gz 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66295.log 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53822.log 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53205.log.gz 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66295.log.gz 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34367.log 2024-04-23T19:05:20.526 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52104.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53822.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25219.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34367.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52104.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56046.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64376.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25219.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67610.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56046.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64376.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39418.log 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67610.log.gz 2024-04-23T19:05:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58601.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.39418.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39418.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58601.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61390.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.44866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61390.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.41294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43079.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38277.log 2024-04-23T19:05:20.528 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.43079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49081.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43079.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.38277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31586.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38277.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.49081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49081.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54027.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55452.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31586.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33286.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54027.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.55452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55452.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53107.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53038.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33286.log.gz 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2024-04-23T19:05:20.529 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53107.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67558.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53038.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61827.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67584.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67558.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32990.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61827.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53174.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67584.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56729.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32990.log.gz 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53641.log 2024-04-23T19:05:20.530 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53174.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56729.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33691.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53641.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56630.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33691.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60496.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56630.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61613.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57244.log 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60496.log.gz 2024-04-23T19:05:20.531 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66601.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61613.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57244.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.66601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53969.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66601.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67376.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54183.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53969.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63729.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67376.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54183.log.gz 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.63729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33988.log 2024-04-23T19:05:20.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63729.log.gz 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53401.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54051.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33988.log.gz 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53401.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53401.log.gz 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66495.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54051.log.gz 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66310.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66495.log.gz 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65689.log 2024-04-23T19:05:20.533 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66310.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34143.log 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67714.log 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65689.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34143.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34227.log 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34509.log 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67714.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34227.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66092.log 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40073.log 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66092.log.gz 2024-04-23T19:05:20.534 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31576.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.40073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65637.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40073.log.gz 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31576.log.gz 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65585.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65637.log.gz 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65585.log.gz 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64608.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32925.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67688.log 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64608.log.gz 2024-04-23T19:05:20.535 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31394.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32925.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65845.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67688.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66079.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31394.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65320.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65845.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31910.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66079.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65320.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66521.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42482.log 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31910.log.gz 2024-04-23T19:05:20.536 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61753.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66521.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.42482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25065.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42482.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58075.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61753.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31592.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25065.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31187.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58075.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67298.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31592.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61948.log 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31187.log.gz 2024-04-23T19:05:20.537 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33051.log 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67298.log.gz 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61948.log.gz 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31784.log 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65897.log 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33051.log.gz 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65767.log 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31784.log.gz 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32867.log 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65897.log.gz 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65455.log 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65767.log.gz 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32867.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32867.log.gz -5 2024-04-23T19:05:20.538 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57849.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67402.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65455.log.gz 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65663.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57849.log.gz 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31185.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67402.log.gz 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65889.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65663.log.gz 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33373.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31185.log.gz 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65889.log.gz 2024-04-23T19:05:20.539 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61824.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33373.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61572.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33810.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61824.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32766.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61572.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65346.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33810.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32766.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59251.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.65346.log: -- /var/log/ceph/ceph-client.admin.48468.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65346.log.gz 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.59251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31030.log 2024-04-23T19:05:20.540 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59251.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.48468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34326.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48468.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52192.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31030.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46054.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34326.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66102.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52192.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.46054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53871.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46054.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38867.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66102.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33501.log 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53871.log.gz 2024-04-23T19:05:20.541 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.38867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31170.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38867.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33501.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58454.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31170.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50887.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56953.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58454.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20287.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.50887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50887.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56953.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56953.log.gz 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.tmp-client.admin.20287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32768.log 2024-04-23T19:05:20.542 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20287.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64697.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32768.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31588.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64697.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.48471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53597.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64530.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31588.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65819.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53597.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64530.log.gz 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67636.log 2024-04-23T19:05:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65819.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67454.log 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67636.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.67636.log.gz -- 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/ceph-client.admin.33448.log 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66309.log 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67454.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53486.log 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66309.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53317.log 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53486.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32667.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.66107.log -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-23T19:05:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53317.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53317.log.gz 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60684.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66107.log.gz 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.1.log: -- /var/log/ceph/ceph-client.admin.47282.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65883.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60684.log.gz 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.47282.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31108.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66086.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65883.log.gz 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31108.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67741.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31108.log.gz 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40690.log 2024-04-23T19:05:20.545 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66086.log.gz 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67741.log.gz 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65886.log 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.40690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63731.log 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40690.log.gz 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65886.log.gz 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57894.log 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65899.log 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.63731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63731.log.gz/var/log/ceph/ceph-client.admin.57894.log: 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31186.log 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57894.log.gz 2024-04-23T19:05:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53560.log 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65899.log.gz 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31186.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31186.log.gz -5 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31175.log 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60785.log 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53560.log.gz 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67220.log 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31175.log.gz 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60785.log.gz 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67246.log 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53774.log 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67220.log.gz 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67246.log.gz 2024-04-23T19:05:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31886.log 2024-04-23T19:05:20.606 INFO:teuthology.orchestra.run.smithi193.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30943.log 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53774.log: /var/log/ceph/ceph-client.admin.31886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53774.log.gz 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31599.log 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31886.log.gz 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52387.log 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.30943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30943.log.gz 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31599.log.gz 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58381.log 2024-04-23T19:05:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52387.log.gz 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34067.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58381.log.gz 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34661.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54142.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34067.log.gz 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34661.log.gz 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52349.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53750.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54142.log.gz/var/log/ceph/ceph-client.admin.52349.log: 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53798.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52349.log.gz 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56841.log 2024-04-23T19:05:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53750.log.gz 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53798.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.53798.log.gz --verbose 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/ceph-client.admin.31836.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56841.log.gz 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67532.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34482.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31836.log.gz 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65533.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67532.log.gz 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66095.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34482.log.gz 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61414.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65533.log: /var/log/ceph/ceph-client.admin.66095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61489.log 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66095.log.gz 0.0% 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65533.log.gz 2024-04-23T19:05:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61414.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60461.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61489.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61489.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33806.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60461.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65895.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66294.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33806.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65895.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46650.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66294.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.46650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46650.log.gz 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58576.log 2024-04-23T19:05:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35326.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58576.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58158.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65507.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.35326.log: /var/log/ceph/ceph-client.admin.58158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35326.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58158.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65507.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.65507.log.gz --verbose 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/ceph-client.admin.65481.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67194.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65481.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67272.log 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65481.log.gz 2024-04-23T19:05:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67194.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31082.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67272.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34234.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31936.log: /var/log/ceph/ceph-client.admin.31082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31082.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58457.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58550.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34234.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40077.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58457.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57982.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58550.log.gz 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31374.log 2024-04-23T19:05:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.40077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40077.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57982.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65611.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31374.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.50268.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60643.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57064.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65611.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64561.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60643.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45460.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57064.log.gz 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34736.log 2024-04-23T19:05:20.614 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64561.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.45460.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34421.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45460.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60713.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34736.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65715.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34421.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60713.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60713.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61461.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65715.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61659.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65715.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61461.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.57179.log 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61461.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61659.log.gz 2024-04-23T19:05:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54217.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56867.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57179.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54217.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65372.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56867.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65372.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67798.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64643.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67798.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64426.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64643.log.gz 2024-04-23T19:05:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64426.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53721.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49672.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53721.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.49672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32984.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49672.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 92.0% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67662.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0%/var/log/ceph/ceph-client.admin.67662.log: -- replaced with /var/log/ceph/ceph-client.admin.32984.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67662.log.gz 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57205.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52442.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T19:05:20.617 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57205.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31860.log 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31860.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54264.log 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31376.log 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.54264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54264.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65893.log 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31376.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57023.log 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65893.log.gz 2024-04-23T19:05:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31624.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.57023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66311.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57023.log.gz 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31624.log.gz 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66105.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66311.log.gz 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31178.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66105.log.gz 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61728.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66287.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31178.log.gz 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.61728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61728.log.gz 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31381.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33151.log 2024-04-23T19:05:20.619 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66287.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31381.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63133.log 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31134.log 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33151.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.63133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63133.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67324.log 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31134.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.46653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31375.log 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67350.log 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67324.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31375.log.gz 2024-04-23T19:05:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59845.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65429.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67350.log.gz 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.59845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59845.log.gz 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58657.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.65429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58006.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65429.log.gz 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58657.log.gz 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58289.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58006.log.gz 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58289.log.gz 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31810.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53669.log 2024-04-23T19:05:20.621 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31810.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67506.log 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35916.log 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53669.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67506.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.35916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56920.log 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35916.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66091.log 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.56920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56920.log.gz 2024-04-23T19:05:20.622 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66091.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52308.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58125.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52308.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58125.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58264.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67480.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58264.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52222.log 2024-04-23T19:05:20.623 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67769.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67480.log.gz 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.52222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52222.log.gz 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67822.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67769.log.gz 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67822.log.gz 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.47877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60532.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.50266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31183.log 2024-04-23T19:05:20.624 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60532.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64451.log 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67428.log 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31183.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.64451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64451.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31005.log 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.67428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67428.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31005.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34616.log 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58377.log 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34616.log.gz 2024-04-23T19:05:20.625 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58216.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36506.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58377.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58216.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32958.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.36506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33242.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36506.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32958.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66312.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33531.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33242.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66312.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66547.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25323.log 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33531.log.gz 2024-04-23T19:05:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.66547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66547.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33881.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.25323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31384.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25323.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33881.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32615.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.31384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60597.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31384.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32615.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41885.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.60597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60597.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.41885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41885.log.gz 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58215.log 2024-04-23T19:05:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.32723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53080.log 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58215.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.53080.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39481.log 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53080.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58524.log 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.39481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39481.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.58524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58524.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33349.log 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-04-23T19:05:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.33349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33349.log.gz 2024-04-23T19:05:20.649 INFO:teuthology.orchestra.run.smithi193.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-23T19:05:20.773 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-23T19:05:20.849 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T19:05:21.162 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T19:05:21.163 INFO:teuthology.orchestra.run.smithi193.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-23T19:05:21.253 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T19:05:21.279 INFO:teuthology.orchestra.run.smithi193.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-23T19:05:21.324 INFO:teuthology.orchestra.run.smithi193.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-23T19:05:21.356 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T19:05:21.411 INFO:teuthology.orchestra.run.smithi193.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-23T19:05:21.412 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-04-23T19:05:21.412 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m0.938s 2024-04-23T19:05:21.412 INFO:teuthology.orchestra.run.smithi193.stderr:user 0m3.329s 2024-04-23T19:05:21.412 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m0.155s 2024-04-23T19:05:21.535 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T19:05:21.536 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-23T19:05:21.536 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m1.099s 2024-04-23T19:05:21.536 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m4.020s 2024-04-23T19:05:21.537 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.224s 2024-04-23T19:05:21.537 INFO:tasks.ceph:Archiving logs... 2024-04-23T19:05:21.538 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/remote/smithi169/log 2024-04-23T19:05:21.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T19:05:22.341 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/remote/smithi193/log 2024-04-23T19:05:22.342 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T19:05:22.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-23T19:05:22.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-23T19:05:22.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-23T19:05:22.754 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T19:05:22.764 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T19:05:22.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T19:05:22.767 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T19:05:22.845 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T19:05:22.856 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T19:05:22.856 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T19:05:22.859 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T19:05:22.870 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T19:05:22.870 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-04-23T19:05:22.870 INFO:teuthology.orchestra.run.smithi169.stdout:*hv01.front.sepi 44.4.53.2 2 u 18 64 377 0.168 -1.166 0.927 2024-04-23T19:05:22.870 INFO:teuthology.orchestra.run.smithi169.stdout:+hv02.front.sepi 63.231.80.2 3 u 20 64 377 0.126 -0.567 0.913 2024-04-23T19:05:22.870 INFO:teuthology.orchestra.run.smithi169.stdout:+hv03.front.sepi 74.6.168.72 3 u 23 64 377 0.108 -1.295 0.923 2024-04-23T19:05:22.870 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T19:05:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T19:05:22.872 INFO:teuthology.orchestra.run.smithi193.stdout:============================================================================== 2024-04-23T19:05:22.872 INFO:teuthology.orchestra.run.smithi193.stdout:*hv01.front.sepi 44.4.53.2 2 u 20 64 377 0.048 -1.174 0.449 2024-04-23T19:05:22.872 INFO:teuthology.orchestra.run.smithi193.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 377 0.081 -0.530 0.382 2024-04-23T19:05:22.872 INFO:teuthology.orchestra.run.smithi193.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 377 0.069 -1.276 0.472 2024-04-23T19:05:22.872 INFO:teuthology.orchestra.run.smithi193.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T19:05:22.873 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T19:05:22.882 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T19:05:22.882 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T19:05:22.903 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T19:05:22.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T19:05:22.921 INFO:teuthology.task.internal:Duration was 918.257691 seconds 2024-04-23T19:05:22.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T19:05:22.933 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T19:05:22.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T19:05:22.936 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T19:05:22.973 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T19:05:22.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-04-23T19:05:22.974 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T19:05:23.020 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-04-23T19:05:23.020 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T19:05:23.031 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T19:05:23.031 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T19:05:23.064 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T19:05:23.104 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T19:05:23.104 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T19:05:23.143 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T19:05:23.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T19:05:23.223 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T19:05:23.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T19:05:23.236 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T19:05:23.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T19:05:23.259 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T19:05:23.283 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T19:05:23.291 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-04-23T19:05:23.300 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-04-23T19:05:23.356 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T19:05:23.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T19:05:23.363 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T19:05:23.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T19:05:23.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T19:05:23.413 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T19:05:23.414 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/remote/smithi169 2024-04-23T19:05:23.414 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T19:05:23.436 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/suriarte-2024-04-23_15:04:03-rgw-rgw-update-boost-redis-distro-default-smithi/7669961/remote/smithi193 2024-04-23T19:05:23.436 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T19:05:23.467 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T19:05:23.467 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T19:05:23.475 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T19:05:23.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T19:05:23.522 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T19:05:23.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T19:05:23.534 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T19:05:23.534 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T19:05:23.537 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T19:05:23.540 INFO:teuthology.orchestra.run.smithi169.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 19:05 /home/ubuntu/cephtest 2024-04-23T19:05:23.559 INFO:teuthology.orchestra.run.smithi193.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 19:05 /home/ubuntu/cephtest 2024-04-23T19:05:23.561 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T19:05:23.572 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T19:05:23.595 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 918.2576911449432 flavor: default owner: scheduled_suriarte@teuthology success: true 2024-04-23T19:05:23.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T19:05:23.681 INFO:teuthology.run:pass